Mahal Systems

Overview › Benchmark catalog

WebGames

Fits teams that want fast, hermetic checks of raw browser control. Borrow the password-on-success grading, which needs no judge or state inspection.

What it asks the agent to do

  • solve a small self-contained browser challenge (drag, scroll, timing, canvas)
  • handle tricky inputs, pop-ups and adversarial page tricks
  • read visual puzzles on the page

What to borrow from it

grading designcase template

Caveats

Toy pages, not real sites; paper says 50+ challenges while the repo has 150; license not stated; best agent 43.1 percent versus 95.7 for humans.

Details

Workloadsweb browsing, games
Interactionsingle turn
Environmentbrowser
End state checkedNo
Toolsclient side web pages, no network
Gradingexact match
Size150
Datasynthetic
Personal datanone
Licenseunknown
Harnessown repo
Statusactive

Links