Mahal Systems

Overview › Benchmark catalog

WebArena-Infinity

Fits teams that need many fresh, uncontaminated browser tasks; borrow the pipeline that generates an app, its tasks and verifiers with coding agents and audits them with browser agents.

What it asks the agent to do

  • complete generated tasks on auto-built web apps
  • difficulty-graded tasks with programmatic verifiers

What to borrow from it

sandbox designcase template

Caveats

Blog post only, no paper; task count not published; environments are synthetic apps so realism is unverified; very new.

Details

Workloadsweb browsing, workflow automation
Interactionsingle turn
Environmentbrowser
End state checkedYes
Toolsbrowser actions on generated web apps
Gradingprogrammatic check, state diff
SizeNot published
Datasynthetic
Personal datanone
LicenseMIT
Harnessown repo
Statusactive

Links