Mahal Systems

Overview › Benchmark catalog

WebMall

Fits comparison-shopping agents; borrow the multi-shop offline sandbox built from Common Crawl product pages and the basic / advanced task split.

What it asks the agent to do

  • find a specific product across four shops and compare prices
  • find substitutes or compatible products from a vague description
  • add to cart and check out

What to borrow from it

sandbox designcase template

Caveats

Small; shops are simplified; license not stated; best agents 62 to 75 percent on basic tasks and 19 to 41 on advanced.

Details

Workloadsshopping, retail, web browsing
Interactionsingle turn
Environmentbrowser
End state checkedYes
Toolsfour self hosted simulated shops
Gradingprogrammatic check, state diff
Size91
Datamixed
Personal datanone
Licenseunknown
Harnessown repo
Statusactive

Links