Mahal Systems

Overview › Benchmark catalog

B-MoCA

Fits mobile agents that must survive device variation. Borrow the configuration randomizer and the rule-based success detector over system logs, app data and view hierarchy.

What it asks the agent to do

  • do a daily phone task (alarm, settings, calls, apps) on a randomized device
  • stay correct across different screen layouts, languages and icon themes

What to borrow from it

sandbox designgrading design

Caveats

Small, simple tasks; code is linked only from the project site; license not stated.

Details

Workloadsmobile
Interactionsingle turn
Environmentmobile
End state checkedYes
ToolsAndroid emulator with randomized configuration, ADB, Appium
Gradingstate diff, programmatic check
Size131
Datasynthetic
Personal datanone
Licenseunknown
Harnessown repo
Statusactive

Links