Mahal Systems

Overview › Benchmark catalog

USACO

A cost-tracked algorithmic baseline available on HAL; useful as a sanity check for reasoning-heavy coding agents, not for product engineering.

What it asks the agent to do

  • solve a USA Computing Olympiad problem in Python against hidden tests
  • use retrieval of similar problems or reflection to improve a solution

What to borrow from it

baseline

Caveats

Olympiad puzzles with public solutions online; no repository or tools; license is not stated in the repo.

Details

Workloadscoding
Interactionsingle turn
Environmentstatic
End state checkedNo
Toolsnone
Gradingunit tests
Size307
Datareal public
Personal datanone
Licenseunknown
Harnessinspect_evals, hal, own repo
Statusactive

Links