Mahal Systems

Overview › Benchmark catalog

LogiOR (ORThought)

Fits planning or operations-research copilots that turn a logistics request into a solvable model. Borrow the case format (problem text, reference formulation, reference solver code, optimal value, size and type metadata) and grading on the optimal value.

What it asks the agent to do

  • read a logistics or transport planning problem in plain words
  • write a mathematical optimization model for it
  • write and run solver code (Gurobi) that solves the model
  • return the optimal objective value

What to borrow from it

grading designcase template

Caveats

Only 92 problems; needs a Gurobi license beyond the free trial for larger problems; grades the final objective value so a wrong model with the right number passes; no license stated for the data or code.

Details

Workloadsplanning, data analysis, coding, manufacturing
Interactionsingle turn
Environmentterminal
End state checkedNo
ToolsPython, Gurobi solver
Gradingprogrammatic check
Size92
Datasynthetic
Personal datanone
Licenseunknown
Harnessown repo
Statusactive

Links