Mahal Systems

Overview › Benchmark catalog

TeleMath

Fits radio-planning or network-engineering assistants that must do arithmetic on telecom quantities. Borrow its seed-and-expand pattern (50 expert problems grown to 500 with numeric-only answers that grade without a judge).

What it asks the agent to do

  • solve a numerical telecom engineering problem
  • compute link budgets, capacities or signal metrics
  • return a single numeric answer

What to borrow from it

case templatebaseline

Caveats

450 of 500 problems are model-generated from 50 seeds; dataset on Hugging Face (netop/TeleMath) is gated behind a contact form and no license is stated; question-answer only, no agent actions.

Details

Workloadstelecom, knowledge qa
Interactionsingle turn
Environmentstatic
End state checkedNo
Toolsnone
Gradingexact match
Size500
Datasynthetic
Personal datanone
Licenseunknown
Harnessown repo
Statusactive

Links