Mahal Systems QRData
Fits analysis assistants that must apply statistics or causal methods correctly, not just run code. Borrow the pairing of each question with a data sheet and a companion text-only set to tell reasoning failures from data-handling failures.
What it asks the agent to do
- answer a statistics question using an attached data sheet
- answer a causal reasoning question using the provided data
- give a multiple-choice or numeric answer
What to borrow from it
case templatebaseline
Caveats
Non-commercial license; the README admits measurement errors in some text-only numeric questions; questions come from textbooks and papers, so they may be in training data.
Details
| Workloads | data analysis, science, education |
|---|---|
| Interaction | single turn |
| Environment | terminal |
| End state checked | No |
| Tools | python code interpreter |
| Grading | exact match |
| Size | 411 |
| Data | real public |
| Personal data | none |
| License | CC-BY-NC-4.0 |
| Harness | own repo |
| Status | active |