Mahal Systems FEA-Bench
Fits incremental-development agents in Python; the task format (issue plus new component signatures plus tests) is a usable template for feature cases.
What it asks the agent to do
- add a feature to a repository given a description and the new function signatures
- make new unit tests from the feature pull request pass
What to borrow from it
case template
Caveats
Instance count and data license were not visible on the paper page; the code link is not on the arXiv page, so check availability before planning on it.
Details
| Workloads | coding |
|---|---|
| Interaction | autonomous long horizon |
| Environment | containers |
| End state checked | Yes |
| Tools | shell, file editor |
| Grading | unit tests |
| Size | Not published |
| Data | real public |
| Personal data | possible |
| License | unknown |
| Harness | own repo |
| Status | active |