Mahal Systems SWE-Dev
Fits feature-implementation agents rather than bug fixers. Borrow the Easy/Hard test split and the 14,000-instance training set if you train your own model.
What it asks the agent to do
- implement a new feature in an existing Python codebase from a description
- write about 190 lines across three files and pass developer-written unit tests
What to borrow from it
case templatebaseline
Caveats
Python only; feature descriptions are derived from the merged code rather than written by a product owner, so they can leak the solution shape.
Details
| Workloads | coding |
|---|---|
| Interaction | autonomous long horizon |
| Environment | containers |
| End state checked | Yes |
| Tools | shell, file editor |
| Grading | unit tests |
| Size | 500 |
| Data | real public |
| Personal data | possible |
| License | Apache-2.0 |
| Harness | own repo |
| Status | active |