Remote Labor Index (RLI)
Fits teams who want an economic value baseline for end-to-end work. Borrow the 3-point expert rating with majority vote and the Bradley-Terry pairing against a human reference.
What it asks the agent to do
- deliver a complete freelance project from a brief and input files
- produce media, CAD, web, design or data deliverables
- draft legal or business documents to a client's spec
What to borrow from it
baselinegrading designtaxonomy
Caveats
Only 10 of 240 projects are public; human grading only; projects skew to media and design rather than office workflows.
Details
| Workloads | general assistant, documents, data analysis, coding |
|---|---|
| Interaction | single turn |
| Environment | static |
| End state checked | No |
| Tools | any; deliverables are judged, not the process |
| Grading | human |
| Size | 240 |
| Data | real public |
| Personal data | possible |
| License | unknown |
| Harness | none |
| Status | active |