Mahal Systems

Overview › Benchmark catalog

AIOpsLab

Fits incident-response agents; borrow the four-stage taxonomy (detection, localization, analysis, mitigation) and the problem = app + fault + workload + evaluator structure.

What it asks the agent to do

  • detect that a fault has been injected into a microservice app
  • localize and explain the root cause from telemetry
  • mitigate the fault and restore service

What to borrow from it

sandbox designtaxonomy

Caveats

Problem count is not stated and lives in a registry file; needs a Kubernetes cluster; network noise makes runs non-deterministic.

Details

Workloadsit ops, devops
Interactionautonomous long horizon
Environmentcontainers
End state checkedYes
Toolskubectl, shell, telemetry queries
Gradingprogrammatic check, state diff
SizeNot published
Datasynthetic
Personal datanone
LicenseMIT
Harnessown repo
Statusactive

Links