A curated 500-case root-cause-analysis (RCA) evaluation set for microservice systems, with manifest-driven causal-graph ground truth.
Each case bundles:
injection.json)causal_graph.json)env.json, result.json,
label.txt)The corpus spans three open-source microservice testbeds:
| system | n | description |
|---|---|---|
ts (Train-Ticket) | 320 | Java/Spring Cloud microservice system, 44 application services |
hs (Hotel Reservation / DeathStarBench) | 142 | Go/gRPC microservice system, 9 application services |
otel-demo | 38 | OpenTelemetry Demo e-commerce app, 15 polyglot application services |
Benchmarking RCA algorithms on microservice fault propagation. Each case provides the ground-truth root-cause service(s) and a manifest-derived causal graph against which an algorithm's predicted ranking or path can be scored.
internal/reasoning)
enumerates the fault propagation layer-by-layer from the registered
fault manifest, producing the causal_graph.json ground truth.This repo card summarizes the released artifact itself. The full generation and selection pipeline will be documented in the associated paper / artifact release.
ops-lite/
├── manifest.jsonl # 500 lines, one JSON record per case
├── README.md
├── croissant.json # core Croissant + RAI fields
└── cases/
└── <case-name>/
├── injection.json
├── causal_graph.json
├── env.json
├── result.json
├── label.txt
└── *.parquet # abnormal_* + normal_*
manifest.jsonl schema:
{
"name": "ts0-ts-order-service-exception-l2bqm5",
"system": "ts|hs|otel-demo",
"longest_path": 7,
"n_svc": 13,
"n_edge": 21,
"n_alarm_svc": 2,
"root_services": ["ts-order-service"],
"chaos_family": "JVM*|HTTP*|Network*|Pod*|*Stress|DNS|Time|hybrid_clean|hybrid_kill",
"primary_kind": "<chaos_type or 'hybrid'>",
"subtypes": ["..."],
"hybrid": false,
"has_kill_leg": false
}
| metric | value |
|---|---|
| total cases | 500 |
mean longest_path | 3.18 |
mean n_edge | 4.06 |
mean n_svc | 3.97 |
| chaos families | 8 |
| systems | 3 |
Apache-2.0. The underlying microservice testbeds (Train-Ticket, Hotel Reservation / DeathStarBench, OpenTelemetry Demo) retain their own upstream licenses.
A formal citation will be added on publication.
29 commits
A curated 500-case root-cause-analysis (RCA) evaluation set for microservice systems, with manifest-driven causal-graph ground truth.
Each case bundles:
injection.json)causal_graph.json)env.json, result.json,
label.txt)The corpus spans three open-source microservice testbeds:
| system | n | description |
|---|---|---|
ts (Train-Ticket) | 320 | Java/Spring Cloud microservice system, 44 application services |
hs (Hotel Reservation / DeathStarBench) | 142 | Go/gRPC microservice system, 9 application services |
otel-demo | 38 | OpenTelemetry Demo e-commerce app, 15 polyglot application services |
Benchmarking RCA algorithms on microservice fault propagation. Each case provides the ground-truth root-cause service(s) and a manifest-derived causal graph against which an algorithm's predicted ranking or path can be scored.
internal/reasoning)
enumerates the fault propagation layer-by-layer from the registered
fault manifest, producing the causal_graph.json ground truth.This repo card summarizes the released artifact itself. The full generation and selection pipeline will be documented in the associated paper / artifact release.
ops-lite/
├── manifest.jsonl # 500 lines, one JSON record per case
├── README.md
├── croissant.json # core Croissant + RAI fields
└── cases/
└── <case-name>/
├── injection.json
├── causal_graph.json
├── env.json
├── result.json
├── label.txt
└── *.parquet # abnormal_* + normal_*
manifest.jsonl schema:
{
"name": "ts0-ts-order-service-exception-l2bqm5",
"system": "ts|hs|otel-demo",
"longest_path": 7,
"n_svc": 13,
"n_edge": 21,
"n_alarm_svc": 2,
"root_services": ["ts-order-service"],
"chaos_family": "JVM*|HTTP*|Network*|Pod*|*Stress|DNS|Time|hybrid_clean|hybrid_kill",
"primary_kind": "<chaos_type or 'hybrid'>",
"subtypes": ["..."],
"hybrid": false,
"has_kill_leg": false
}
| metric | value |
|---|---|
| total cases | 500 |
mean longest_path | 3.18 |
mean n_edge | 4.06 |
mean n_svc | 3.97 |
| chaos families | 8 |
| systems | 3 |
Apache-2.0. The underlying microservice testbeds (Train-Ticket, Hotel Reservation / DeathStarBench, OpenTelemetry Demo) retain their own upstream licenses.
A formal citation will be added on publication.
29 commits