Research
New Benchmark Measures How Multi-Agent Systems Fail and Recover
OrchestraBench, a new benchmark introduced in an arXiv paper, uses controlled failure injection to measure how multi-agent systems fail and recover. It introduces metrics like cascade radius and per-failure-mode recovery, revealing that simple routers fail on adversarial cases while intent-reasoning models succeed. The benchmark also identifies three tiers of failure handling and shows that blind retry amplifies latent faults.
Aug 74 minNeura News