An Open Pipeline and Dashboard for Systemic-Risk Evidence under the EU AI Act's Code of Practice
[Sztuczna inteligencja] Autorzy: Jacob T. Emmerson, Phuong-Anh Nguyen-Le, Ronan Romano i 3 więcej
Claims about AI safety reach audiences well beyond the AI community, yet many rely on opaque evidence or static assessments, when supporting evidence is accessible at all. We present the Systemic Risk Index, an open evaluation pipeline and dashboard built to make empirical evidence more transparent and traceable to the public. Our work organizes 19 public benchmarks into four systemic-risk categories defined by the EU GPAI Code of Practice---CBRN, cyber offense, harmful manipulation, and loss of control---and evaluates models using harm-preserving perturbations and simulated deployment contexts. The interactive dashboard lets users alternate between average and worst-case aggregation, vary how model capability affects the aggregate score, and trace each risk rating to its benchmark evidence. Across 18 models, scores fall by 14 to 37 points under worst-case aggregation, highlighting info…
- Kategoria arxiv
- cs.AI
- Kategoria
- Sztuczna inteligencja