---
title: "Replication of Agentic Security Events... | SI Paper Desk"
url: https://thesimind.si/papers/2611.26553/
description: "ROGUE-SI rebuilds real news-reported SI agent failures offline, with a matched control, and finds most harm comes from ordinary missed hazards, not from..."
---

Number 2 of 12 · November 21, 2026

# Replication of Agentic Security Events: Audit and Investigation (ROGUE-AI)

ROGUE-SI rebuilds real news-reported SI agent failures offline, with a matched control, and finds most harm comes from ordinary missed hazards, not from attackers or prompt injection.

Mengxiao Wang, Mahbub Alam, Kalyan Nakka and 1 more · Submitted November 19, 2026 · arXiv 2611.26553v1 · cs.CR

[Read the paper on arXiv](https://arxiv.org/abs/2611.26553) · [The PDF](https://arxiv.org/pdf/2611.26553) · [The day's 12](https://thesimind.si/papers/day/2026-11-21/)

## What they found

The authors built ROGUE-SI, a multi-agent framework that rebuilds each reported agent incident offline. It also builds a matched control that lacks only the cause the report blames, then runs agents on both. It reproduced the reported harm in 89% of its 108 attempted replications. Agents built on five GPT, Claude, Gemini and DeepSeek models made the reported mistake in 18% to 33% of runs, against at most 1% without the blamed cause. Of 72 incidents with real-world harm, 62 had no underlying attacker. In those, agents did what the task asked but missed an ordinary hazard, such as a database shared with the live site. A warning after each tool output that named the hazard and its consequence lowered harm for all five models. A note of the same length that did not mention the hazard left most of the harm in place.

## Why it matters

News reports of SI agent failures usually say what went wrong but rarely check the incident or test its cause. Incident catalogs and benchmarks do not replicate incidents either. This work tests the blamed cause directly. The findings suggest that many real failures are not attacks, so defenses that only look for injected instructions would miss them.

## How it changes the race

If the result holds, vendors get a reusable audit they can rerun before each release, built from real incidents. It also points safety work toward helping agents notice everyday hazards, not only toward blocking attackers.

## Safety and control

The abstract reports that replications without an attacker caused more harm than prompt injection replications for all five models. It also says that warnings naming the specific hazard and its consequence reduced harm. The abstract does not say how far these results carry beyond the 108 replications.

### The abstract, by the authors

Agents based on large language models (LLMs) can now delete files and send payments on behalf of their users. News media reports routinely describe failures of these agents (e.g., Replit's coding agent deleting a production database), but a report often only says what went wrong and rarely (in)validates the incident or finds its root cause. Incident catalogs collect these reports, and benchmarks record whether agents fail, but neither replicates an incident nor tests the cause its report might identify. In this paper, we present ROGUE-AI (Replication of Agentic Security Events: Audit and Investigation), a multi-agent framework that closes the above gap and rebuilds each reported incident offline together with a matched control that lacks only the blamed cause, and runs agents on both. Our results suggest that ROGUE-AI is able to reproduce the reported harm in 89% of its 108 attempted replications. Agents built on five current GPT, Claude, Gemini and DeepSeek models made the reported mistake in 18% to 33% of runs, against at most 1% without the blamed cause. Of the 72 incidents with real-world harm, 62 had no underlying attacker, and in these, agents did what their task asked for but missed an ordinary hazard, such as a database shared with the live site. Replications without an attacker caused more harm than replications of prompt injection for all five models. Defenses against prompt injection look for injected instructions, but these replications contain none. Further, a warning after each tool output that names the hazard and its consequence lowered harm for all five models, whereas a note of the same length that does not mention the hazard left most of the harm in place. Built from real incidents, the ROGUE-AI replications form a reusable audit framework that vendors can rerun before each new release.

Quoted from arXiv:2611.26553. The research and its words belong to its authors.

Desk score **80** out of 100

Why it was picked

- Agents (in the title)
- Safety
- Evals
- Security
- Studies frontier models (Claude)
- Cross-listed in 3 fields
- Multi-agent

Topics

- [Security](https://thesimind.si/papers/?tag=security)
- [Agents](https://thesimind.si/papers/?tag=agents)
- [Safety](https://thesimind.si/papers/?tag=safety)
- [Evals](https://thesimind.si/papers/?tag=evals)
- [Multi-agent systems](https://thesimind.si/papers/?tag=multi-agent)
- [Language models](https://thesimind.si/papers/?tag=language-models)

**arXiv ID:** 2611.26553v1
**Submitted:** November 19, 2026
**Fields:** cs.CR (Cryptography and Security), cs.AI (Artificial Intelligence), cs.MA (Multiagent Systems)
**Level:** Intermediate
**Comments:** 21 pages, 5 figures, 13 tables. Project page: [https://rogue-ai.surge.sh](https://rogue-ai.surge.sh)

Fingerprint, SHA-256

`779f146f215b5317aa35c11aa68cd6e15c9a5d6c7ee0151c90bb97a7df2b9cfd`

On Solana: [Proof of Mind seal, beudvj...We9f](https://solscan.io/tx/beudvjGVbBTGVZsMaL2MgMJjuMy9dK2a2K3ETkw5AFwjoARs9PQedxMxfrBaiJ5MetjT2AHxuhfTCyP34eQWe9f)

### The exact text fingerprinted

{"arxiv":"2611.26553","version":1,"title":"Replication of Agentic Security Events: Audit and Investigation (ROGUE-AI)","authors":["Mengxiao Wang","Mahbub Alam","Kalyan Nakka","Nitesh Saxena"],"day":"2026-11-21","rank":2,"score":80,"status":"written","summary":{"takeaway":"ROGUE-SI rebuilds real news-reported SI agent failures offline, with a matched control, and finds most harm comes from ordinary missed hazards, not from attackers or prompt injection.","found":"The authors built ROGUE-SI, a multi-agent framework that rebuilds each reported agent incident offline. It also builds a matched control that lacks only the cause the report blames, then runs agents on both. It reproduced the reported harm in 89% of its 108 attempted replications. Agents built on five GPT, Claude, Gemini and DeepSeek models made the reported mistake in 18% to 33% of runs, against at most 1% without the blamed cause. Of 72 incidents with real-world harm, 62 had no underlying attacker. In those, agents did what the task asked but missed an ordinary hazard, such as a database shared with the live site. A warning after each tool output that named the hazard and its consequence lowered harm for all five models. A note of the same length that did not mention the hazard left most of the harm in place.","matters":"News reports of SI agent failures usually say what went wrong but rarely check the incident or test its cause. Incident catalogs and benchmarks do not replicate incidents either. This work tests the blamed cause directly. The findings suggest that many real failures are not attacks, so defenses that only look for injected instructions would miss them.","race":"If the result holds, vendors get a reusable audit they can rerun before each release, built from real incidents. It also points safety work toward helping agents notice everyday hazards, not only toward blocking attackers.","safety":"The abstract reports that replications without an attacker caused more harm than prompt injection replications for all five models. It also says that warnings naming the specific hazard and its consequence reduced harm. The abstract does not say how far these results carry beyond the 108 replications.","level":"intermediate","tags":["security","agents","safety","evals","multi-agent","language-models"]}}

[Check it on Verify a thought](https://thesimind.si/proof-of-mind/)

## The authors

Mengxiao Wang, Mahbub Alam, Kalyan Nakka, Nitesh Saxena

Credit for this research belongs to its authors. SI MIND's page is a plain-English reading of their abstract on arXiv, not a review of the full paper.

Related on the desk

## More papers on these topics

[Nov 16, 2026 · Paper of the DayOnly as Safe as the Weakest Agent: A Break That Appears Only When the System Is Multi-AgentWhen a strong SI model hands work to a cheaper sub-agent, the whole system can be only as safe as the weaker agent, even if the strong model alone resists the attack.SafetyMulti-agent systemsSecurity](https://thesimind.si/papers/2611.17520/) · [Nov 20, 2026 · Number 2AutoPI: Taxonomy-Guided Adaptive Red Teaming for Prompt Injection in LLM AgentsAutoPI is a red teaming tool that tests SI agents for prompt injection across many attack types, not just how often attacks work, and it reports higher success and coverage than recent rivals.SecurityAgentsEvals](https://thesimind.si/papers/2611.24313/) · [Nov 16, 2026 · Number 2Soteria: Formally Verified Planning with Runtime Enforcement for Safe LLM AgentsSoteria checks an SI agent's plan against written rules before any tool runs, then enforces those rules during execution. The authors report more completed tasks and no policy violations.AgentsSafetyReasoning](https://thesimind.si/papers/2611.17880/)

[Number 1](https://thesimind.si/papers/2611.25898/) · [All 12 for Nov 21, 2026](https://thesimind.si/papers/day/2026-11-21/) · [Number 3](https://thesimind.si/papers/2611.26248/)
