---
title: "Only as Safe as the Weakest Agent: A... | SI Paper Desk"
url: https://thesimind.si/papers/2611.17520/
description: "When a strong SI model hands work to a cheaper sub-agent, the whole system can be only as safe as the weaker agent, even if the strong model alone resists..."
---

Paper of the Day · November 16, 2026

# Only as Safe as the Weakest Agent: A Break That Appears Only When the System Is Multi-Agent

When a strong SI model hands work to a cheaper sub-agent, the whole system can be only as safe as the weaker agent, even if the strong model alone resists the attack.

Keegan Wang and Anantika Mannby · Submitted November 12, 2026 · arXiv 2611.17520v1 · cs.MA

[Read the paper on arXiv](https://arxiv.org/abs/2611.17520) · [The PDF](https://arxiv.org/pdf/2611.17520) · [The day's 12](https://thesimind.si/papers/day/2026-11-16/)

## What they found

The authors tested Claude Code, Codex and a reference harness, all unmodified, using their own sub-agent features. They asked agents to answer questions from a store of files on disk where the authors had planted a forged record. When strong orchestrator models searched the files themselves, they made almost zero harmful revisions in over 1,000 trials. When the same orchestrator delegated to a cheaper sub-agent, the same models on the same facts failed on 20/180, 44/180, 75/180 and 553/900 trials. In simulations over 18 models, five aggregators that were almost never unsafe alone repeated a corrupted sub-agent's error in 751/757 trials. The authors conclude that system safety lands near the weak reader's, not the orchestrator's.

## Why it matters

Many real SI tools are built so a strong model plans and cheaper models do the reading and searching. Safety tests usually check one model on its own. This paper argues that this misses a failure that only shows up when models work together. The abstract does not say how the failure rates compare across all setups or how broadly the attack applies beyond these tests.

## How it changes the race

If the result holds, builders of frontier SI cannot rely on a strong model's safety record to cover a whole agent system. Cost-saving designs that pass work to cheaper sub-agents may need their own safety testing.

## Safety and control

The paper shows that attacks thought patched in single models can work again inside multi-agent systems, through a forged record passed along by a weaker sub-agent. Safety checks should cover the whole system and its weakest agent, not only the strongest model.

### The abstract, by the authors

Major industry multi-agent systems like Codex and Claude Code can be broken by attacks that have long been unsuccessful against modern frontier models. AI Safety as a discipline has largely focused on finding the bounds and vulnerabilities of AI models used in isolation. Yet as humans increasingly deploy these models as agents and multi-agent systems, the same attacks that had been thought to be patched when using a model in isolation can break these same models under specific circumstances. We show that these system breaks are not purely theoretical, but can break Claude Code, Codex, and a reference harness, all unmodified and used with their own sub-agent mechanisms. We show the attack by asking agents to answer questions from a store of files on disk in which we have planted a forged record. Searching the store themselves, the strong model orchestrators commit almost zero harmful revisions in over 1,000 trials. However, if that same orchestrator model delegates to a cheaper sub-agent, which is what these harnesses are built to do, the same models on the same facts fail on 20/180, 44/180, 75/180 and 553/900. Thus, even when the system is driven by a strong model, the system's safety lands near the weak reader's, not the orchestrator's. Simulations over 18 models show the same effect in the delivery channel where five aggregators, who on their own were almost never unsafe, repeat a corrupted sub-agent's error in 751/757 trials. The safety of real-world agentic systems that use strong orchestrator agents and weaker sub-agents, and multi-agent systems in general, is defined not by the safety of the strong agent but by the safety of the weakest agent.

Quoted from arXiv:2611.17520. The research and its words belong to its authors.

Desk score **89** out of 100

Why it was picked

- Frontier lab: Meta
- Agents (in the title)
- Safety
- Evals
- Multi-agent (in the title)
- Security
- Studies frontier models (Claude)

Topics

- [Safety](https://thesimind.si/papers/?tag=safety)
- [Multi-agent systems](https://thesimind.si/papers/?tag=multi-agent)
- [Security](https://thesimind.si/papers/?tag=security)
- [Agents](https://thesimind.si/papers/?tag=agents)
- [Evals](https://thesimind.si/papers/?tag=evals)
- [Language models](https://thesimind.si/papers/?tag=language-models)

**arXiv ID:** 2611.17520v1
**Submitted:** November 12, 2026
**Fields:** cs.MA (Multiagent Systems), cs.AI (Artificial Intelligence)
**Level:** Intermediate
**Comments:** Accepted to the NeurIPS 2026 First Workshop on Meta Agents: Managing Agents that Manage Agents (Meta-Agents)

Fingerprint, SHA-256

`8d368ba0c0e812be3eb8180d65228b3f89b368dde3645d1e9b240b40e0bd7cc9`

On Solana: [Proof of Mind seal, 3mXUMW...GSim](https://solscan.io/tx/3mXUMW5MkdFiyPBNPYd5DfwHhma5EdjhUFEw9jZaDuuPqgszJtoDYttSrD9kyWUFdMCzn7RnFNd4nQhwAUgrGSim)

### The exact text fingerprinted

{"arxiv":"2611.17520","version":1,"title":"Only as Safe as the Weakest Agent: A Break That Appears Only When the System Is Multi-Agent","authors":["Keegan Wang","Anantika Mannby"],"day":"2026-11-16","rank":1,"score":89,"status":"written","summary":{"takeaway":"When a strong SI model hands work to a cheaper sub-agent, the whole system can be only as safe as the weaker agent, even if the strong model alone resists the attack.","found":"The authors tested Claude Code, Codex and a reference harness, all unmodified, using their own sub-agent features. They asked agents to answer questions from a store of files on disk where the authors had planted a forged record. When strong orchestrator models searched the files themselves, they made almost zero harmful revisions in over 1,000 trials. When the same orchestrator delegated to a cheaper sub-agent, the same models on the same facts failed on 20/180, 44/180, 75/180 and 553/900 trials. In simulations over 18 models, five aggregators that were almost never unsafe alone repeated a corrupted sub-agent's error in 751/757 trials. The authors conclude that system safety lands near the weak reader's, not the orchestrator's.","matters":"Many real SI tools are built so a strong model plans and cheaper models do the reading and searching. Safety tests usually check one model on its own. This paper argues that this misses a failure that only shows up when models work together. The abstract does not say how the failure rates compare across all setups or how broadly the attack applies beyond these tests.","race":"If the result holds, builders of frontier SI cannot rely on a strong model's safety record to cover a whole agent system. Cost-saving designs that pass work to cheaper sub-agents may need their own safety testing.","safety":"The paper shows that attacks thought patched in single models can work again inside multi-agent systems, through a forged record passed along by a weaker sub-agent. Safety checks should cover the whole system and its weakest agent, not only the strongest model.","level":"intermediate","tags":["safety","multi-agent","security","agents","evals","language-models"]}}

[Check it on Verify a thought](https://thesimind.si/proof-of-mind/)

## The authors

Keegan Wang, Anantika Mannby

Credit for this research belongs to its authors. SI MIND's page is a plain-English reading of their abstract on arXiv, not a review of the full paper.

Related on the desk

## More papers on these topics

[Nov 21, 2026 · Number 2Replication of Agentic Security Events: Audit and Investigation (ROGUE-AI)ROGUE-SI rebuilds real news-reported SI agent failures offline, with a matched control, and finds most harm comes from ordinary missed hazards, not from attackers or prompt injection.SecurityAgentsSafety](https://thesimind.si/papers/2611.26553/) · [Nov 20, 2026 · Number 2AutoPI: Taxonomy-Guided Adaptive Red Teaming for Prompt Injection in LLM AgentsAutoPI is a red teaming tool that tests SI agents for prompt injection across many attack types, not just how often attacks work, and it reports higher success and coverage than recent rivals.SecurityAgentsEvals](https://thesimind.si/papers/2611.24313/) · [Nov 16, 2026 · Number 2Soteria: Formally Verified Planning with Runtime Enforcement for Safe LLM AgentsSoteria checks an SI agent's plan against written rules before any tool runs, then enforces those rules during execution. The authors report more completed tasks and no policy violations.AgentsSafetyReasoning](https://thesimind.si/papers/2611.17880/)

[All 12 for Nov 16, 2026](https://thesimind.si/papers/day/2026-11-16/) · [Number 2](https://thesimind.si/papers/2611.17880/)
