Number 5 of 12 · November 19, 2026

Evolution Under Fire: Evolving Agent Safety Harnesses with Adaptive Injection Stressors

The authors let an automated search build and improve the safety wrapper around an SI agent, testing it against evolving attacks, and cut attack success sharply on the benchmarks they report.

What they found

The authors built Evolution Under Fire. It automatically evolves a "safety harness", which is the code that wraps an agent and guards it against malicious instructions hidden in emails, webpages and documents. The task model, benchmark, tools and evaluator stay fixed while the harness changes. A second part evolves attacks that still let the task get done, and these attacks guide a further round of harness evolution. On AgentDyn with GPT-4o-mini, attack success fell from 50.4% to 3.0%, and utility improved over the initial harness. On Agent-SafetyBench with Qwen2.5-7B-Instruct, attack success fell from 82.6% to 62.0%. Evolved harnesses moved to Qwen3.5-35B-A3B without more evolution, cutting attack success from 32.1% to 0.9%.

Why it matters

Agents that read untrusted content face a hard problem: attacker instructions and real task instructions arrive through the same channel. Most defenses today are written by hand and stay static. This work suggests defenses can be improved by automated search that uses attack evidence. The abstract reports results on two benchmarks and three models. It does not say how well this holds against attacks outside those tests.

How it changes the race

If the results hold, teams building agents could spend less manual effort on defenses and update them as attacks change. It is a method for hardening the layer around a model, not a gain in the model's own capability.

Safety and control

This bears directly on prompt injection, where hidden instructions hijack an agent. The 62.0% attack success on Agent-SafetyBench is still high after evolution. Defenses tuned against generated attacks may also miss new kinds of attack, which the abstract does not address.

The abstract, by the authors

Tool-using language-model agents must act on information from untrusted emails, webpages, and documents. This creates a central security challenge: malicious instructions and legitimate task directives can arrive through the same interaction channel. Existing defenses are largely hand-designed and static, making further improvements dependent on repeated manual redesign. We introduce Evolution Under Fire, a staged framework that couples safety-harness evolution with adaptive stressor evolution. Utility-constrained, Pareto-scheduled tree search evolves complete executable safety harnesses from execution evidence while keeping the task model, benchmark, tools, and evaluator fixed. Adaptive stressor evolution then discovers utility-preserving attacks that guide a subsequent stage of harness evolution. On AgentDyn with GPT-4o-mini, an evolved harness reduces attack success from 50.4% to 3.0%, improves clean and attacked utility over the initial harness, and offers a stronger security-utility trade-off than reproduced defenses. On Agent-SafetyBench with Qwen2.5-7B-Instruct, harness evolution reduces attack success from 82.6% to 62.0% while retaining helpfulness and runtime validity. Evolved harnesses also transfer without further evolution to Qwen3.5-35B-A3B, reducing attack success from 32.1% to 0.9% while improving attacked-task utility.

Quoted from arXiv:2611.22583. The research and its words belong to its authors.

The authors

Yujun Wang, Yilun Liu, Jinhe Bi, Krishna Kanth Nakka, Xuebing Zhou, Hinrich Sch{ü}tze, Yunpu Ma

Credit for this research belongs to its authors. SI MIND's page is a plain-English reading of their abstract on arXiv, not a review of the full paper.