Number 6 of 12 · November 12, 2026

When Should Agents Remember? Falsification-Gated Self-Evolution for LLM Agents

The authors propose testing each lesson an SI agent learns as a hypothesis before saving it to memory, and report fewer harmful memory updates as a result.

What they found

The authors build Falsification-Gated Self-Evolution (FGSE). Instead of writing a lesson straight into memory after one success, the agent turns it into a structured hypothesis. The hypothesis has a precondition, a behavior change, an expected effect and a verifier (a check that can confirm the result). The agent applies it in a temporary state and runs three kinds of tests: transfer to the target task, an attempt to falsify it, and a check against archived cases for regressions. Then it commits, refines or rejects the lesson. The abstract reports 39.8 WebArena success rate, 78.8 AppWorld average completion, and 0.724/0.487 Pass¹ on τ-Retail/τ-Airline. It also reports falsification failures of 5.0%, regression damage of 1.3% and harmful committed updates of 3.6%. The abstract does not say which baselines were compared.

Why it matters

SI agents that learn from their own experience can store bad lessons. A lesson that worked once may fail elsewhere or break something that worked before. This paper treats memory writing as a decision that needs evidence. That could make long-running agents more dependable. The abstract does not give details on cost, such as how many extra tests each update needs.

How it changes the race

If the results hold, teams building agents could add a testing gate to self-improvement. That would be a practical reliability step rather than a new capability. It depends on having verifiers, so it fits some environments better than others.

Safety and control

The framework aims to stop harmful or unsafe knowledge from entering an agent's persistent state, and it reports a 3.6% rate of harmful committed updates. It relies on verifiers, so its protection is only as good as those checks. The abstract does not say how it handles cases with no good verifier.

The abstract, by the authors

LLM agents increasingly operate in long-horizon, verifier-rich environments, but current self-improvement mechanisms often write episode-derived lessons directly into memory, making local success an unreliable signal for reusable and safe knowledge. This paper addresses the core question of when an experience-derived behavioral update should be admitted into persistent agent state. We propose Falsification-Gated Self-Evolution (FGSE), a verifier-grounded framework that represents each candidate lesson as a structured hypothesis with an explicit precondition, behavior change, expected effect, and verifier. FGSE applies the hypothesis only in a temporary state, tests it on target-transfer, falsification, and archived-regression probes, and then commits, refines, or rejects it according to measured gain and risk. Across web, app, tool-use, and long-term memory benchmarks, FGSE achieves strong task performance, including 39.8 WebArena success rate, 78.8 AppWorld average completion, and 0.724/0.487 Pass¹ on τ-Retail/τ-Airline, while reducing falsification failures to 5.0%, regression damage to 1.3%, and harmful committed updates to 3.6%. These results suggest that testing memory updates as hypotheses supports more reliable long-term adaptation.

Quoted from arXiv:2611.14326. The research and its words belong to its authors.

The authors

Runxuan Tang, Haoyu Gao, Yuyan Ding, Junyi Yao, Zihao Zheng, Zecheng Sheng, Liwei Hou

Credit for this research belongs to its authors. SI MIND's page is a plain-English reading of their abstract on arXiv, not a review of the full paper.