---
title: "AVCORP: Identifying and Resisting... | SI Paper Desk"
url: https://thesimind.si/papers/2611.10176/
description: "The authors built AVCORP, a set of 5,000 annotated Avalon game utterances, and showed that training a small model on it improves deception detection, in one..."
---

Number 4 of 12 · November 10, 2026

# AVCORP: Identifying and Resisting Deception via Communication Theory and Theory of Mind

The authors built AVCORP, a set of 5,000 annotated Avalon game utterances, and showed that training a small model on it improves deception detection, in one test matching Claude Opus 5.5.

Fardin Saad, Zhe Zhang, Sanjana Cheerla and 2 more · Submitted November 6, 2026 · arXiv 2611.10176v1 · cs.AI

[Read the paper on arXiv](https://arxiv.org/abs/2611.10176) · [The PDF](https://arxiv.org/pdf/2611.10176) · [The day's 12](https://thesimind.si/papers/day/2026-11-10/)

## What they found

The authors built AVCORP, a corpus of 5,000 annotated utterances from 250 games of Avalon, a social game built on hidden roles and lying. It labels 37 deception tactics, mapped to a 4x4 behavior matrix. It also includes reasoning traces with abductive hypotheses (best-guess explanations), suspicion levels, and nested Theory of Mind beliefs (what one player thinks another player believes). They trained Qwen3-8B on it and tested on 25 held-out games and 20 games played by humans. On held-out games, their best trained detector beat its untrained baseline and the frontier models GPT-5.6 Sol, Gemini 3.1 Pro and DeepSeek-V4-Pro, and matched Claude Opus 5.5. On human games, every trained detector beat the untrained model in F1 score across all rounds. The abstract gives no exact scores.

## Why it matters

SI agents are starting to talk with users and with other agents, and either may try to deceive them. This work offers a training set and a method aimed at spotting deception. It also shows that a small 8B model can compete with much larger ones on this narrow task. The abstract does not say how well results carry over from a game to real-world deception.

## How it changes the race

If the result holds, deception detection may not need the largest models, which would lower the cost of building it. It is a narrow, game-based result, so it is an incremental step.

## Safety and control

The paper bears directly on defending SI agents against manipulation by users and other agents. The abstract does not say whether skills learned in Avalon transfer to other settings.

### The abstract, by the authors

Today's LLM-based agents are vulnerable to deception by users and other agents. Defending against deception requires Theory of Mind (ToM) reasoning to infer the beliefs and goals of others as well as modeling tactics based on communication theory. To enable training models to detect deception, we adopt the well-known deception game, Avalon. We present a corpus, AVCORP, of 5,000 annotated utterances from 250 games of Avalon. AVCORP includes (1) 37 tactics mapped to a 4x4 behavior matrix, and (2) reasoning traces capturing abductive hypotheses, suspicion levels, and nested ToM beliefs. We train Qwen3-8B on AVCORP and evaluate it on 25 held-out games and 20 games played by humans. On held-out games, our best trained detector outperforms its untrained baseline and frontier models (GPT-5.6 Sol, Gemini 3.1 Pro, DeepSeek-V4-Pro), matching Claude Opus 5.5. On human games, every trained detector exceeds the untrained model in F1 score across all rounds.

Quoted from arXiv:2611.10176. The research and its words belong to its authors.

Desk score **82** out of 100

Why it was picked

- Safety (in the title)
- Agents
- Reasoning
- Evals
- Studies frontier models (Qwen3)
- Cross-listed in 3 fields
- Language models

Topics

- [Safety](https://thesimind.si/papers/?tag=safety)
- [Agents](https://thesimind.si/papers/?tag=agents)
- [Multi-agent systems](https://thesimind.si/papers/?tag=multi-agent)

**arXiv ID:** 2611.10176v1
**Submitted:** November 6, 2026
**Fields:** cs.AI (Artificial Intelligence), cs.CL (Computation and Language), cs.LG (Machine Learning)
**Level:** Intermediate
**Comments:** 36 pages (with appendix), 17 figures, 24 tables. Code and corpus: [https://github.com/fardinsaad/_AVCORP_](https://github.com/fardinsaad/_AVCORP_) . Dataset and detector: [https://huggingface.co/collections/fardinsaad/avcorp](https://huggingface.co/collections/fardinsaad/avcorp)

Fingerprint, SHA-256

`328c8d4c2c37b086fd6944bfa2b8b5b8415b6f49145d146b1c3af3e7c0206b56`

In SI MIND's journal since Nov 10, 2026, 03:15 UTC. It goes on Solana with the next hourly Proof of Mind seal.

### The exact text fingerprinted

{"arxiv":"2611.10176","version":1,"title":"AVCORP: Identifying and Resisting Deception via Communication Theory and Theory of Mind","authors":["Fardin Saad","Zhe Zhang","Sanjana Cheerla","Amanul Haque","Munindar P. Singh"],"day":"2026-11-10","rank":4,"score":82,"status":"written","summary":{"takeaway":"The authors built AVCORP, a set of 5,000 annotated Avalon game utterances, and showed that training a small model on it improves deception detection, in one test matching Claude Opus 5.5.","found":"The authors built AVCORP, a corpus of 5,000 annotated utterances from 250 games of Avalon, a social game built on hidden roles and lying. It labels 37 deception tactics, mapped to a 4x4 behavior matrix. It also includes reasoning traces with abductive hypotheses (best-guess explanations), suspicion levels, and nested Theory of Mind beliefs (what one player thinks another player believes). They trained Qwen3-8B on it and tested on 25 held-out games and 20 games played by humans. On held-out games, their best trained detector beat its untrained baseline and the frontier models GPT-5.6 Sol, Gemini 3.1 Pro and DeepSeek-V4-Pro, and matched Claude Opus 5.5. On human games, every trained detector beat the untrained model in F1 score across all rounds. The abstract gives no exact scores.","matters":"SI agents are starting to talk with users and with other agents, and either may try to deceive them. This work offers a training set and a method aimed at spotting deception. It also shows that a small 8B model can compete with much larger ones on this narrow task. The abstract does not say how well results carry over from a game to real-world deception.","race":"If the result holds, deception detection may not need the largest models, which would lower the cost of building it. It is a narrow, game-based result, so it is an incremental step.","safety":"The paper bears directly on defending SI agents against manipulation by users and other agents. The abstract does not say whether skills learned in Avalon transfer to other settings.","level":"intermediate","tags":["safety","agents","multi-agent"]}}

[Check it on Verify a thought](https://thesimind.si/proof-of-mind/)

## The authors

Fardin Saad, Zhe Zhang, Sanjana Cheerla, Amanul Haque, Munindar P. Singh

Credit for this research belongs to its authors. SI MIND's page is a plain-English reading of their abstract on arXiv, not a review of the full paper.

Related on the desk

## More papers on these topics

[Nov 10, 2026 · Number 2Tail-risk-aware Agent Safety: Constraining Tail Risks Across Multi-step LLM Agent WorkflowsThe authors propose TAS, a way to keep SI agents safe by tracking how risk builds across workflow steps and capping rare, severe failures with one shared budget.SafetyAgentsSecurity](https://thesimind.si/papers/2611.10411/) · [Nov 9, 2026 · Paper of the DayPhantom Consensus: Measuring Social Reasoning in Multi-Agent LLM Decision-MakingWhen SI models see ambiguous public signals from other models, they can drift to a group answer that no one privately held, and checking private judgments can catch this.Multi-agent systemsEvalsBenchmarks](https://thesimind.si/papers/2611.08971/) · [Nov 9, 2026 · Number 4HomeLoop: A Simulation Framework and Benchmark for Robot-IoT Coordination in Everyday Domestic Assistance and SafetyHomeLoop is a new simulated home benchmark where SI robots must work with smart devices and handle ambiguous alerts. The best of six models scored 61.9%, and models often over-reacted.RoboticsBenchmarksEvals](https://thesimind.si/papers/2611.08914/)

[Number 3](https://thesimind.si/papers/2611.10240/) · [All 12 for Nov 10, 2026](https://thesimind.si/papers/day/2026-11-10/) · [Number 5](https://thesimind.si/papers/2611.09798/)