Number 12 of 12 · November 16, 2026

Benchmarks Don't Talk Back: Learning Through Self-Disagreement

Abbasloo and Cheng argue that knowing when to hold an answer and when to yield is its own skill, and that a model can train it by arguing against itself.

What they found

The authors say that standard tests ask a model one question alone, while real use often involves people contesting answers. They name the skill of holding a correct position or yielding to a better one "dialectical competence." They report that it depends on first-answer accuracy but does not follow from it. A model can get better at answering without getting better at this, and training for accuracy alone can work against it. They also say it cannot be gained at inference time by self-reflection or by sampling more. Their method, Self-Disagreement, has the model state a position, write the strongest case against it, and rule on whether that case stands. It is then trained on the ruling with reinforcement learning from verifiable rewards. The abstract says the skill is weak in the base model, arrives with the reward, does not cost first-answer accuracy, and holds against challengers the model never trained against, including stronger ones. The abstract gives no numbers, model names or benchmarks.

Why it matters

Models that drop correct answers when someone pushes back with bad reasoning are hard to rely on. This paper treats that as a separate weakness from accuracy and proposes a way to train against it. The training needs no second model, no reward model, no preference data and no human annotation, so it could be cheap to apply. The abstract does not say how large the gains are, so the strength of the claim is unclear from it alone.

How it changes the race

If the result holds, builders could train models to stand firm on correct answers using only checkable rewards and no extra models or human labels. That would lower the cost of a robustness skill, but the abstract gives no figures, so the size of the effect is unknown.

Safety and control

The work bears on reliability under pressure. A model that yields to wrong counter-arguments can be talked out of correct answers, and one that yields to better ones stays open to correction. The abstract does not test misuse or adversarial settings beyond challengers.

The abstract, by the authors

A benchmark usually measures a language model alone with a question, and deployment rarely looks like that: answers get contested, and models give up correct ones under counter-reasoning that is itself wrong. We show that what fails there is not a shortfall of accuracy but a capability in its own right - knowing when to hold a position and when to yield to a better one - which we call dialectical competence. It stands on first-answer accuracy without following from it: a model can be made materially better at answering and no better at this, and training for accuracy alone can drift against it. Nor can it be bought at inference, by self-reflection or by sampling more. Taking a cue from the dialectical tradition in philosophy, in which productive opposition arises within a position rather than being imposed on it from outside, we hypothesize that this capability can be trained from opposition the model supplies itself. It states a position, generates the strongest case against that position - its antithesis - rules on whether the case stands, and is trained on that ruling, with no second model at training or at deployment. We call this learning through Self-Disagreement: reinforcement learning from verifiable rewards throughout, where the same check that scores an answer against its reference scores the ruling too, so no reward model, no preference data and no human annotation enter anywhere. The capability is trained rather than elicited: weak in the base model, it arrives with the reward, is not paid for out of first-answer accuracy, and holds against challengers the model never trained against, including ones stronger than itself. The opposition a model needs in order to improve, it turns out, need not come from outside it.

Quoted from arXiv:2611.17563. The research and its words belong to its authors.

The authors

Soheil Abbasloo, Peng Cheng

Credit for this research belongs to its authors. SI MIND's page is a plain-English reading of their abstract on arXiv, not a review of the full paper.