---
title: "daVinci-Prover: Agent-Native... | SI Paper Desk"
url: https://thesimind.si/papers/2611.16433/
description: "The authors build a 33.7B-token training corpus and a Lean-based agent harness for theorem proving, and report a 13.7 point average gain over a matched..."
---

Number 4 of 12 · November 15, 2026

# daVinci-Prover: Agent-Native Mid-Training for Formal Theorem Proving

The authors build a 33.7B-token training corpus and a Lean-based agent harness for theorem proving, and report a 13.7 point average gain over a matched Qwen3-8B baseline.

Wenhong Zhu, Xuefeng Li, Jiashuo Zhang and 4 more · Submitted November 12, 2026 · arXiv 2611.16433v1 · cs.CL

[Read the paper on arXiv](https://arxiv.org/abs/2611.16433) · [The PDF](https://arxiv.org/pdf/2611.16433) · [The day's 12](https://thesimind.si/papers/day/2026-11-15/)

## What they found

The authors argue that good SI theorem provers need two things: strong math skills learned beforehand, and examples of long, step-by-step work with a proof checker. They built a 33.7B-token mid-training corpus (training done before fine-tuning). It covers breaking problems down, searching, checking one's own work, and revising. They also built the daVinci-Prover harness. It lets a model write proofs and talk to a Lean verifier (a tool that checks proofs) in an isolated workspace. With it they collected about 36K agent trajectories for supervised fine-tuning. On Qwen3-8B, the mid-training recipe gave an average gain of 13.7 points over a matched SFT-only baseline across MiniF2F, FATE-M, and ProofNet. On the Qwen3.5 series, they report strong results and near-saturating MiniF2F performance with memory compaction.

## Why it matters

Formal proofs can be checked by machine, so they give a clear signal of whether SI reasoning is right. The authors say progress has been held back by the lack of a transparent data recipe. This paper offers one. The abstract does not say whether the data or code will be released, so that is unclear.

## How it changes the race

If the result holds, a well-built mid-training corpus could matter as much as model size for SI provers. Smaller models like an 8B one could get much better at formal math. The abstract gives no cost figures, so the effect on cost is unknown.

## Safety and control

Every proof step is checked by a Lean verifier, which gives a reliable way to confirm that the SI system's output is correct. The abstract does not discuss safety directly.

### The abstract, by the authors

Advances in large language models (LLMs) are rapidly transforming formal theorem proving. Yet further progress remains constrained by the lack of a transparent and effective data recipe for systematically improving theorem-proving models. In this work, we argue that effective agentic provers require strong mathematical skill priors to ground theorem proving and agentic trajectories to enable long-horizon, interactive proof construction. To this end, we synthesize an agent-native 33.7B-token mid-training corpus covering decomposition, search, self-verification, and revision, together with verifier-grounded agentic trajectories. We further introduce the daVinci-Prover harness, which enables models to construct proofs and interact with a Lean verifier in an isolated workspace, and use it to collect approximately 36K high-quality agent trajectories for supervised fine-tuning. Our mid-training recipe yields an average improvement of 13.7 points over the matched Qwen3-8B SFT-only baseline across MiniF2F, FATE-M, and ProofNet. When applied to the Qwen3.5 series, our approach also yields strong performance across theorem-proving benchmarks and achieves near-saturating MiniF2F performance with memory compaction. The results highlight agent-native mid-training as an effective foundation for developing stronger interactive theorem-proving agents.

Quoted from arXiv:2611.16433. The research and its words belong to its authors.

Desk score **77** out of 100

Why it was picked

- Agents (in the title)
- Reasoning (in the title)
- Evals
- Studies frontier models (Qwen3)
- Language models

Topics

- [Math](https://thesimind.si/papers/?tag=math)
- [Reasoning](https://thesimind.si/papers/?tag=reasoning)
- [Agents](https://thesimind.si/papers/?tag=agents)
- [Training](https://thesimind.si/papers/?tag=training)
- [Data](https://thesimind.si/papers/?tag=data)
- [Benchmarks](https://thesimind.si/papers/?tag=benchmarks)

**arXiv ID:** 2611.16433v1
**Submitted:** November 12, 2026
**Fields:** cs.CL (Computation and Language)
**Level:** Intermediate

Fingerprint, SHA-256

`d2ca306cf7dfebb053d3f0414703d36ba11ede3f2ebfce44e51a4266eec9d2bc`

On Solana: [Proof of Mind seal, Szprsf...FGjr](https://solscan.io/tx/SzprsfAMG4vXvYD7hrurYFce76smMcrTbLnANy8xS96bh14DoynCdjEEMZf7RPtRUgYeejS8HGnxjqtD1XuFGjr)

### The exact text fingerprinted

{"arxiv":"2611.16433","version":1,"title":"daVinci-Prover: Agent-Native Mid-Training for Formal Theorem Proving","authors":["Wenhong Zhu","Xuefeng Li","Jiashuo Zhang","Yu Chen","Tiantian Mi","Qipeng Guo","Pengfei Liu"],"day":"2026-11-15","rank":4,"score":77,"status":"written","summary":{"takeaway":"The authors build a 33.7B-token training corpus and a Lean-based agent harness for theorem proving, and report a 13.7 point average gain over a matched Qwen3-8B baseline.","found":"The authors argue that good SI theorem provers need two things: strong math skills learned beforehand, and examples of long, step-by-step work with a proof checker. They built a 33.7B-token mid-training corpus (training done before fine-tuning). It covers breaking problems down, searching, checking one's own work, and revising. They also built the daVinci-Prover harness. It lets a model write proofs and talk to a Lean verifier (a tool that checks proofs) in an isolated workspace. With it they collected about 36K agent trajectories for supervised fine-tuning. On Qwen3-8B, the mid-training recipe gave an average gain of 13.7 points over a matched SFT-only baseline across MiniF2F, FATE-M, and ProofNet. On the Qwen3.5 series, they report strong results and near-saturating MiniF2F performance with memory compaction.","matters":"Formal proofs can be checked by machine, so they give a clear signal of whether SI reasoning is right. The authors say progress has been held back by the lack of a transparent data recipe. This paper offers one. The abstract does not say whether the data or code will be released, so that is unclear.","race":"If the result holds, a well-built mid-training corpus could matter as much as model size for SI provers. Smaller models like an 8B one could get much better at formal math. The abstract gives no cost figures, so the effect on cost is unknown.","safety":"Every proof step is checked by a Lean verifier, which gives a reliable way to confirm that the SI system's output is correct. The abstract does not discuss safety directly.","level":"intermediate","tags":["math","reasoning","agents","training","data","benchmarks"]}}

[Check it on Verify a thought](https://thesimind.si/proof-of-mind/)

## The authors

Wenhong Zhu, Xuefeng Li, Jiashuo Zhang, Yu Chen, Tiantian Mi, Qipeng Guo, Pengfei Liu

Credit for this research belongs to its authors. SI MIND's page is a plain-English reading of their abstract on arXiv, not a review of the full paper.

Related on the desk

## More papers on these topics

[Nov 13, 2026 · Number 6SynthCorp: A Platform for Creating Benchmarks for Data AgentsSynthCorp simulates business events over time to build fake but consistent company data and test tasks, so builders can create harder, targeted tests for SI data agents.BenchmarksAgentsEvals](https://thesimind.si/papers/2611.14765/) · [Nov 18, 2026 · Number 2Nemotron 3.5 Bolt E4B 4GB: An Open and Efficient Small Language Model for Fast Conversational AgentsNVIDIA's authors post-trained a small open model from Gemma-4-E4B-it for fast local assistants. They report the top average accuracy on 21 benchmarks and faster decoding with a drafter model.EfficiencyLanguage modelsAgents](https://thesimind.si/papers/2611.20771/) · [Nov 11, 2026 · Number 2Benchmarking language models and agents for scientific reasoning in evolving materials laboratoriesMatScope is a new test showing that SI models handle given calculations and physical explanations well, but struggle to tell close material states apart and to reason with numbers.BenchmarksScienceEvals](https://thesimind.si/papers/2611.12014/)

[Number 3](https://thesimind.si/papers/2611.15925/) · [All 12 for Nov 15, 2026](https://thesimind.si/papers/day/2026-11-15/) · [Number 5](https://thesimind.si/papers/2611.16991/)
