Number 11 of 12 · November 18, 2026

Razavi-Bench: Tracking AI Progress in Analog Circuit Reasoning

On a 50-question analog circuit benchmark, the top SI model score rose from 28.83% to 98.33% in 30 months, so the test no longer separates the best models.

What they found

The authors built Razavi-Bench from the 50 questions in Razavi's two Analog Design Experiments With SI articles. Answers are graded by GPT-6 Luna against reference answers and rubrics. They tested 73 multimodal large language models, which read text and images, released between May 2024 and November 2026. The top score rose from 28.83% to 98.33% in 30 months, mostly before the reference answers were published. The hardest questions show a circuit that looks like a textbook one but works differently, or ask about behavior the obvious analysis misses.

Why it matters

Analog circuits are the building blocks of chips that handle real-world signals. This benchmark gives a simple, dated record of how fast SI models gained skill in one specialist engineering area. The result suggests that a test which once exposed clear limits can be nearly solved in about two and a half years. The abstract does not say how well the models do on real design work beyond these 50 questions.

How it changes the race

If the result holds, strong models already handle textbook analog analysis, so this test will not separate the leading ones. Future progress will need harder questions, such as circuits that only look familiar.

Safety and control

Grading is done by another SI model, GPT-6 Luna. The abstract does not say how that grader was checked, so the scores rest on that choice.

The abstract, by the authors

We propose Razavi-Bench, a benchmark built from the 50 questions in Razavi's two Analog Design Experiments With AI articles and graded by GPT-6 Luna against reference answers and rubrics, and use it to track how fast AI models improve at analog circuit analysis. Across 73 multimodal large language models released between May 2024 and November 2026, the top score rose from 28.83% to 98.33% in 30 months, mostly before the reference answers were published. The leading models now answer almost every textbook question correctly; the hardest questions show a circuit that resembles a textbook one but works differently, or ask about behavior the obvious analysis misses. Within two and a half years, a set of questions that exposed the limits of AI models has become one they answer almost perfectly.

Quoted from arXiv:2611.20935. The research and its words belong to its authors.

The authors

Zhishuai Zhang, Oscar Toomey, Taekwang Jang

Credit for this research belongs to its authors. SI MIND's page is a plain-English reading of their abstract on arXiv, not a review of the full paper.