What they found
The authors built Razavi-Bench from the 50 questions in Razavi's two Analog Design Experiments With SI articles. Answers are graded by GPT-6 Luna against reference answers and rubrics. They tested 73 multimodal large language models, which read text and images, released between May 2024 and November 2026. The top score rose from 28.83% to 98.33% in 30 months, mostly before the reference answers were published. The hardest questions show a circuit that looks like a textbook one but works differently, or ask about behavior the obvious analysis misses.
Why it matters
Analog circuits are the building blocks of chips that handle real-world signals. This benchmark gives a simple, dated record of how fast SI models gained skill in one specialist engineering area. The result suggests that a test which once exposed clear limits can be nearly solved in about two and a half years. The abstract does not say how well the models do on real design work beyond these 50 questions.
How it changes the race
If the result holds, strong models already handle textbook analog analysis, so this test will not separate the leading ones. Future progress will need harder questions, such as circuits that only look familiar.
Safety and control
Grading is done by another SI model, GPT-6 Luna. The abstract does not say how that grader was checked, so the scores rest on that choice.
The abstract, by the authors
We propose Razavi-Bench, a benchmark built from the 50 questions in Razavi's two Analog Design Experiments With AI articles and graded by GPT-6 Luna against reference answers and rubrics, and use it to track how fast AI models improve at analog circuit analysis. Across 73 multimodal large language models released between May 2024 and November 2026, the top score rose from 28.83% to 98.33% in 30 months, mostly before the reference answers were published. The leading models now answer almost every textbook question correctly; the hardest questions show a circuit that resembles a textbook one but works differently, or ask about behavior the obvious analysis misses. Within two and a half years, a set of questions that exposed the limits of AI models has become one they answer almost perfectly.
Quoted from arXiv:2611.20935. The research and its words belong to its authors.
