Topic

SI papers on benchmarks

Every paper on the SI Paper Desk tagged benchmarks, newest first: 6 so far, each explained in plain English by SI MIND.

  1. 1Phantom Consensus: Measuring Social Reasoning in Multi-Agent LLM Decision-MakingWhen SI models see ambiguous public signals from other models, they can drift to a group answer that no one privately held, and checking private judgments can catch this.Disha Sheshanarayana, Rajat Subhra Pal, Manjira Sinha and 1 moreNov 9, 2026Intermediate85score
  2. 2Forcing a Letter Suppresses Refusal: Mechanistic Evidence from WMDPIn multiple-choice safety tests, forcing a model to pick a letter seems to crowd out its refusal, so these scores may measure knowledge more than safety.Stepan Epifantsev, Anna Antipova, Oleg Chernikov and 2 moreNov 9, 2026Intermediate83score
  3. 3AIM: Adaptive Interaction in Multi-Agent Debate for Multimodal LLM InferenceAIM lets SI agents in a debate choose, case by case, how to share evidence (text, graph, or image, audio and video regions), which raised accuracy and cut token use in the authors' tests.Wei Fan, JinYi Yoon and Bo JiNov 9, 2026Intermediate83score
  4. 4HomeLoop: A Simulation Framework and Benchmark for Robot-IoT Coordination in Everyday Domestic Assistance and SafetyHomeLoop is a new simulated home benchmark where SI robots must work with smart devices and handle ambiguous alerts. The best of six models scored 61.9%, and models often over-reacted.Ramy ElMallah, Marc Bishara, Hyegang Kim and 3 moreNov 9, 2026Intermediate81score
  5. 8DexDICE: Reconciling Safety and Performance via Dual-Expert Offline Imitation LearningDexDICE learns from two kinds of demonstrations, safe but weaker ones and strong but risky ones, to build agents that score well while staying inside safe regions.Seokin Seo, Sung Kuk Shyn, Minji Seo and 4 moreNov 9, 2026Advanced77score
  6. 9BrainCoT: A Multi-Task Zero-Shot Brain Signal Foundation Model with Neurometric-Anchored Chain-of-Thought ReasoningBrainCoT is a single brain signal model that handles several tasks with no extra training, and it gives step by step reasoning tied to measurable brain evidence.Yiyu Gui, Mingzhi Chen, Guibo Luo and 1 moreNov 9, 2026Intermediate73score
The archive

Every day on the desk

  1. Week 46, 2026The weekly digest comes out on Monday
  2. Paper of the DayPhantom Consensus: Measuring Social Reasoning in Multi-Agent LLM Decision-Making12 papers