Topic

SI papers on safety

Every paper on the SI Paper Desk tagged safety, newest first: 6 so far, each explained in plain English by SI MIND.

  1. 1Phantom Consensus: Measuring Social Reasoning in Multi-Agent LLM Decision-MakingWhen SI models see ambiguous public signals from other models, they can drift to a group answer that no one privately held, and checking private judgments can catch this.Disha Sheshanarayana, Rajat Subhra Pal, Manjira Sinha and 1 moreNov 9, 2026Intermediate85score
  2. 2Forcing a Letter Suppresses Refusal: Mechanistic Evidence from WMDPIn multiple-choice safety tests, forcing a model to pick a letter seems to crowd out its refusal, so these scores may measure knowledge more than safety.Stepan Epifantsev, Anna Antipova, Oleg Chernikov and 2 moreNov 9, 2026Intermediate83score
  3. 4HomeLoop: A Simulation Framework and Benchmark for Robot-IoT Coordination in Everyday Domestic Assistance and SafetyHomeLoop is a new simulated home benchmark where SI robots must work with smart devices and handle ambiguous alerts. The best of six models scored 61.9%, and models often over-reacted.Ramy ElMallah, Marc Bishara, Hyegang Kim and 3 moreNov 9, 2026Intermediate81score
  4. 5I Think, Therefore I Attack: Evaluating Thought Injection Attacks on Reasoning AgentsAttacker text written to look like a reasoning model's own thoughts can hijack SI agents, reaching up to 50% success in a test range, while plain prompt injection of the same goal never worked.Parth Illendula, Garik Livingston, Zain Shamsi and 2 moreNov 9, 2026Intermediate81score
  5. 8DexDICE: Reconciling Safety and Performance via Dual-Expert Offline Imitation LearningDexDICE learns from two kinds of demonstrations, safe but weaker ones and strong but risky ones, to build agents that score well while staying inside safe regions.Seokin Seo, Sung Kuk Shyn, Minji Seo and 4 moreNov 9, 2026Advanced77score
  6. 12Conflux: Preventing Privilege Escalation with Principal Contexts and System-Level EvaluationConflux checks every SI agent action against the permissions of everyone who influenced it, outside the model's own judgement, and the proof only holds under stated conditions.Raya Buckley and Christian Schroeder de WittNov 9, 2026Advanced65score
The archive

Every day on the desk

  1. Week 46, 2026The weekly digest comes out on Monday
  2. Paper of the DayPhantom Consensus: Measuring Social Reasoning in Multi-Agent LLM Decision-Making12 papers