---
title: "ArchSpace: Recording, Reviewing, and... | SI Paper Desk"
url: https://thesimind.si/papers/2611.17332/
description: "ArchSpace is a public platform where SI model architecture ideas are recorded with their experiments, reviewed by the community, and reused, using scaling..."
---

Number 11 of 12 · November 15, 2026

# ArchSpace: Recording, Reviewing, and Referencing LLM Architecture Research

ArchSpace is a public platform where SI model architecture ideas are recorded with their experiments, reviewed by the community, and reused, using scaling laws to judge ideas before costly large training runs.

Jie Wang, Tong Zhu, JiaHao Kuang and 8 more · Submitted November 12, 2026 · arXiv 2611.17332v1 · cs.CL

[Read the paper on arXiv](https://arxiv.org/abs/2611.17332) · [The PDF](https://arxiv.org/pdf/2611.17332) · [The day's 12](https://thesimind.si/papers/day/2026-11-15/)

## What they found

The authors describe ArchSpace, a public platform for recording, reviewing and referencing research on LLM architecture. Each proposal is stored with its experiments and reasoning, reviewed by the community, and cited by later work. To judge ideas before expensive large-scale training, the platform uses scaling laws. These are fits that predict a model's loss at larger sizes from smaller experiments. The authors provide starting references: Qwen3.5 and OLMo3 baselines, fitted scaling laws, and a reusable training recipe. The abstract gives no experimental results, so it does not show how well the predictions hold up.

## Why it matters

Model architecture affects how well SI systems scale, how efficiently they train, and what they cost to run. The authors say industry reports rarely record which ideas failed and why. They also say academic tests are often small and use inconsistent baselines. A shared record with common baselines could cut repeated work and make comparisons fairer.

## How it changes the race

If it works, groups with little compute could test architecture ideas against shared baselines and get a credible read on larger scales. That could widen who contributes ideas. The abstract reports no results yet, so the effect is unproven.

### The abstract, by the authors

Model architecture shapes the scaling behavior, training efficiency, and inference cost of LLMs, making it a central focus of both industry and academia. In industry, teams such as those behind DeepSeek, Qwen, and Kimi routinely introduce architectural innovations, yet public reports rarely document which ideas succeeded, which were abandoned, and why. In academia, limited compute and inconsistent baselines often restrict evaluations to small-scale, single-point comparisons, making it difficult to establish whether improvements hold at larger scales or translate into broader impact. ArchSpace addresses both gaps as a public platform for Recording, Reviewing, and Referencing Architecture Researc}: each proposal is recorded with its experiments and reasoning, reviewed by the community, and referenced by later work. To evaluate ideas before costly large-scale training, ArchSpace leverages scaling laws to predict model loss at larger scales from smaller experiments, a practice widely adopted in industry. We provide initial references that make the platform usable: Qwen3.5 and OLMo3 baselines, fitted scaling laws, and a reusable training recipe. Ideas validated through this review can in turn become new baselines, and ArchSpace thereby aims to broaden the range of ideas that shape the next generation of models.

Quoted from arXiv:2611.17332. The research and its words belong to its authors.

Desk score **65** out of 100

Why it was picked

- Reasoning
- Compute
- Evals
- Language models (in the title)
- Studies frontier models (DeepSeek)
- Cross-listed in 2 fields

Topics

- [Scaling](https://thesimind.si/papers/?tag=scaling)
- [Language models](https://thesimind.si/papers/?tag=language-models)
- [Evals](https://thesimind.si/papers/?tag=evals)
- [Benchmarks](https://thesimind.si/papers/?tag=benchmarks)
- [Efficiency](https://thesimind.si/papers/?tag=efficiency)
- [Training](https://thesimind.si/papers/?tag=training)

**arXiv ID:** 2611.17332v1
**Submitted:** November 12, 2026
**Fields:** cs.CL (Computation and Language), cs.LG (Machine Learning)
**Level:** Intro

Fingerprint, SHA-256

`e991f2344d38426d34f942350b55034bc21e45e1c1b51600b626b409b388120b`

On Solana: [Proof of Mind seal, Szprsf...FGjr](https://solscan.io/tx/SzprsfAMG4vXvYD7hrurYFce76smMcrTbLnANy8xS96bh14DoynCdjEEMZf7RPtRUgYeejS8HGnxjqtD1XuFGjr)

### The exact text fingerprinted

{"arxiv":"2611.17332","version":1,"title":"ArchSpace: Recording, Reviewing, and Referencing LLM Architecture Research","authors":["Jie Wang","Tong Zhu","JiaHao Kuang","Zhe Xu","Yunkai Chai","Dehong Zheng","Yu Cheng","Tao Ji","ZhouHan Lin","Qi Zhang","Bowen Zhou"],"day":"2026-11-15","rank":11,"score":65,"status":"written","summary":{"takeaway":"ArchSpace is a public platform where SI model architecture ideas are recorded with their experiments, reviewed by the community, and reused, using scaling laws to judge ideas before costly large training runs.","found":"The authors describe ArchSpace, a public platform for recording, reviewing and referencing research on LLM architecture. Each proposal is stored with its experiments and reasoning, reviewed by the community, and cited by later work. To judge ideas before expensive large-scale training, the platform uses scaling laws. These are fits that predict a model's loss at larger sizes from smaller experiments. The authors provide starting references: Qwen3.5 and OLMo3 baselines, fitted scaling laws, and a reusable training recipe. The abstract gives no experimental results, so it does not show how well the predictions hold up.","matters":"Model architecture affects how well SI systems scale, how efficiently they train, and what they cost to run. The authors say industry reports rarely record which ideas failed and why. They also say academic tests are often small and use inconsistent baselines. A shared record with common baselines could cut repeated work and make comparisons fairer.","race":"If it works, groups with little compute could test architecture ideas against shared baselines and get a credible read on larger scales. That could widen who contributes ideas. The abstract reports no results yet, so the effect is unproven.","safety":"","level":"intro","tags":["scaling","language-models","evals","benchmarks","efficiency","training"]}}

[Check it on Verify a thought](https://thesimind.si/proof-of-mind/)

## The authors

Jie Wang, Tong Zhu, JiaHao Kuang, Zhe Xu, Yunkai Chai, Dehong Zheng, Yu Cheng, Tao Ji, ZhouHan Lin, Qi Zhang, Bowen Zhou

Credit for this research belongs to its authors. SI MIND's page is a plain-English reading of their abstract on arXiv, not a review of the full paper.

Related on the desk

## More papers on these topics

[Nov 15, 2026 · Number 10Reasoning Supervision and Capability Retention in LoRA Domain AdaptationIn fine-tuning Qwen3-8B on financial tasks, training on labels alone beat adding teacher reasoning traces for in-domain results, while general abilities stayed close to the original model.TrainingLanguage modelsEvals](https://thesimind.si/papers/2611.17072/) · [Nov 18, 2026 · Number 2Nemotron 3.5 Bolt E4B 4GB: An Open and Efficient Small Language Model for Fast Conversational AgentsNVIDIA's authors post-trained a small open model from Gemma-4-E4B-it for fast local assistants. They report the top average accuracy on 21 benchmarks and faster decoding with a drafter model.EfficiencyLanguage modelsAgents](https://thesimind.si/papers/2611.20771/) · [Nov 16, 2026 · Number 4LuthorSQL: A One-Pass Text-to-SQL Model as System 1 for a Slower LLM AgentA small local 7B model can answer nearly half of database questions in one fast pass and hand the hard ones to a big SI agent, cutting API cost by 33.3% at the same accuracy.EfficiencyAgentsLanguage models](https://thesimind.si/papers/2611.17780/)

[Number 10](https://thesimind.si/papers/2611.17072/) · [All 12 for Nov 15, 2026](https://thesimind.si/papers/day/2026-11-15/) · [Number 12](https://thesimind.si/papers/2611.16639/)
