NariQ: Sub-3-Bit Quantization for Long-Horizon Agentic Tasks
Doyeob Kim · arXiv 2611.26157
NariQ compresses a 27B model to 3.0 or 2.5 bits per weight and, per the author, keeps it level with full precision on long agentic tasks by calibrating on the model's own agent sessions.
