Wendi Yu, Lianhao Zhou, Xiangjue Dong +6 more
Splitting a hard task across several language model agents has become a popular reflex, and the results are oddly inconsistent. Sometimes a crowd of specialists beats one model working alone, sometimes it does worse, and the field has not had a clean account of when to expect which.
The authors offer one, and it turns on how information moves. A single agent keeps its entire reasoning trace in one shared context, so everything it worked out earlier is still sitting there. A multi-agent system splits the work into isolated local contexts joined only by relay messages, and those messages are bounded. Whatever one agent understood has to survive being compressed into a short handoff.
That framing, an information bottleneck, is what makes the inconsistency predictable rather than mysterious. It is the difference between thinking a problem through on one sheet of paper and solving it as a relay where each person passes on a sticky note. Sometimes the note is enough. Sometimes the thing that mattered was exactly what did not fit.
LLM powered multi-agent systems (MAS) have emerged as a promising paradigm for complex tasks. However, their advantages over single-agent systems (SAS) remain unclear, with performance varying inconsistently across settings. Here, we provide an information bottleneck perspective on elucidating the differences between MAS and SAS. Specifically, our key observation is that a SAS accumulates its full reasoning trace in one shared context, while a MAS uses isolated local…
Handwritten and Printed Text Segmentation via Region-Aware Human-Writing Descriptor Engineering
arXiv (cs.LG) · July 17, 2026Learning Reach-Avoid Task with Reinforcement Learning: Vectorized Simulation and Benchmark
arXiv (cs.CV) · July 16, 2026Hierarchical Denoising For Multi-Step Visual Reasoning
arXiv (cs.CL) · July 16, 2026Partition, Prompt, Aggregate: Statistical Self-Consistency in Language Models