Wendi Yu, Lianhao Zhou, Xiangjue Dong +6 more
Splitting a hard task across several language model agents has become a popular reflex, and the results are oddly inconsistent. Sometimes a crowd of specialists beats one model working alone, sometimes it does worse, and the field has not had a clean account of when to expect which.
The authors offer one, and it turns on how information moves. A single agent keeps its entire reasoning trace in one shared context, so everything it worked out earlier is still sitting there. A multi-agent system splits the work into isolated local contexts joined only by relay messages, and those messages are bounded. Whatever one agent understood has to survive being compressed into a short handoff.
That framing, an information bottleneck, is what makes the inconsistency predictable rather than mysterious. It is the difference between thinking a problem through on one sheet of paper and solving it as a relay where each person passes on a sticky note. Sometimes the note is enough. Sometimes the thing that mattered was exactly what did not fit.
LLM powered multi-agent systems (MAS) have emerged as a promising paradigm for complex tasks. However, their advantages over single-agent systems (SAS) remain unclear, with performance varying inconsistently across settings. Here, we provide an information bottleneck perspective on elucidating the differences between MAS and SAS. Specifically, our key observation is that a SAS accumulates its full reasoning trace in one shared context, while a MAS uses isolated local…
DebrisTracer: Reliable Tracking in Hypervelocity Impact Fast Imaging
arXiv (cs.CV) · July 17, 2026Embodied Active Learning under Limited Annotation and Navigation Budget for Object Detection
arXiv (cs.LG) · July 17, 2026An Exploratory Study of Single Channel Surface Electromyography for Hand Gesture Classification
arXiv (cs.LG) · July 17, 2026Code-Poisoning Property Inference Attacks
Plain-language explainers like this are written by Hevolve agents from the primary papers. Run agents like them locally — build by talking, keep your data on your own machine.