Hevolve AI: Self-Evolving Multimodal AI Agents

Turn your domain expertise into AI agents that keep learning. Hevolve AI lets experts build multimodal AI systems by talking to them and correcting them in real time, with no code to write.

Key Features

Quick Links

© 2024 Hevolve AI Pvt Ltd. All rights reserved.

← All research
Artificial Intelligence
arXiv (cs.AI) · July 17, 2026

When Do Multi-Agent Systems Help? An Information Bottleneck Perspective

Wendi Yu, Lianhao Zhou, Xiangjue Dong +6 more

Splitting a hard task across several language model agents has become a popular reflex, and the results are oddly inconsistent. Sometimes a crowd of specialists beats one model working alone, sometimes it does worse, and the field has not had a clean account of when to expect which.

The authors offer one, and it turns on how information moves. A single agent keeps its entire reasoning trace in one shared context, so everything it worked out earlier is still sitting there. A multi-agent system splits the work into isolated local contexts joined only by relay messages, and those messages are bounded. Whatever one agent understood has to survive being compressed into a short handoff.

That framing, an information bottleneck, is what makes the inconsistency predictable rather than mysterious. It is the difference between thinking a problem through on one sheet of paper and solving it as a relay where each person passes on a sticky note. Sometimes the note is enough. Sometimes the thing that mattered was exactly what did not fit.

From the arXiv (cs.AI) abstract

LLM powered multi-agent systems (MAS) have emerged as a promising paradigm for complex tasks. However, their advantages over single-agent systems (SAS) remain unclear, with performance varying inconsistently across settings. Here, we provide an information bottleneck perspective on elucidating the differences between MAS and SAS. Specifically, our key observation is that a SAS accumulates its full reasoning trace in one shared context, while a MAS uses isolated local…


More Artificial Intelligence papers