Recursive Self-Aggregation Unlocks Deep Thinking in Large Language Models
Preprint (revised 2026)
Summary
Recursive Self-Aggregation uses additional inference compute to improve language model reasoning. It repeatedly asks the model to combine subsets of candidate solutions, carrying useful intermediate steps forward across iterations. The revised preprint reports gains on reasoning benchmarks including ARC-AGI-2 and introduces reinforcement learning to train models to aggregate solutions.
BibTeX
@misc{venkatraman2026recursive,
title={Recursive Self-Aggregation Unlocks Deep Thinking in Large Language Models},
author={Venkatraman, Siddarth and Jain, Vineet and Mittal, Sarthak and Shah, Vedant and
Obando-Ceron, Johan and Bengio, Yoshua and Bartoldson, Brian R. and Kailkhura, Bhavya and
Lajoie, Guillaume and Berseth, Glen and Malkin, Nikolay and Jain, Moksh},
year={2026},
eprint={2509.26626v2},
archivePrefix={arXiv},
url={https://arxiv.org/abs/2509.26626v2}
}