LoopViT: Scaling Visual ARC with Looped Transformers

Wenjie Shu
Wenjie Shu
,
Xuerui Qiu
,
Rui-Jie Zhu
,
Harold Haodong Chen
,
Yexin Liu
,
Harry Yang
· 1 min read
Abstract
We introduce Loop-ViT, a weight-tied (looped) transformer for Visual ARC that scales reasoning via iterative inference. By trading model width for “thinking time”, Loop-ViT reaches a new Pareto frontier on ARC-AGI, achieving strong accuracy with significantly fewer parameters.
Type
Publication
EMNLP 2026 Findings

Accepted at EMNLP 2026 Findings.

Can't display the PDF inline. Click to view/download: pipeline.pdf

Figure: LoopViT overview.