Scaling up Test-Time Compute with Latent Reasoning: A Recurrent Depth Approach
Open accessThe DOI matches its Crossref record; 134 of the 134 references it cites were found in a registry or an index.
Abstract
Depth-recurrent transformers scale test-time compute by iterating a core block in latent space before emitting tokens. The geometry of these latent trajectories is a named open problem in the latent reasoning literature (survey arXiv:2604.02029, §6.3). We report a pre-registered experiment on Huginn-0125 (arXiv:2502.05171), a 3.5B-parameter depth-recurrent transformer, measuring the per-head attention power-law exponent Δ of the recurrent core at recurrence counts r ∈ {1, 2, 4, 8, 16, 32}. For natural-text inputs the median exponent decreases monotonically with recurrence (Spearman ρ = −0.94), from 0.29 at r=1 to 0.239 at r=32 — converging onto the Sachdev–Ye–Kitaev (SYK) q=4 conformal value Δ = 1/4 — while the count of SYK-near heads grows monotonically (ρ = +0.77). Random-token inputs show an architecture-driven convergence with a transient at Δ ≈ 1/2 (the q=2 prethermal plateau previously observed in training time) but no monotone SYK-near growth. A randomized-weights control freezes completely: Δ_med constant to the sixth decimal across all r, zero SYK-near heads. Inference-time recurrence therefore acts as renormalization-group flow toward the conformal fixed point, and the flow is a property of the trained model, not the iteration procedure. Together with prior results on architectural depth (10.5281/zenodo.19225996) and training time, this completes a three-axis triangulation: the conformal fixed point is an attractor of iterative attending. The published orbit/spiral phenomenology of recurrent-depth latent trajectories acquires a candidate theory — the spiral is flow near an infrared fixed point — and the geometric benefit of additional recurrence saturates when the flow arrives, consistent with convergence-based early-exit criteria. All code, pre-registration (commit 702efd95), per-head data, and experiment notes with recorded protocol deviations are in the public repository 3ld0n/attention-geometry.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“latent CoT—recurrent reasoning in the hidden state, without token traces [64,65,66]—may soften the feedforward bottleneck, though it still iterates over activations rather than weight-level self-models.”
From Self-Referential Introspection in Large Language Models: The Critical Threshold for Recursive Self-Improvement (2026) · cites this paper as [65]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The publisher hasn’t deposited this paper’s reference list.
Research works printed but not linked: 36
- Brandon Amos and J. Zico Kolter. 2017. OptNet: Differentiable Optimization as a Layer in Neural Networks. In International Conference on Machine Learning , pages 136-145.
- Zhangir Azerbayev, Hailey Schoelkopf, Keiran Paster, Marco Dos Santos, Stephen Marcus McAleer, Albert Q. Jiang, Jia Deng, Stella Biderman, and Sean Welleck. 2023. Llemma: An Open Language Model for Mathematics. In The Twelfth International Conference on Learning Representations .
- Shaojie Bai, J. Zico Kolter, and Vladlen Koltun. 2019. Deep Equilibrium Models. In Advances in Neural Information Processing Systems , volume 32. Curran Associates, Inc.
- Shaojie Bai, Vladlen Koltun, and J. Zico Kolter. 2022. Neural Deep Equilibrium Solvers. In International Conference on Learning Representations .
- Andrea Banino, Jan Balaguer, and Charles Blundell. 2021. PonderNet: Learning to Ponder. In 8th ICML Workshop on Automated Machine Learning (AutoML) .
- Valentino Braitenberg. 1986. Vehicles: Experiments in Synthetic Psychology . MIT press.
- Tianle Cai, Yuhong Li, Zhengyang Geng, Hongwu Peng, Jason D. Lee, Deming Chen, and Tri Dao. 2024. Medusa: Simple LLM Inference Acceleration Framework with Multiple Decoding Heads. In Forty-First International Conference on Machine Learning . character.ai. 2024. Optimizing AI Inference at Character.AI. https://research.character.ai/optimizing-inference/
- Hantian Ding, Zijian Wang, Giovanni Paolini, Varun Kumar, Anoop Deoras, Dan Roth, and Stefano Soatto. 2024. Fewer Truncations Improve Language Modeling. In Forty-First International Conference on Machine Learning .
- Maha Elbayad, Jiatao Gu, Edouard Grave, and Michael Auli. 2019. Depth-Adaptive Transformer. In International Conference on Learning Representations .
- Ying Fan, Yilun Du, Kannan Ramchandran, and Kangwook Lee. 2025. Looped Transformers for Length Generalization. In The Thirteenth International Conference on Learning Representations .
- Jonas Geiping and Tom Goldstein. 2023. Cramming: Training a Language Model on a single GPU in one day. In Proceedings of the 40th International Conference on Machine Learning , pages 11117-11143. PMLR.
- Angeliki Giannou, Shashank Rajput, Jy-Yong Sohn, Kangwook Lee, Jason D. Lee, and Dimitris Papailiopoulos. 2023. Looped Transformers as Programmable Computers. In Proceedings of the 40th International Conference on Machine Learning , pages 11398-11442. PMLR.
- Tamir David Hay and Lior Wolf. 2023. Dynamic Layer Tying for Parameter-Efficient Transformers. In The Twelfth International Conference on Learning Representations .
- Dan Hendrycks, Collin Burns, Steven Basart, Andy Zou, Mantas Mazeika, Dawn Song, and Jacob Steinhardt. 2021a. Measuring massive multitask language understanding. Proceedings of the International Conference on Learning Representations (ICLR) .
- Dan Hendrycks, Collin Burns, Steven Basart, Andy Zou, Mantas Mazeika, Dawn Song, and Jacob Steinhardt. 2021b. Measuring Massive Multitask Language Understanding. In International Conference on Learning Representations .
- Pavel Izmailov, Dmitrii Podoprikhin, Timur Garipov, Dmitry Vetrov, and Andrew Gordon Wilson. 2018. Averaging weights leads to wider optima and better generalization: 34th Conference on Uncertainty in Artificial Intelligence 2018, UAI 2018. 34th Conference on Uncertainty in Artificial Intelligence 2018, UAI 2018 , pages 876-885.
- Angelos Katharopoulos, Apoorv Vyas, Nikolaos Pappas, and François Fleuret. 2020. Transformers are RNNs: Fast Autoregressive Transformers with Linear Attention. In Proceedings of the 37th International Conference on Machine Learning , pages 5156-5165. PMLR.
- Diederik P. Kingma and Jimmy Ba. 2015. Adam: A Method for Stochastic Optimization. In International Conference on Learning Representations (ICLR) , San Diego.
- Zhenzhong Lan, Mingda Chen, Sebastian Goodman, Kevin Gimpel, Piyush Sharma, and Radu Soricut. 2019. ALBERT: A Lite BERT for Self-supervised Learning of Language Representations. In International Conference on Learning Representations .
- Yann LeCun. 2022. A Path Towards Autonomous Machine Intelligence. Preprint , Version 0.9.2:62.
- Yann LeCun and Fu Jie Huang. 2005. Loss functions for dis- criminative training of energy-based models. In AISTATS 2005 https://nyuscholars.nyu.edu/en/publications/loss-functions-for-discriminative-training-of-energy-based-models
- Yaniv Leviathan, Matan Kalman, and Yossi Matias. 2023. Fast Inference from Transformers via Speculative Decoding. In Proceedings of the 40th International Conference on Machine Learning , pages 19274-19286. PMLR.
- Mrinal Mathur, Barak A. Pearlmutter, and Sergey M. Plis. 2024. MIND over Body: Adaptive Thinking using Dynamic Computation. In The Thirteenth International Conference on Learning Representations .
- Neel Nanda, Lawrence Chan, Tom Lieberum, Jess Smith, and Jacob Steinhardt. 2022. Progress measures for grokking via mechanistic interpretability. In The Eleventh International Conference on Learning Representations .
- Keiran Paster, Marco Dos Santos, Zhangir Azerbayev, and Jimmy Ba. 2023. OpenWebMath: An Open Dataset of High-Quality Mathematical Web Text. In The Twelfth International Conference on Learning Representations .
- Victor Sanh, Albert Webson, Colin Raffel, Stephen Bach, Lintang Sutawika, Zaid Alyafeai, Antoine Chaffin, Arnaud Stiegler, Arun Raja, Manan Dey, M. Saiful Bari, Canwen Xu, Urmish Thakker, Shanya Sharma Sharma, Eliza Szczechla, Taewoon Kim, Gunjan Chhablani, Nihal Nayak, Debajyoti Datta, and 21 others. 2021. Multitask Prompted Training Enables Zero-Shot Task Generalization. In International Conference on Learning Representations .
- Sunny Sanyal, Atula Tejaswi Neerkaje, Jean Kaddour, Abhishek Kumar, and sujay sanghavi. 2024. Early weight averaging meets high learning rates for LLM pre-training. In First Conference on Language Modeling .
- Avi Schwarzschild. 2023. Deep Thinking Systems: Logical Extrapolation with Recurrent Neural Networks . Ph.D. thesis, University of Maryland, College Park, College Park.
- Avi Schwarzschild, Eitan Borgnia, Arjun Gupta, Furong Huang, Uzi Vishkin, Micah Goldblum, and Tom Goldstein. 2021b. Can You Learn an Algorithm? Generalizing from Easy to Hard Problems with Recurrent Networks. In Advances in Neural Information Processing Systems , volume 34, pages 6695-6706. Curran Associates, Inc.
- Yu Sun, Xiaolong Wang, Zhuang Liu, John Miller, Alexei Efros, and Moritz Hardt. 2020. Test-Time Training with SelfSupervision for Generalization under Distribution Shifts. In Proceedings of the 37th International Conference on Machine Learning , pages 9229-9248. PMLR.
- Ilya Sutskever, Geoffrey E Hinton, and Graham W Taylor. 2008. The Recurrent Temporal Restricted Boltzmann Machine. In Advances in Neural Information Processing Systems , volume 21. Curran Associates, Inc.
- Mitchell Wortsman, Tim Dettmers, Luke Zettlemoyer, Ari S. Morcos, Ali Farhadi, and Ludwig Schmidt. 2023b. Stable and low-precision training for large-scale vision-language models. In Thirty-Seventh Conference on Neural Information Processing Systems .
- Yuhuai Wu, Markus Norman Rabe, DeLesley Hutchins, and Christian Szegedy. 2022. Memorizing Transformers. In International Conference on Learning Representations .
- Liu Yang, Kangwook Lee, Robert D. Nowak, and Dimitris Papailiopoulos. 2024a. Looped Transformers are Better at Learning Learning Algorithms. In The Twelfth International Conference on Learning Representations .
- Longhui Yu, Weisen Jiang, Han Shi, Jincheng Yu, Zhengying Liu, Yu Zhang, James Kwok, Zhenguo Li, Adrian Weller, and Weiyang Liu. 2023. MetaMath: Bootstrap Your Own Mathematical Questions for Large Language Models. In The Twelfth International Conference on Learning Representations .
- Yifan Zhang, Yifan Luo, Yang Yuan, and Andrew C. Yao. 2024c. Autonomous Data Selection with Language Models for Mathematical Texts. In ICLR 2024 Workshop on Navigating and Addressing Data Problems for Foundation Models .
Cited by
Items 301–361 of 361
Statistical Gains from Looped Estimation under Parameter BudgetsPreprint
Tian, X., & Shen, X. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2609.25778
Deng, W. (2026) · ACM Conference on Recommender Systems (RecSys) · doi:10.1145/3773078.3831944
Loop Dropout: Regularizing Shared Updates in Looped Language ModelsPreprint
Zhu, Z., Xu, H., Zhao, X., Liu, Y., Ren, Y., Sarkar, K., Xu, K., & You, Y. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2609.34218
SOLO: Pretraining Billion-Parameter Language Models with Shared-Output Local LearningPreprint
Yin, B., Wang, S., Pan, Y., & Li, G. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2609.35440
Counting on Thinking: Tracing Evidence Integration in Language ModelsPreprint
Xue, J., Wilson, R. C., & 熊华东 (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2609.32932
Ceiling of a Task: When Can a Transformer Succeed Without Its Chain of Thought?Preprint
He, J., Fan, J., Xiao, X., Mărculescu, R., & Ribeiro, A. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2609.33134
DISCERN: Can AI Agents Work Like Scientists and Guide Discovery?Preprint
Huang, N., Tapia-Pacheco, M., Zhou, K., Huang, Y., Díaz, K. J. B., Amariuta, T., & Shang, J. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2609.33357
When Less Compute Is More: Adaptive Early Exit Improves Pretrained Outlier DetectionPreprint
Zhou, T., & Akoglu, L. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2609.32898
Principled Thoughts for Latent Recursive LLM SystemsPreprint
Seddik, F., & Fard, F. H. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2609.36159
Looped Transformers as OptimizersPreprint
Huang, Y., Jiang, C., Zhou, Z., Zhang, H., Li, T., He, T., Zhang, X., & Cheng, B. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2609.37379
Universal interpolation for deep residual self-attention networksPreprint
Marcotte, S., & Bruna, J. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2610.01981
Question Selection and Answer Scoring Shape Revision Risk in Recurrent Language Models
Lei, R., Ren, Y., & Xu, Z. (2026) · Applied Sciences · doi:10.3390/app16199857
D-Loop: Looped Diffusion Drafting for Speculative DecodingPreprint
Chen, K., He, Y., Gong, C. B., Liu, H., Long, G., Li, J., Wu, S., Zhang, S., Li, H., Liu, Z., et al. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2610.06011
LoopMoEVR: Loop-Based Degradation-Aware Mixture-of-Experts for Unified UHD Video RestorationPreprint
Xin, Y., Bai, R., Wang, Y., Gao, G., Liu, J., Lu, D., Fan, L., & Zheng, Z. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2610.05109
Dynamic Routing as a New Dimension for Test-time Versatility of LLMsPreprint
Štefánik, M., Kadlcík, M., Kuchař, J., & Spiegel, M. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2610.04751
GitSwarm: Decentralized Compounding Inference
Shah, V., Samanta, A., Dahal, P., Plekhanov, M., Wu, C.-J., Yih, S., Munos, R., Fergus, R., Foerster, J., Salakhutdinov, R., et al. (2026) · arXiv · doi:10.48550/arxiv.2610.04862
Learning What to Investigate Next: Meta-Reasoning for Long-Horizon Research AgentsPreprint
Samanta, A., Efroni, Y., Sajda, P., Hassani, K., & Goyal, A. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2610.02525
Mull-Tokens: Modality-Agnostic Latent Thinking
Ray, A., Abdelkader, A., Mao, C., Plummer, B. A., Saenko, K., Krishna, R., Guibas, L., & Chu, W.-S. (2026) · 2026 IEEE/CVF Conference on Computer Vision and Pattern Recognition- FINDINGS Track (CVPRF) · doi:10.1109/cvprf71909.2026.00908 · Cited by 5
TAFFY: A Task-Adaptive Tabular Foundation Model with In-Context DiversityPreprint
Li, Z., Song, X., Luo, G., Qiao, J., Cai, R., Chen, Z., Dong, X., Feng, F., Chen, G., & Zhang, K. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2610.07559
AdaPerceiver: Transformers with Adaptive Width, Depth, and Tokens
Jajal, P., Eliopoulos, N. J., Chou, B. S.-H., Thiruvathukal, G. K., Lu, Y.-H., & Davis, J. C. (2026) · 2026 IEEE/CVF Conference on Computer Vision and Pattern Recognition- FINDINGS Track (CVPRF) · doi:10.1109/cvprf71909.2026.00255
Emergent Inverse-Depth Scaling From Nonlinearity In AttentionPreprint
Peng, Z., Liu, Y., Liu, Z., & Gore, J. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2610.11063
Scaling RNA Foundation Models through Iterative RefinementPreprint
Chen, P., Hong, L., Liu, X., Huang, H., Lin, Z., Chen, J., Fan, Y., Jiang, J., & Li, Y. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2610.13106
Running Fewer Loops Removes Refusal Behaviour in Recurrent-Depth Language ModelsPreprint
Azizi, S., Potraghloo, E. B., Fayyazi, A., Shokoufa, S., & Pedram, M. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2610.15218
LoopREG: Representation Supervision Enables Test-Time Recurrent Depth in Diffusion TransformersPreprint
Wang, Z., Xiong, A., Zhang, J., Zhu, X., Jiang, Y., Xiao, Y., Zeng, Z., Chen, Z., Liu, X., Hu, H., et al. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2610.17877
Adaptive-Depth Is a Finishing StagePreprint
Piterbarg, A., McLeish, S., Pai, D., & Keigwin, B. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2610.14252
Self-citationFitting Every Hint Is Not Enough: Premature Floods in Recurrent Algorithmic ReasonersPreprint
Najafgholizadeh, A., & Afsharchi, M. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2610.14982
Recurrent In-Context Learning for Tabular Foundation ModelsPreprint
Vaidhya, T., Sahu, G., & Rish, I. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2610.14998
Rotate the Loop: Blockwise Conformality for Looped TransformersPreprint
Zemtsov, A., Klepach, A., Lomshakov, V., Polubarov, A., Lyubaykin, N., Derevyagin, A., Kurenkov, V., & Nikulin, A. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2610.14030
DeepThink: A Conceptual Model for Knowledge-Addressable Recurrent Language ModelingPreprint
Chen, W. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2610.16171
Retrofitting Recurrent Vision-Language Models from Pretrained BackbonesPreprint
Iyengar, M., Geiger, A., & Kühne, H. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2610.22075
Causal Latent Workspaces for Looped TransformersPreprint
Zaznov, I. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2610.22796
Nested Shared-Operator Recursion on ARC-AGI-1: An Empirical Study of HRM, TRM and URMPreprint
Neri, S., Gaeta, E., Ceschini, A., Facchinetti, A., & Fico, G. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2610.26666
The Inference Revolution: Test-Time Compute Scaling for Enhanced Reasoning in Large Language Models
Sharma, N., Sodhi, B., Verma, P., Gungun, Sapra, D., & Himanshi (2026) · International Conference on Computational Intelligence: Methods, Models, and Real-World Applications (ICCIMMR) · doi:10.1109/iccimmr71310.2026.11731720
recAMPLIFY: Large-Scale Pretraining of Recursive Protein Language ModelsPreprint
Jha, S., Liao, Q., Vernon, R., Chandar, S., & Fournier, Q. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2610.26747
Zhang, T., Shi, Z., Peng, Y., & Xie, T. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2610.28011
Predictive Latents for Autoregressive Language Models: Possibility, Gauge, and ObstructionPreprint
Hong, Y. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2610.28540
Accordion: Elastic-Depth Inference via Fixed-Prefix Layer LoopingPreprint
Zhang, Y., Ding, W., Zheng, K., Ding, Y., & Zhang, Z. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2610.32492
PRISM: Promoting Sampling Diversity of Large Language Models with Implicit Stochastic Modulation
Xu, Q., Zhu, Z., Liu, X., & Lyu, B. (2026) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/2026.findings-emnlp.748
Lu, D., Li, R., Ni, Z., Tang, Y., 孔行权, Yang, J., & Guo, J. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2610.34436
Lu, D., Ni, Z., & Li, R. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2610.34427 · Cited by 1
LoopFold: Parallelizing Recurrent Depth in Looped TransformersPreprint
Song, F., Zeng, B., Hao, Y., Song, S., Li, H., Yang, Y., Wang, Z., Liu, Y., He, Z., & Lin, Z. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2610.35556
Agreement rather than normalisation keeps depth reusable in looped language modelsPreprint
Viakhirev, I., Borodin, K., Abramov, M., & Mkrtchian, G. (2026) · arXiv (Cornell University)
IRIS: Iterative Refinement of Internal States for Safer Language Models
Zhang, B., Feng, Y., Li, P., Zhu, Z., Fu, P., Weimin, M., Lin, Z., & Wang, W. (2026) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/2026.findings-emnlp.912
Decoding Self-Knowledge from Latent Reasoning Models for Selective Prediction and Adaptive Routing
Li, Z., Zhang, Y., He, C., Hua, Z., Wang, M., & Xu, Z. (2026) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/2026.findings-emnlp.1187
TRLM: Shared-Weight Recursive Reasoning for Non-Autoregressive Language Generation
Oytac, D. (2026) · BabyLM Workshop · doi:10.18653/2026.babylm-main.29 · Cited by 1
Haller, P., Laitenberger, F., Golde, J., & Akbik, A. (2026) · BabyLM Workshop · doi:10.18653/2026.babylm-main.57 · Cited by 1
Sasidhar, A. (2026) · BabyLM Workshop · doi:10.18653/2026.babylm-main.10 · Cited by 1
Deeper Backpropagation or More Updates? Training Looped Language Models Across BudgetsPreprint
Shen, J., & Li, X. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2610.38422
CopyLoop: Fast Looped Transformer Decoding via Context Copying and Shallow ScreeningPreprint
Du, W., & Chung, S. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2610.38822
Think Twice: The Metis-1.6 Technical ReportPreprint
Vollmer, G. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2610.37903
From Grind to GraspPreprint
Sunehag, P. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2610.38728
Where KV-Cache Error Lives in Looped Language Models: A Diagnostic Study of Ouro and HuginnPreprint
Lu, D., Li, R., Ni, Z., Tang, Y., 孔行权, Yang, J., Guo, J., & Gao, L. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2610.41825
When Does Adaptive Halting Win? Selection Rules Matter in Looped Language ModelsPreprint
Pagadala, M. R. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2611.02333
How Does Chain-of-Thought Supervision Teach Models to Reason? A Theoretical AnalysisPreprint
Takanami, K., & Pehlevan, C. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2611.01740
Dory1.0-4B: A Looped Normalized-GPTPreprint
Fishman, M., Sun, S., Acharya, S., Ladhak, F., Chmiel, B., Serano, S. A., Banner, R., Ginsburg, B., & Puvvada, K. C. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2611.03998
Lu, D., Li, R., Ni, Z., Tang, Y., 孔行权, Yang, J., Guo, J., & Gao, L. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2611.05150
LooM: Loop-Invariant Memory for Causal Encoder-Decoder Language ModelsPreprint
Yang, L., Diao, M., Yan, Z., Chen, J., Wen, B., Gao, T., Zhang, W., Liang, K., Ma, Z., & Xu, W. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2611.06835
The Lagrangian Brain: A Constraint Mechanics of Mind and MachinePreprint
He, Y., & WU, S. (2026) · doi:10.66977/xsci.2611.0012
Energy-Based Reasoners: Your Recurrent Reasoner Should Be an Energy-Based ModelPreprint
Chen, W. X., Gladstone, A., Li, Z. M., Ji, H., & Du, Y. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2611.08977 · Cited by 1
Chen, Y., Zhang, F., Chen, Z., Wang, D., Li, H., Xu, P., Liu, H., Li, S., Pei, X., Zhuang, F., et al. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2611.09006
Transparency Disclosures for Chain-of-Thought MonitorabilityPreprint
Davies, J., & Bearman, T. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2611.13873
Metadata
- Authors
- Geiping, J., McLeish, S., Jain, N., Kirchenbauer, J., Singh, S., Bartoldson, B., Kailkhura, B., Bhatele, A., & Goldstein, T.
- Affiliations
- Tübingen AI Center (DE)
- University of Maryland, College Park (US)
- Lawrence Livermore National Laboratory (US)
- ORCID
- Venue
- Advances in Neural Information Processing Systems 38
- Published
- 2025
- Pages
- 46242-46293
- ISSN
- 1049-5258 (ISSN-L)
- OpenAlex
- W4407310640
- Cited by
- 10
- References
- 0
- Citations by year
- 2026: 10
- FWCI
- 9.53
- Type
- conference paper
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- neural information processing systems (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
- Physical Sciences › Computer Science › Artificial Intelligence › Explainable Artificial Intelligence (XAI)
- Physical Sciences › Computer Science › Artificial Intelligence › Natural Language Processing Techniques
- Keywords
- latent reasoning, test-time compute, Sachdev-Ye-Kitaev model, conformal fixed points, prethermalization, renormalization group flow, latent trajectories
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.