CoChat
Sign Up
PreprintCited by 4

Large Language Models Are Not Strong Abstract Reasoners

Gendron, Gaël, Bao, Qiming, Witbrock, Michael, Dobbie, Gillian·2023·arXiv
DOI 10.48550/arxiv.2305.19555arXiv 2305.19555
Open this paper in CoChat — free account

Abstract

Large Language Models have shown tremendous performance on a large variety of natural language processing tasks, ranging from text comprehension to common sense reasoning. However, the mechanisms responsible for this success remain opaque, and it is unclear whether LLMs can achieve human-like cognitive capabilities or whether these models are still fundamentally circumscribed. Abstract reasoning is a fundamental task for cognition, consisting of finding and applying a general pattern from few data. Evaluating deep neural architectures on this task could give insight into their potential limitations regarding reasoning and their broad generalisation abilities, yet this is currently an under-explored area. In this paper, we introduce a new benchmark for evaluating language models beyond memorization on abstract reasoning tasks. We perform extensive evaluations of state-of-the-art LLMs, showing that they currently achieve very limited performance in contrast with other natural language tasks, even when applying techniques that have been shown to improve performance on other NLP tasks. We argue that guiding LLM generation to follow causal paths could help improve the generalisation and reasoning abilities of LLMs.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

DataCite · 10.48550/arxiv.2305.19555

Cites

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • LLMs have limited abilities on abstract reasoning and are prone to confusion or errors in complex contexts.

    “LLMs have limited abilities on abstract reasoning [56], and are prone to confusion or errors in complex contexts [148].”

    From A Survey on Evaluation of Large Language Models (2024) · cites this paper as [56]

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

No references could be resolved yet.

Research works printed but not linked: 66

  1. Samuel Acquaviva et al. "Communicating Natural Programs to Humans and Machines". In: CoRR abs/2106.07824 (2021). arXiv: 2106.07824. URL: https://arxiv.org/abs/2106.07824. · arXiv
  2. Qiming Bao et al. "Contrastive Learning with Logic-driven Data Aug- mentation for Logical Reasoning over Text". In: CoRR abs/2305.12599 (2023). DOI: 10.48550/arXiv.2305.12599. arXiv: 2305.12599. URL: https://doi.org/10.48550/arXiv.2305.12599. · DOI
  3. Qiming Bao et al. "Multi-Step Deductive Reasoning Over Natural Language: An Empiri- cal Study on Out-of-Distribution Generalisation". In: Proceedings of the 16th International Workshop on Neural-Symbolic Learning and Reasoning as part of the 2nd International Joint Conference on Learning & Reasoning (IJCLR 2022), Cumberland Lodge, Windsor Great Park, UK, September 28-30, 2022.
  4. Ed. by Artur S. d'Avila Garcez and Ernesto Jiménez- Ruiz. Vol. 3212. CEUR Workshop Proceedings. CEUR-WS.org, 2022, pp. 202-217. URL: https://ceur-ws.org/Vol-3212/paper15.pdf.
  5. Emily M. Bender et al. "On the Dangers of Stochastic Parrots: Can Language Models Be Too Big?" In: FAccT '21: 2021 ACM Conference on Fairness, Accountability, and Transparency, Virtual Event / Toronto, Canada, March 3-10, 2021.
  6. Ed. by Madeleine Clare Elish, William Isaac, and Richard S. Zemel. ACM, 2021, pp. 610-623. DOI: 10.1145/3442188.3445922. URL: https://doi.org/10.1145/3442188.3445922. · DOI · Paper page
  7. Rishi Bommasani et al. "On the Opportunities and Risks of Founda- tion Models". In: CoRR abs/2108.07258 (2021). arXiv: 2108.07258. URL: https://arxiv.org/abs/2108.07258. · arXiv
  8. Grady Booch et al. "Thinking Fast and Slow in AI". In: Thirty-Fifth AAAI Conference on Ar- tificial Intelligence, AAAI 2021, Thirty-Third Conference on Innovative Applications of Artifi- cial Intelligence, IAAI 2021, The Eleventh Symposium on Educational Advances in Artificial Intelligence, EAAI 2021, Virtual Event, February 2-9, 2021. AAAI Press, 2021, pp. 15042- 15046. URL: https://ojs.aaai.org/index.php/AAAI/article/view/17765.
  9. Tom B. Brown et al. "Language Models are Few-Shot Learners". In: Ad- vances in Neural Information Processing Systems 33: Annual Confer- ence on Neural Information Processing Systems 2020, NeurIPS 2020, De- cember 6-12, 2020, virtual. Ed. by Hugo Larochelle et al. 2020. URL: https://proceedings.neurips.cc/paper/2020/hash/1457c0d6bfcb4967418bfb8ac142f64a-Abstract.htm
  10. Sébastien Bubeck et al. "Sparks of Artificial General Intelligence: Early experiments with GPT-4". In: CoRR abs/2303.12712 (2023). DOI: 10.48550/arXiv.2303.12712. arXiv: 2303.12712. URL: https://doi.org/10.48550/arXiv.2303.12712. · DOI · Paper page
  11. Patricia A Carpenter, Marcel A Just, and Peter Shell. "What one intelligence test measures: a theoretical account of the processing in the Raven Progressive Matrices Test." In: Psycholog- ical review 97.3 (1990), p. 404.
  12. Mark Chen et al. "Evaluating Large Language Models Trained on Code". In: CoRR abs/2107.03374 (2021). arXiv: 2107.03374. URL: https://arxiv.org/abs/2107.03374. · arXiv
  13. Wenhu Chen et al. "Program of Thoughts Prompting: Disentangling Computa- tion from Reasoning for Numerical Reasoning Tasks". In: CoRR abs/2211.12588 (2022). DOI: 10.48550/arXiv.2211.12588. arXiv: 2211.12588. URL: https://doi.org/10.48550/arXiv.2211.12588. · DOI · Paper page
  14. François Chollet. "On the Measure of Intelligence". In: CoRR abs/1911.01547 (2019). arXiv: 1911.01547. URL: http://arxiv.org/abs/1911.01547. · arXiv
  15. Aakanksha Chowdhery et al. "PaLM: Scaling Language Modeling with Pathways". In: CoRR abs/2204.02311 (2022). DOI: 10.48550/arXiv.2204.02311. arXiv: 2204.02311. URL: https://doi.org/10.48550/arXiv.2204.02311. · DOI · Paper page
  16. Peter Clark, Oyvind Tafjord, and Kyle Richardson. "Transformers as Soft Reasoners over Language". In: Proceedings of the Twenty-Ninth International Joint Conference on Artificial Intelligence, IJCAI 2020. Ed. by Christian Bessiere. ijcai.org, 2020, pp. 3882-3890. DOI: 10.24963/ijcai.2020/537. URL: https://doi.org/10.24963/ijcai.2020/537. · DOI · Paper page
  17. Jacob Devlin et al. "BERT: Pre-training of Deep Bidirectional Transformers for Lan- guage Understanding". In: Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technolo- gies, NAACL-HLT 2019, Minneapolis, MN, USA, June 2-7, 2019, Volume 1 (Long and Short Papers). Ed. by Jill Burstein, Christy Doran, and Thamar Solorio. Association for Computational Linguistics, 2019, pp. 4171-4186. DOI: 10.18653/v1/n19-1423. URL: https://doi.org/10.18653/v1/n19-1423. · DOI · Paper page
  18. Kevin Ellis et al. "DreamCoder: Growing generalizable, interpretable knowledge with wake- sleep Bayesian program learning". In: CoRR abs/2006.08381 (2020). arXiv: 2006.08381. URL: https://arxiv.org/abs/2006.08381. · arXiv
  19. Gaël Gendron, Michael Witbrock, and Gillian Dobbie. "A Survey of Meth- ods, Challenges and Perspectives in Causality". In: CoRR abs/2302.00293 (2023). DOI: 10.48550/arXiv.2302.00293. arXiv: 2302.00293. URL: https://doi.org/10.48550/arXiv.2302.00293. · DOI
  20. Andrew S. Gordon, Zornitsa Kozareva, and Melissa Roemmele. "SemEval-2012 Task 7: Choice of Plausible Alternatives: An Evaluation of Commonsense Causal Reasoning". In: Proceedings of the 6th International Workshop on Semantic Evaluation, SemEval@NAACL- HLT 2012, Montréal, Canada, June 7-8, 2012.
  21. Ed. by Eneko Agirre, Johan Bos, and Mona T. Diab. The Association for Computer Linguistics, 2012, pp. 394-398. URL: https://aclanthology.org/S12-1052/.
  22. Anirudh Goyal and Yoshua Bengio. "Inductive Biases for Deep Learning of Higher- Level Cognition". In: CoRR abs/2011.15091 (2020). arXiv: 2011.15091. URL: https://arxiv.org/abs/2011.15091. · arXiv
  23. Edward J. Hu et al. "LoRA: Low-Rank Adaptation of Large Language Mod- els". In: The Tenth International Conference on Learning Representations, ICLR 2022, Virtual Event, April 25-29, 2022. OpenReview.net, 2022. URL: https://openreview.net/forum?id=nZeVKeeFYf9.
  24. Albert Q. Jiang et al. "Mistral 7B". In: CoRR abs/2310.06825 (2023). DOI: 10.48550/ARXIV.2310.06825. arXiv: 2310.06825. URL: https://doi.org/10.48550/arXiv.2310.06825. · DOI · Paper page
  25. Fangkai Jiao et al. "MERIt: Meta-Path Guided Contrastive Learning for Log- ical Reasoning". In: Findings of the Association for Computational Linguis- tics: ACL 2022, Dublin, Ireland, May 22-27, 2022.
  26. Ed. by Smaranda Muresan, Preslav Nakov, and Aline Villavicencio. Association for Computational Linguis- tics, 2022, pp. 3496-3509. DOI: 10.18653/v1/2022.findings-acl.276. URL: https://doi.org/10.18653/v1/2022.findings-acl.276. · DOI
  27. Emre Kiciman et al. "Causal Reasoning and Large Language Models: Opening a New Fron- tier for Causality". In: CoRR abs/2305.00050 (2023). DOI: 10.48550/arXiv.2305.00050. arXiv: 2305.00050. URL: https://doi.org/10.48550/arXiv.2305.00050. · DOI · Paper page
  28. Brenden M Lake, Ruslan Salakhutdinov, and Joshua B Tenenbaum. "Human-level concept learning through probabilistic program induction". In: Science 350.6266 (2015), pp. 1332- 1338.
  29. Yifei Li et al. "On the Advance of Making Language Models Better Reasoners". In: CoRR abs/2206.02336 (2022). DOI: 10.48550/arXiv.2206.02336. arXiv: 2206.02336. URL: https://doi.org/10.48550/arXiv.2206.02336. · DOI
  30. Jian Liu et al. "LogiQA: A Challenge Dataset for Machine Reading Comprehension with Log- ical Reasoning". In: Proceedings of the Twenty-Ninth International Joint Conference on Artifi- cial Intelligence, IJCAI 2020. Ed. by Christian Bessiere. ijcai.org, 2020, pp. 3622-3628. DOI: 10.24963/ijcai.2020/501. URL: https://doi.org/10.24963/ijcai.2020/501. · DOI
  31. Yinhan Liu et al. "RoBERTa: A Robustly Optimized BERT Pretraining Approach". In: CoRR abs/1907.11692 (2019). arXiv: 1907.11692. URL: http://arxiv.org/abs/1907.11692. · arXiv
  32. Ilya Loshchilov and Frank Hutter. "Decoupled Weight Decay Regularization". In: 7th Interna- tional Conference on Learning Representations, ICLR 2019, New Orleans, LA, USA, May 6-9, 2019. OpenReview.net, 2019. URL: https://openreview.net/forum?id=Bkg6RiCqY7.
  33. Aman Madaan et al. "Self-Refine: Iterative Refinement with Self-Feedback". In: CoRR abs/2303.17651 (2023). DOI: 10.48550/arXiv.2303.17651. arXiv: 2303.17651. URL: https://doi.org/10.48550/arXiv.2303.17651. · DOI · Paper page
  34. OpenAI. "GPT-4 Technical Report". In: CoRR abs/2303.08774 (2023). DOI: 10.48550/arXiv.2303.08774. arXiv: 2303.08774. URL: https://doi.org/10.48550/arXiv.2303.08774. http://papers.nips.cc/paper%5C_files/paper/2022/hash/b1efde53be364a73914f58805a001731-Abstra · DOI · Paper page
  35. Linlu Qiu et al. "Phenomenal Yet Puzzling: Testing Inductive Reasoning Capabilities of Language Models with Hypothesis Refinement". In: CoRR abs/2310.08559 (2023). DOI: 10.48550/ARXIV.2310.08559. arXiv: 2310.08559. URL: https://doi.org/10.48550/arXiv.2310.08559. · DOI
  36. Colin Raffel et al. "Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer". In: J. Mach. Learn. Res. 21 (2020), 140:1-140:67. URL: http://jmlr.org/papers/v21/20-074.html.
  37. John C Raven. "Raven standard progressive matrices". In: Journal of Cognition and Develop- ment (1938).
  38. Joshua Stewart Rule. "The child as hacker: building more human-like models of learning". PhD thesis. Massachusetts Institute of Technology, 2020.
  39. Adam Santoro et al. "Measuring abstract reasoning in neural networks". In: Proceedings of the 35th International Conference on Machine Learning, ICML 2018, Stockholmsmäs- san, Stockholm, Sweden, July 10-15, 2018.
  40. Ed. by Jennifer G. Dy and Andreas Krause. Vol. 80. Proceedings of Machine Learning Research. PMLR, 2018, pp. 4477-4486. URL: http://proceedings.mlr.press/v80/santoro18a.html.
  41. Bernhard Schölkopf et al. "Toward Causal Representation Learning". In: Proc. IEEE 109.5 (2021), pp. 612-634. DOI: 10.1109/JPROC.2021.3058954. URL: https://doi.org/10.1109/JPROC.2021.3058954. · DOI · Paper page
  42. Aarohi Srivastava et al. "Beyond the Imitation Game: Quantifying and ex- trapolating the capabilities of language models". In: CoRR abs/2206.04615 (2022). DOI: 10.48550/arXiv.2206.04615. arXiv: 2206.04615. URL: https://doi.org/10.48550/arXiv.2206.04615. · DOI · Paper page
  43. Alessandro Stolfo et al. "A Causal Framework to Quantify the Robustness of Mathematical Reasoning with Language Models". In: CoRR abs/2210.12023 (2022). DOI: 10.48550/arXiv.2210.12023. arXiv: 2210.12023. URL: https://doi.org/10.48550/arXiv.2210.12023. · DOI
  44. Alon Talmor et al. "Leap-Of-Thought: Teaching Pre-Trained Models to Systemati- cally Reason Over Implicit Knowledge". In: Advances in Neural Information Process- ing Systems 33: Annual Conference on Neural Information Processing Systems 2020, NeurIPS 2020, December 6-12, 2020, virtual.
  45. Ed. by Hugo Larochelle et al. 2020. URL: https://proceedings.neurips.cc/paper/2020/hash/e992111e4ab9985366e806733383bd8c-Abstract.htm
  46. Kushal Tirumala et al. "Memorization Without Overfitting: Analyzing the Training Dynamics of Large Language Models". In: NeurIPS. 2022. URL: http://papers.nips.cc/paper%5C_files/paper/2022/hash/fa0509f4dab6807e2cb465715bf2d249-Abstra
  47. Hugo Touvron et al. "Llama 2: Open Foundation and Fine-Tuned Chat Models". In: CoRR abs/2307.09288 (2023). DOI: 10.48550/ARXIV.2307.09288. arXiv: 2307.09288. URL: https://doi.org/10.48550/arXiv.2307.09288. · DOI · Paper page
  48. Hugo Touvron et al. "LLaMA: Open and Efficient Foundation Language Models". In: CoRR abs/2302.13971 (2023). DOI: 10.48550/arXiv.2302.13971. arXiv: 2302.13971. URL: https://doi.org/10.48550/arXiv.2302.13971. · DOI · Paper page
  49. Lewis Tunstall et al. "Zephyr: Direct Distillation of LM Alignment". In: CoRR abs/2310.16944 (2023). DOI: 10.48550/ARXIV.2310.16944. arXiv: 2310.16944. URL: https://doi.org/10.48550/arXiv.2310.16944. · DOI
  50. Petar Velickovic et al. "The CLRS Algorithmic Reasoning Benchmark". In: In- ternational Conference on Machine Learning, ICML 2022, 17-23 July 2022, Baltimore, Maryland, USA.
  51. Ed. by Kamalika Chaudhuri et al. Vol. 162. Pro- ceedings of Machine Learning Research. PMLR, 2022, pp. 22084-22102. URL: https://proceedings.mlr.press/v162/velickovic22a.html.
  52. Ruocheng Wang et al. "Hypothesis Search: Inductive Reasoning with Language Models". In: CoRR abs/2309.05660 (2023). DOI: 10.48550/ARXIV.2309.05660. arXiv: 2309.05660. URL: https://doi.org/10.48550/arXiv.2309.05660. · DOI
  53. Siyuan Wang et al. "Logic-Driven Context Extension and Data Augmentation for Logical Reasoning of Text". In: Findings of the Association for Computational Lin- guistics: ACL 2022, Dublin, Ireland, May 22-27, 2022.
  54. Ed. by Smaranda Mure- san, Preslav Nakov, and Aline Villavicencio. Association for Computational Lin- guistics, 2022, pp. 1619-1629. DOI: 10.18653/v1/2022.findings-acl.127. URL: https://doi.org/10.18653/v1/2022.findings-acl.127. · DOI
  55. Yizhong Wang et al. "Self-Instruct: Aligning Language Model with Self Generated In- structions". In: CoRR abs/2212.10560 (2022). DOI: 10.48550/arXiv.2212.10560. arXiv: 2212.10560. URL: https://doi.org/10.48550/arXiv.2212.10560. · DOI · Paper page
  56. Jason Wei et al. "Chain-of-Thought Prompting Elicits Reason- ing in Large Language Models". In: NeurIPS. 2022. URL: http://papers.nips.cc/paper%5C_files/paper/2022/hash/9d5609613524ecf4f15af0f7b31abca4-Abstra
  57. Moritz Willig et al. "Can Foundation Models Talk Causality?" In: CoRR abs/2206.10591 (2022). DOI: 10.48550/arXiv.2206.10591. arXiv: 2206.10591. URL: https://doi.org/10.48550/arXiv.2206.10591. · DOI
  58. Frank F. Xu et al. "A systematic evaluation of large language models of code". In: MAPS@PLDI 2022: 6th ACM SIGPLAN International Symposium on Machine Programming, San Diego, CA, USA, 13 June 2022. Ed. by Swarat Chaudhuri and Charles Sutton. ACM, 2022, pp. 1-10. DOI: 10.1145/3520312.3534862. URL: https://doi.org/10.1145/3520312.3534862. · DOI · Paper page
  59. Zonglin Yang et al. "Language Models as Inductive Reasoners". In: CoRR abs/2212.10923 (2022). DOI: 10.48550/arXiv.2212.10923. arXiv: 2212.10923. URL: https://doi.org/10.48550/arXiv.2212.10923. · DOI
  60. Nathan Young et al. "AbductionRules: Training Transformers to Explain Un- expected Inputs". In: Findings of the Association for Computational Linguis- tics: ACL 2022, Dublin, Ireland, May 22-27, 2022.
  61. Ed. by Smaranda Mure- san, Preslav Nakov, and Aline Villavicencio. Association for Computational Lin- guistics, 2022, pp. 218-227. DOI: 10.18653/v1/2022.findings-acl.19. URL: https://doi.org/10.18653/v1/2022.findings-acl.19. · DOI
  62. Weihao Yu et al. "ReClor: A Reading Comprehension Dataset Requiring Logical Reasoning". In: 8th International Conference on Learning Representations, ICLR 2020, Addis Ababa, Ethiopia, April 26-30, 2020. OpenReview.net, 2020. URL: https://openreview.net/forum?id=HJgJtT4tvB.
  63. Chi Zhang et al. "ACRE: Abstract Causal REasoning Beyond Covari- ation". In: IEEE Conference on Computer Vision and Pattern Recogni- tion, CVPR 2021, virtual, June 19-25, 2021. Computer Vision Foundation / IEEE, 2021, pp. 10643-10653. DOI: 10.1109/CVPR46437.2021.01050. URL: https://openaccess.thecvf.com/content/CVPR2021/html/Zhang%5C_ACRE%5C_Abstract%5C_Causal%5C_R · DOI
  64. Chi Zhang et al. "RAVEN: A Dataset for Relational and Analogical Visual REa- soNing". In: IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2019, Long Beach, CA, USA, June 16-20, 2019. Computer Vision Foun- dation / IEEE, 2019, pp. 5317-5327. DOI: 10.1109/CVPR.2019.00546. URL: http://openaccess.thecvf.com/content%5C_CVPR%5C_2019/html/Zhang%5C_RAVEN%5C_A%5C_Dataset%5C_ · DOI
  65. Chiyuan Zhang et al. "Pointer Value Retrieval: A new benchmark for understanding the limits of neural network generalization". In: CoRR abs/2107.12580 (2021). arXiv: 2107.12580. URL: https://arxiv.org/abs/2107.12580. · arXiv
  66. Jiayao Zhang et al. "ROCK: Causal Inference Principles for Reasoning about Common- sense Causality". In: International Conference on Machine Learning, ICML 2022, 17- 23 July 2022, Baltimore, Maryland, USA. Ed. by Kamalika Chaudhuri et al. Vol. 162. Proceedings of Machine Learning Research. PMLR, 2022, pp. 26750-26771. URL: https://proceedings.mlr.press/v162/zhang22am.html. [3, 8, 4, 8, 0, 8, 9, 6, 6, 4, 8] → 0 [8, 3, 0, 8, 9, 3, 0, 5, 8, 1, 3] → 1 [4, 6, 8, 1, 8, 3, 4, 1, 3, 0, 1] → 3 [1, 5, 8, 7, 1, 9, 4, 5, 5, 9, 0] → 8 [6, 1, 6, 3, 9, 2, 2, 1, 9, 9, 8] → 1

Cited by

Sorted by citations

Authors
Gendron, G., Bao, Q., Witbrock, M., & Dobbie, G.
Venue
arXiv
Publisher
arXiv
Published
2023
DOI
10.48550/arxiv.2305.19555
arXiv
2305.19555
References
0
Type
Preprint
Licence
creativecommons.org/licenses/by/4.0/legalcode

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review