CLadder: Assessing Causal Reasoning in Language Models
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Real-world causal judgment often requires navigating informal ambiguity rather than formal symbols.
“CLadder (Jin et al., 2023) generates queries from causal graphs, effectively testing the 'do-calculus' (Pearl, 2009), but real-world causal judgment often requires navigating informal ambiguity rather than formal symbols.”
From Diagnosing and Mitigating Sycophancy and Skepticism in LLM Causal Judgment (2026) · cites this paper as Jin et al., 2023
Cites
Still being checked.
Cited by
Sorted by citations
Nezhurina, M., Cipolina-Kun, L., Cherti, M., & Jitsev, J. (2024) · arXiv · doi:10.48550/arxiv.2406.02061 · Cited by 21 · see citing works
Diagnosing and Mitigating Sycophancy and Skepticism in LLM Causal Judgment
Chang, E. Y. (2026) · Findings of the Association for Computational Linguistics: ACL 2026 · doi:10.18653/v1/2026.findings-acl.427 · Cited by 2 · see citing works
Function-Centric Bayesian Network for Zero-Shot Object Goal Navigation
Zhang, S., Yu, X. H., Song, X., Wang, Y., & Jiang, S. (2025) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51701.2025.01816 · Cited by 1 · see citing works
CausalT5k: Diagnosing Refusal and Failure Modes in Trustworthy Causal Reasoning Across Causal Rungs
Geng, L., Ouyang, A., Wu, T., Barretto, D., Hayes, M. J., Cooper, R., Zeng, Y., Vijay, S., Ancone, G., Rai, A., et al. (2026) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3770855.3817567 · Cited by 1 · see citing works
CRRC: A Prompt Engineering Approach for Logical Reasoning in Large Language Models
He, B., Sun, J., Xin, H., Cui, R., & Wu, L. (2026) · Chinese Control and Decision Conference (CCDC) · doi:10.1109/ccdc69976.2026.11560566
AI Control Through Causal Agents
Kaushik, M. M., Karthik, K. N. V., & Arjan Durresi, A. (2026) · Lecture notes on data engineering and communications technologies · doi:10.1007/978-3-032-23304-2_11
Lu, J., Yu, L., Li, S., Zhao, X., Jiang, P., Liu, S. U., & Wang, Y. (2026) · Concurrency and Computation Practice and Experience · doi:10.1002/cpe.70842
A Survey of Commonsense Reasoning in LLMs
Teo, N., Huang, D., & Wang, Z. (2026) · ACM Computing Surveys · doi:10.1145/3832753
CausalT5k Foundation and Development
(2026) · ACM eBooks · doi:10.1145/3822380.3822388
A Divide-and-Conquer Framework for Query-Efficient Causal Discovery with Large Language Models
Hernandez, L., Boussard, M., & Leite, A. (2026) · Communications in computer and information science · doi:10.1007/978-3-032-31319-5_11
Nguyễn, N. B. H. (2026) · SSRN Electronic Journal · doi:10.2139/ssrn.7268438
Gao, J., Dong, L., & Hu, J. (2026) · doi:10.2196/preprints.109941
Framework for Grounding Healthcare LLMs in a Causal Knowledge Graph: A Cardiovascular ExamplePreprint
Mumtaz, U., Noor, A., & Ahmed, A. (2026) · Research Square · doi:10.21203/rs.3.rs-10720346/v1
Wu, X., Yu, K., Wu, J., & Tan, K. C. (2026) · Pattern Recognition · doi:10.1016/j.patcog.2026.114825
Zou, H., Wang, J., Yang, Z., Zhang, M., Li, Y., Du, W., Chen, J., Duan, Z. Y., & Zhao, S. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-37664-0_7
Ethical Proof-Carrying Causal Answers on CLadder
Vallverdú, J., & Xu, A. (2025) · IEEE/WIC/ACM International Conference on Web Intelligence and Intelligent Agent Technology (WI-IAT) · doi:10.1109/wi-iat67162.2025.00124
Retrieving Causes, Not Correlates: HiCauRAG for Causal Question AnsweringPreprint
Chen, T. N., & Li, W. (2026) · SSRN Electronic Journal · doi:10.2139/ssrn.7459901
Chen, Y., Liu, J., Lin, X., & Tang, R. (2026) · doi:10.1109/cvprf71909.2026.00879
Self-citationLarge language models for computational social science
Xu, F., Shao, C., Chen, L., Zeng, Q., Chen, Z., Sukiennik, N., Wang, J., Gao, C., Wang, H., Lian, J., et al. (2026) · Nature Human Behaviour · doi:10.1038/s41562-026-02539-9
Cyberlogic-enabled Thinking Space: a closed-loop human-cyber cognitive architecture in CPST
Chen, R., Zhou, L., Ding, J., & Ning, H. (2026) · Frontiers in Artificial Intelligence · doi:10.3389/frai.2026.1899109
- Authors
- Jin, Z., Chen, Y., Leeb, F., Gresele, L., Kamal, O., Lyu, Z., Blin, K., Adauto, F. G., Kleiman-Weiner, M., Sachan, M., & Schölkopf, B.
- Venue
- Advances in Neural Information Processing Systems 36
- Published
- 2023
- Pages
- 31038-31065
- ISSN
- 1049-5258 (ISSN-L)
- OpenAlex
- W7133216625
- Cited by
- 19
- References
- 0
- Citations by year
- 2026: 17 · 2025: 2
- FWCI
- 3.37
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- neural information processing systems (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Logic, Reasoning, and Knowledge
- Physical Sciences › Computer Science › Artificial Intelligence › Bayesian Modeling and Causal Inference
- Physical Sciences › Computer Science › Artificial Intelligence › Natural Language Processing Techniques
- Keywords
- causal reasoning, language models, causal inference, benchmark
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review