The DOI matches its Crossref record; 11 of the 13 references it cites were found in a registry or an index, and 2 are not checked yet.
The Memorization Problem: Can We Trust LLMs' Economic Forecasts?
Open accessOverview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source doesn’t support the claim as written.
In the citing paper
“This sample period ensures that our evaluation is out-of-sample as the training data of the ChatGPT models stops in September 2021 (e.g., Sarkar and Vafa (2024) and Lopez-Lira, Tang, and Zhu (2025)).”
From Can ChatGPT forecast stock price movements? Return predictability and large language models (2026) · cites this paper as Lopez-Lira, Tang, and Zhu (2025)
Checked by a reasoning model — may be wrong.
Experimental — accuracy not yet measuredIn the citing paper
“This sample period is selected to avoid look-ahead bias and ensure an out-of-sample evaluation of LLMs like ChatGPT, as the version we evaluate was trained on data up until September 2021.”
From Can ChatGPT forecast stock price movements? Return predictability and large language models (2026) · cites this paper as Lopez-Lira, Tang, and Zhu (2025)
In the citing paper
“recent work by Lopez-Lira, Tang, and Zhu (2025) provides a comprehensive set of evidence that ChatGPT can accurately recall economic and financial information, including macroeconomic variables, stock returns, news headlines, and earnings call content, before the model's knowledge cutoff, and finds no evidence of lookahead bias or memorization after the cutoff”
From Can ChatGPT forecast stock price movements? Return predictability and large language models (2026) · cites this paper as Lopez-Lira, Tang, and Zhu (2025)
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Can ChatGPT forecast stock price movements? Return predictability and large language models
Lopez-Lira, A., & Tang, Y. (2026) · Journal of Financial Economics · doi:10.1016/j.jfineco.2026.104335 · Cited by 425
Self-citationText Embeddings Reveal (Almost) As Much As Text
Morris, J. X., Kuleshov, V., Shmatikov, V., & Rush, A. M. (2023) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2023.emnlp-main.765 · Cited by 218
Large Language Models: An Applied Econometric Framework
Ludwig, J., Mullainathan, S., & Rambachan, A. (2026) · Annual Review of Economics · doi:10.1146/annurev-economics-120925-105620 · Cited by 83
Large Language Models as Simulated Economic Agents: What Can We Learn from Homo Silicus?
Horton, J. J., Filippas, A., & Manning, B. S. (2023) · arXiv · doi:10.48550/arxiv.2301.07543 · Cited by 47
Chen, S., Green, T. C., Gulen, H., & Zhou, D. (2024) · SSRN Electronic Journal · doi:10.2139/ssrn.4941906 · Cited by 27
Caution Ahead: Numerical Reasoning and Look‐Ahead Bias in AI Models
LEVY, B. (2026) · Journal of Accounting Research · doi:10.1111/1475-679x.70058 · Cited by 20
Can generative AI help identify peer firms?
Cao, Y., Chen, L., Tucker, J. W., & Wan, C. (2025) · Review of Accounting Studies · doi:10.1007/s11142-025-09892-6 · Cited by 19
Large Language Models and Return Prediction in ChinaPreprint
Tan, L., wu, H., & Zhang, X. (2024) · SSRN Electronic Journal · doi:10.2139/ssrn.4712248 · Cited by 14
Assessing Look-Ahead Bias in Stock Return Predictions Generated By GPT Sentiment Analysis
Glasserman, P., & Lin, C. (2023) · arXiv · Cited by 12
Generative AI, Managerial Expectations, and Economic Activity
Jha, M., Qian, J., Weber, M., & Yang, B. (2026) · National Bureau of Economic Research · doi:10.48550/arxiv.2410.03897 · Cited by 8
Research works printed but not linked: 16
- John Bai, 2023, Executives vs. chatbots: Unmasking insights through human-AI differences in earnings conference Q&A, Northeastern U. D'Amore-McKim School of Business Research Paper
- Shaun A Bond, 2024, Large language models and financial market sentiment
- Adam Bozman, 2025, Better Than a Coin Flip? Merger Success and Artificial Intelligence Models
- Christian Breitung, 2025, Global Business Networks, Journal of Financial Economics, 166
- J Bybee, 2023, The Ghost in the Machine: Generating Beliefs with Large Language Models
- Chen, 2022, Expected Returns and Large Language Models, Pre-published
- Dominik Degen, 2024, Large Language Models and M&A: Can ChatGPT Help Forecast M&A Activity?, Pre-published
- Joseph Engelberg, 2025, Entity Neutering, Pre-published
- Songrun He, 2025, Chronologically Consistent Large Language Models, Pre-published
- Alex Kim, 2024, Financial statement analysis with large language models
- Benjamin S Manning, 2024, Automated Social Science: Language Models as Scientist and Subjects
- John Morris, 2024, Language Model Inversion, The Twelfth International Conference on Learning Representations
- Eghbal Rahimikia, 2024, Re(Visiting) Large Language Models in Finance, Pre-published
- Jillian Ross, 2024, LLM Economicus? Mapping the Behavioral Biases of LLMs via Utility Theory, Pre-published
- Suproteem Sarkar, 2024, Lookahead Bias in Pretrained Language Models
- Suproteem K Sarkar, 2024, StoriesLM: A Family of Language Models With Time-Indexed Training Data, Pre-published
Cited by
Can ChatGPT forecast stock price movements? Return predictability and large language models
Lopez-Lira, A., & Tang, Y. (2026) · Journal of Financial Economics · doi:10.1016/j.jfineco.2026.104335 · Cited by 425
Self-citationDetecting Lookahead Bias in LLM ForecastsPreprint
Gao, Z., Jiang, W., & Yan, Y. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2512.23847 · Cited by 27
AI Democratization and Trading Inequality
CHANG, A. Y., DONG, X., Martin, X., & Zhou, C. (2026) · Journal of Accounting Research · doi:10.1111/1475-679x.70063 · Cited by 24
Asirvatham, H., Mokski, E., & Shleifer, A. (2026) · National Bureau of Economic Research · doi:10.3386/w34834 · Cited by 22
Evaluating LLMs in Finance Requires Explicit Bias ConsiderationPreprint
Kong, Y., Lee, H., Hwang, Y., Lopez-Lira, A., Levy, B. (., Mehta, D. B., Wen, Q., Choi, C., Lee, Y., & Zohren, S. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2602.14233 · Cited by 20
Self-citationDual-model synergy for audit opinion prediction: A collaborative LLM agent framework approach
Lu, L. Y., Hao, J.-X., & Tang, X. (2025) · International Review of Economics & Finance · doi:10.1016/j.iref.2025.104642 · Cited by 16
Artificial intelligence innovation and financial report quality
Li, J. (2025) · International Review of Economics & Finance · doi:10.1016/j.iref.2025.104832 · Cited by 16
Time Travel is Cheating: Going Live with DeepFund for Real-Time Fund Investment Benchmarking
Li, C. W., Yao, S. H. I., Wang, C., Duan, Q., Ruan, R., Huang, W., Long, H., Huang, L., Tang, N., & Luo, Y. (2025) · neural information processing systems · doi:10.52202/085713-5554 · Cited by 16
AI’s predictable memory in financial analysis
Didisheim, A., Fraschini, M., & Somoza, L. (2025) · Economics Letters · doi:10.1016/j.econlet.2025.112602 · Cited by 12
Toward Expert Investment Teams: A Multi-Agent LLM System with Fine-Grained Trading Tasks
Miyazaki, K., Kawahara, T., Roberts, S., & Zohren, S. (2026) · The Journal of Financial Data Science · doi:10.3905/jfds.2026.008 · Cited by 11
The Natural Language of Finance
Hoberg, G., & Manela, A. (2024) · Foundations and Trends® in Finance · doi:10.1561/0500000075 · Cited by 11
Language Model Guided Reinforcement Learning in Quantitative Trading
Darmanin, A., & Vella, V. (2025) · International Conference on Foundation and Large Language Models (FLLM) · doi:10.1109/fllm67465.2025.11390898 · Cited by 8
Lee, S.-W., Yang, S., Kwak, D., & Siegel, N. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2507.19477 · Cited by 7
Panda, S. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2605.29586 · Cited by 7
Cross-Stock Predictability via LLM-Augmented Semantic NetworksPreprint
Huang, Y., Fan, Z., Hu, K., & Ye, Y. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2604.19476 · Cited by 6
When Alpha Disappears: A One-Switch Benchmark for Decision-Time Leakage in Financial BacktestsPreprint
Zhang, F., Li, Z., Peng, S., & Chen, Y. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2605.23959 · Cited by 5
Jia, H. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2607.18867 · Cited by 5
Prompting for Policy: Forecasting Macroeconomic Scenarios with Synthetic LLM Personas
Iadisernia, G., & Camassa, C. (2025) · ACM International Conference on AI in Finance (ICAIF) · doi:10.1145/3768292.3770385 · Cited by 4
Total Recall? Evaluating the Macroeconomic Knowledge of Large Language Models
Crane, D. L., Karra, A., & Soto, P. E. (2025) · Finance and Economics Discussion Series · doi:10.17016/feds.2025.044 · Cited by 4
Kazinnik, S., & Brynjolfsson, E. (2025) · National Bureau of Economic Research · doi:10.3386/w33998 · Cited by 4
Fake Date Tests: Can We Trust In-sample Accuracy of LLMs in Macroeconomic Forecasting?Preprint
Eliseev, A., & Seleznev, S. (2026) · SSRN Electronic Journal · doi:10.2139/ssrn.6035916 · Cited by 4
Temporal Leakage in LLM Backtesting: Measurement, Validation, and Adjusted ScoresPreprint
Zhang, Z., & Stadie, B. C. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2608.02985 · Cited by 4
AI‐Driven Inflation Forecasting in the Aftermath of COVID‐19
Jaworski, K. (2026) · Journal of Forecasting · doi:10.1002/for.70148 · Cited by 3
Guo, T., & Hauptmann, E. (2025) · arXiv.org · doi:10.48550/arxiv.2510.15691 · Cited by 2
Debiasing LLMs by Fine-tuningPreprint
Gao, Z., Jiang, W., & Yan, Y. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2604.02921 · Cited by 3
Towards Dynamically Generated KGQA Benchmark Datasets for Memorization-Resistant Evaluations
Gashkov, A., Perevalov, A., Eltsova, M., & Both, A. (2025) · Lecture notes in computer science · doi:10.1007/978-3-032-13109-6_3 · Cited by 2
Huang, W., & Yu, Z. (2026) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn69854.2026.11729789 · Cited by 2
Do Large Language Models (LLMs) Understand Chronology?Preprint
Wongchamcharoen, P. K., & Glasserman, P. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2511.14214 · Cited by 2
How AI Forecasts AI Jobs: Benchmarking LLM Predictions of Labor Market ChangesPreprint
Osborn, S., Valecha, R., Rao, H. R., Sass, D., & Rios, A. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2510.23358 · Cited by 2
Prompting for Policy: Forecasting Macroeconomic Scenarios with Synthetic LLM PersonasPreprint
Iadisernia, G., & Camassa, C. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2511.02458 · Cited by 2
Out of the Black Box: Uncertainty Quantification for LLMs via Conditional Probabilities
Chen, H., Didisheim, A., & Somoza, L. (2026) · National Bureau of Economic Research · doi:10.3386/w34965 · Cited by 2
Roy, A., & Roy, D. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2603.26797 · Cited by 2
Mesterséges intelligencia a közgazdasági kutatásban
Fertő, I. (2025) · Külgazdaság · doi:10.47630/kulg.2025.69.5-6.63 · Cited by 1
How large language models incorporate venture capital into investor portfolios
Fieberg, C., Hornuf, L., Meiler, M., & Streich, D. J. (2026) · Venture Capital · doi:10.1080/13691066.2026.2620668 · Cited by 1
ChatMacro: Evaluating Inflation Forecasts of Generative AI
Alam, M. J., Boyle, S., Francisco, F. R. B. O. S., Li, H., Francisco, F. R. B. O. S., & Sekhposyan, T. (2026) · Federal Reserve Bank of San Francisco, Working Paper Series · doi:10.24148/wp2026-04 · Cited by 1
Khanna, S., Berger, A., Berghaus, D., Deußer, T., Sparrenberg, L., & Sifa, R. (2025) · IEEE International Conference on Data Science and Advanced Analytics (DSAA) · doi:10.1109/dsaa65442.2025.11247993 · Cited by 1
The Market's Mirror: Revealing Investor Disagreement with LLMsPreprint
Bhagwat, V., Cookson, J. A., Dim, C., & Niessner, M. (2025) · SSRN Electronic Journal · doi:10.2139/ssrn.5375473 · Cited by 1
Seeing the Goal, Missing the Truth: Human Accountability for AI BiasPreprint
CAO, S. S., Jiang, W., & Xu, H. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2602.09504 · Cited by 1
ChatGPT as a Time Capsule: The Limits of Price DiscoveryPreprint
Lehner, S., & Lopez-Lira, A. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2604.21433 · Cited by 1
Self-citationNumLeak: Public Numeric Benchmarks as Latent Labels in Foundation ModelsPreprint
Kotawala, A. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2605.30393 · Cited by 1
LiveOption: Evaluating LLM Agents in Structured Option Trading with Nonlinear PayoffsPreprint
Luo, H., Li, Y., Minh, A. B., Luo, X., Lai, Z., Zhang, Y., & Liu, C. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2609.33470 · Cited by 1
Look-Ahead-Bench: a Standardized Benchmark of Look-ahead Bias in Point-in-Time LLMs for Finance
Benhenda, M. (2026) · arXiv
Du, Y., & Tang, G. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2507.07037
Ėkonomičeskaja politika = Economic policy = Oikonomia - politika
chozjajstva, A. N., & služby, R. A. N. C. I. G. (n.d.)
Kim, J., Kim, Y., Lee, Y., & Byun, H. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2510.14162
Do Large Language Models (LLMs) Understand Chronology? (Student Abstract)
Wongchamcharoen, P. K., & Glasserman, P. (2026) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v40i48.42295
Seeing the Goal, Missing the Truth: Human Accountability for AI Bias
Cao, S., Jiang, W., & Xu, H. (2026) · National Bureau of Economic Research · doi:10.3386/w35142
Čižinská, R., & Neset, P. (2026) · International Scientific Conference Central and Eastern Europe in the Changing Business Environment · doi:10.18267/pr.2026.vol.2587.7
Regan, C., & Xie, Y. (2026) · Journal of risk and financial management · doi:10.3390/jrfm19060382
Synthetic Audiences as Proxies for Human Users: A Systematic Literature Review
Lappas, T., & Filippas, A. (2026) · IEEE Access · doi:10.1109/access.2026.3703706
Huang, W., Li, J., Yu, Z., & Kong, X. (2026) · Lecture notes in computer science · doi:10.1007/978-981-92-3400-4_30
Egy évvel később: mit tanultunk az AI és a közgazdasági kutatás kapcsolatáról?
Fertő, I. (2026) · Külgazdaság · doi:10.47630/kulg.2026.70.5-6.3
Completing the Curve: Visual Extrapolation and Short-term Return PredictabilityPreprint
Wang, J., Xu, Y., & Yu, J. (2026) · SSRN Electronic Journal · doi:10.2139/ssrn.7087542
Neural Networks in Economics: A Selective Review
Chen, X., Hoderlein, L., & Lieber, J. (2026) · Journal of Political Economy Microeconomics · doi:10.1086/743458
REIT Return Predictability and Relative Sector Performance: The Role of News Sentiment
Schaefers, W., Lautenschlaeger, L., & Lütticke, J. (2026) · Annual European Real Estate Society Conference (ERES) · doi:10.15396/eres2026_194
The Equity Risk Premium of Russian Companies: Theory and Practice
Radygin, A., Abramov, A. E., & Chernova, M. I. (2026) · Economic Policy · doi:10.18288/1994-5124-2026-4-6-37
Uncertainty Quantification for Financial Foundation Models: A Survey
Sun, M., Zhao, Z., & Xu, S. (2026) · ACM International Conference on AI in Finance (ICAIF) · doi:10.2139/ssrn.7323498
Synthetic Consensus: Evaluating Large Language Model Forecasts with Repeated DrawsPreprint
Jaworski, K., & Alam, M. J. (2026) · SSRN Electronic Journal · doi:10.2139/ssrn.7382959
The Return Impact of Form 10-K Releases: Evidence from a Large Language ModelPreprint
Frey, J., Qiu, H., & Zhao, X. (2026) · SSRN Electronic Journal · doi:10.2139/ssrn.7441259
Nguyen, B. (2026) · SSRN Electronic Journal · doi:10.2139/ssrn.7485818
Can LLMs Predict the Future? A Brier Score Analysis of Prediction MarketsPreprint
Li, Y., Li, Z., & Cong, X. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2609.32885
Behavioral History Outperforms Descriptions of the Person for LLM Synthetic PersonasPreprint
Pourtaheri, K., & Zareei, A. (2026) · SSRN Electronic Journal · doi:10.2139/ssrn.7546841
From language-model stock rankings to testable economic rules: A computational auditPreprint
Wu, S., Li, X., Wang, Z., Liu, B., & Cai, W. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2610.01213
BioStudyBench: Evaluating Agents on Post-Cutoff Biomedical StudiesPreprint
Li, D., Karim, S., & Gensbigler, C. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2610.07614
Do LLM Valuation Agents Read the Filing? Metamorphic Tests of Filing Fidelity on Korean Listed FirmsPreprint
Park, D. G. (2026) · SSRN Electronic Journal · doi:10.2139/ssrn.7573358
Reading the News Without Hindsight: NoLBERT Topics and the Cross-Section of Stock ReturnsPreprint
Prakash, S., Foley, K., Vatsal, S., Hartadi, J., & Takkallapalli, C. (2026) · SSRN Electronic Journal · doi:10.2139/ssrn.7617420
Empirical Asset Pricing via Large Language Models
Yatawara, A. (2026) · The Journal of Finance and Data Science · doi:10.1016/j.jfds.2026.100207
Do AI Models Remember Indian Company Financials? Evidence on Look-Ahead Bias by Firm SizePreprint
Chandavarapu, S. M. (2026) · SSRN Electronic Journal · doi:10.2139/ssrn.7666459
The Illusion of Accuracy: Machine-Learning and GARCH Forecasts of UK Equity Index PricesPreprint
Bhatti, U., Umer, S., & Iqbal, A. (2026) · Research Square · doi:10.21203/rs.3.rs-11480555/v1
DealsFlow: An Evidence-Gated Agentic Harness for Venture Capital Deal TriagePreprint
Tang, M. Z., Cutting, D., Carson, B., & Carson, V. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2610.32380
宁, 樊., & Zhu, J. (2026) · arXiv (Cornell University)
EPSBench: Benchmarking LLM Agents for Earnings ForecastingPreprint
Yin, Y., Xu, C., Ye, L., Peng, J., & Zhang, C. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2610.38293
Thinking Fast, Trading Late: System One Decision Models vs the MarketPreprint
Dehkordi, A., Kargarzadeh, A., Khaledian, N., Parvini, N., Ghatak, S., & Khaledian, A. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2611.03985
Large Language Models for Forecasting of Electricity Price SpikesPreprint
Lin, L., Zhu, J., Lei, G., Wang, A., & Lu, X. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2611.04354
Khaledian, A., Kargarzadeh, A., Khaledian, N., Parvini, N., & Ghatak, S. (2026) · SSRN Electronic Journal · doi:10.2139/ssrn.7674961
LLMs Don't Know What They Know: Benchmarking Temporal Self-Knowledge for Financial BacktestingPreprint
Qian, L., Wang, Y., Peng, X., Cao, Y., Jiang, Y., Xie, Z., Xu, A., Cao, W., Chen, J., Li, Z., et al. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2611.06808
Self-citationFINCOSMOS: An Open-World Evaluation Paradigm for Agents in FinancePreprint
Cao, Y., Peng, X., Qian, L., Li, H., Yu, Y., Xu, A., Cao, W., Wang, Y., Jiang, Y., Wang, Y., et al. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2611.07464
Li, S., Wan, K., Hou, B., Deng, Y., & Yuan, Z. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2611.11588
Track or Follow? A Jev-Compatible Multi-Agent Trading System When Web News Lags the MarketPreprint
Feng, Y., Gan, G., Pan, L., Liang, R., Wu, C., Xu, J., & Liu, Y. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2611.10414
Momtaz, P., Wiklund, J., & Yuan, Y. (2026) · Research Square · doi:10.21203/rs.3.rs-11595914/v1
FinMFT: Multi-Source Fine-Tuning of Language Models for Financial News
Li, S., Lu, W. S., Mulvey, J. M., & Li, S. (2026) · ACM International Conference on AI in Finance (ICAIF) · doi:10.1145/3858063.3858857
Metadata
- Authors
- Lopez-Lira, A., Tang, Y., & Zhu, M.
- Affiliations
- University of Florida (US)
- Corresponding author
- Lopez-Lira, Alejandro
- Venue
- SSRN Electronic Journal
- Publisher
- Elsevier BV
- Published
- 2025
- ISSN
- 1556-5068 (ISSN-L)
- OpenAlex
- W4409569681
- Cited by
- 36
- References
- 11
- Citations by year
- 2026: 26 · 2025: 9
- Type
- posted content
- Language
- en
- Open access
- green
- doi.org
- Locations
- SSRN Electronic Journal (acceptedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Topics
- Social Sciences › Decision Sciences › Management Science and Operations Research › Stock Market Forecasting Methods
- Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
- Social Sciences › Decision Sciences › Management Science and Operations Research › Forecasting Techniques and Applications
- Keywords
- large language models, memorization, economic forecasting, data leakage, stock returns, economic indicators, news headlines, conference calls, motivated reasoning
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.