The DOI matches its Crossref record; 22 of the 23 references it cites were found in a registry or an index; none of the 5 sources its claims cite is checked for support yet.
The productivity paradox of information technology
Open accessAbstract
The relationship between information technology (IT) and productivity is widely discussed but little understood.Delivered computing power in the U.S. economy has increased by more than two orders of magnitude since 1970 (Figure 1) yet productivity; especially in the B u s i n e s s C o m p u t i n g 1~ble 2. Studies of IT in M a n u f a c t u r i n g 'robl® 3. Studies of IT in Services
Overview
CoChat Summary
TL;DR
Brynjolfsson reviews the “IT productivity paradox”—large increases in computing power and IT investment without clear aggregate productivity gains—and argues the shortfall is at least partly due to measurement and methodological deficiencies rather than solely mismanagement. He organizes explanations into measurement errors, lags, redistribution, and mismanagement, and notes that some firm-level evidence finds high returns to IT.
Key findings
- U.S. delivered computing power increased by more than two orders of magnitude since 1970 while service-sector productivity stagnated; Solow’s summary is quoted: “we see computers everywhere except in the productivity statistics.”
- Roach’s cited statistics indicate output per production worker grew 16.9% between the mid-1970s and 1986, while output per information worker decreased 6.6%.
- Four explanations for the paradox are assessed: measurement errors, lags, redistribution, and mismanagement. The paper argues measurement difficulties may account for “the lion’s share” of the gap; Baily and Gordon’s revisions add 2.3% per year to productivity between 1973 and 1987 in finance, insurance, and real estate.
- Brynjolfsson and Hitt found service firms’ return on investment averaged over 60% per year, and the study with the largest and most detailed data set found no productivity shortfall. Lags are also noted: executives expected up to five years for IT payoffs, and an econometric study found two-to-three-year lags.
Methods
- Review and synthesis, not new primary data collection.
- Based on a computerized literature search of 30 leading journals in information systems and economics, plus discussions with leading researchers.
- Assesses principal empirical studies of IT and productivity across manufacturing and services and evaluates four hypotheses for the paradox.
Limitations
- The paper states there is still no definitive answer to whether IT’s productivity impact has actually been unusually low; research tools remain “blunt,” and the measurement problem is becoming more severe. It also cautions that “a shortfall of evidence is not necessarily evidence of a shortfall.”
- The paper states that studies usually spell out data and method limitations, but media may report only surprising conclusions, and managers tend to overemphasize productivity studies.
- Evident from the text: as a literature review, its conclusions depend on cited studies and their measurement and methodological limitations; it provides no new empirical estimates.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
0 Valid · 0 Not valid · 5 Not checked · 8 Own results and interpretations
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The sharp drop in productivity roughly coincided with the rapid increase in the use of IT (Figure 1).”
§ THE PRODUCTIVITY PARADOX OF INFORMATION TECHNOLOGY > EconomywJde Productivity and the Information Worker
plainstates an association- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A statement the paper makes itself — it cites no source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Econometric estimates have also indicated low IT capital productivity in a variety of manufacturing and service industries.”
§ THE PRODUCTIVITY PARADOX OF INFORMATION TECHNOLOGY > Dimensions of the Paradox
hedged- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“While a number of dimensions of the paradox are disturbing and provoking, we still do not have a definitive answer to the question of whether the productivity impact of IT has actually been unusually low.”
§ THE PRODUCTIVITY PARADOX OF INFORMATION TECHNOLOGY > Conclusion
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
In the paper
“Using a standard production function approach, Brynjolfsson and Hitt Business Computing [7] found that for the service firms in their sample, return on investment averaged over 60% per year.”
§ THE PRODUCTIVITY PARADOX OF INFORMATION TECHNOLOGY > COMMUNI CATI ONS OF THE ACM
What the sources say
- Not matchedcites [7]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Not matched
In the paper
“This accords with a recent econometric study by Brynjolfsson et al. [8] which found lags of two-tothree years before the strongest organizational impacts of IT were felt.”
§ THE PRODUCTIVITY PARADOX OF INFORMATION TECHNOLOGY > Lags
What the sources say
- Not matchedcites [8]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Not matched
5 more claims
Create a free account to see all 13 claims and every source verdict.
- It may state two separate claims as one. 2
- Probably not a substantial claim. 1
Citations
Cites
Reengineering Work: Don’t Automate, Obliterate
Hammer, M. M. (1990) · Cited by 2,908
Does Information Technology Lead to Smaller Firms?
Brynjolfsson, E., Malone, T. W., Gurbaxani, V., & Kambil, A. (1994) · Management Science · doi:10.1287/mnsc.40.12.1628 · Cited by 682
Self-citationThe Business Value of Computers: An Executive's Guide
Strassmann, P. A. (1990) · Medical Entomology and Zoology · Cited by 553
The Productivity Slowdown, Measurement Issues, and the Explosion of Computer Power
Baily, M. N., Gordon, R. J., Nordhaus, W. D., & Romer, D. (1988) · Brookings Papers on Economic Activity · doi:10.2307/2534534 · Cited by 391
Evaluation of strategic investments in information technology
Clemons, E. K. (1991) · Communications of the ACM · doi:10.1145/99977.99985 · Cited by 384
Services under siege--the restructuring imperative.
Roach, S. S. (1991) · PubMed · Cited by 350
Computers, Networks and the Corporation
Malone, T. W., & Rockart, J. F. (1991) · Scientific American · doi:10.1038/scientificamerican0991-128 · Cited by 342
Cron, W. L., & Sobol, M. G. (1983) · Information & Management · doi:10.1016/0378-7206(83)90034-4 · Cited by 290
IS INFORMATION SYSTEMS SPENDING PRODUCTIVE? NEW EVIDENCE AND NEW RESULTS
Brynjolfsson, E., & Hitt, L. M. (1993) · DSpace@MIT (Massachusetts Institute of Technology) · Cited by 205
Self-citationPurchased Services, Outsourcing, Computers, and Productivity in Manufacturing
Siegel, D. S., & Griliches, Z. (1991) · National Bureau of Economic Research · doi:10.3386/w3678 · Cited by 192
Research works printed but not linked: 11
- Alpar P, 1990, Proceedings of the Twenty- Second Hawaiian International Conference On System Science (Honolufu. Hawaii
- Baily M.N., 1988, Brooking~ Papers on Economic A ctivi~,, W.C. Brainard, and G.I., Perry.
- Berndt E.R., 1991, National Bureau of Economic Research Manuscript
- Brooke G, 1991, University of Minnesota
- 10.5555/3217170.3217173 · doi:10.5555/3217170.3217173
- Harris S.E., 1989, Prorceedings of the Twenty--Second Hawaikm International Conqference ~m System Science (Honolulu
- Loveman G.W., July, 1988.
- Noyelle T., Ed., 1990, the Service Sector. Westview Press, Boulder, Col.
- Siegel D., Apr., 1991
- Strassmann A., 1990, Conn.
- Weill P. Do Computers Pay Off? iCII Press Washington D.C. 1990. Weill P. Do Computers Pay Off? iCII Press Washington D.C. 1990.
Cited by
Items 2,401–2,500 of 2,614
Atatsi, J. (2025) · SSRN Electronic Journal · doi:10.2139/ssrn.5129747
Minh, N. N., & Ngọc, A. P. (2025) · Tạp chí Kinh tế và Phát triển · doi:10.33301/jed.vi.2110
Cui, J. (2025) · Research Square · doi:10.21203/rs.3.rs-6374810/v1
Information technology investment and business performance: The role of management practices
Chi Bich Thi, P. H. A. M., HOANG, H. T. T., & Dinh, D. T. (2025) · International Journal of Innovative Research and Scientific Studies · doi:10.53894/ijirss.v8i3.6509
Werthner, H. (2025) · Springer eBooks · doi:10.1007/978-3-031-86905-1_4
Bridging Cyber Resilience and IT Business Value: A Longitudinal Bibliometric Analysis
Giel, Z. V., Huygh, T., Joshi, A., & Haes, S. D. (2025) · Bled eConference · doi:10.18690/um.fov.4.2025.2
Assioro, O. L., Zandzou, U. J. A. G., & Mouanda-Mouanda, G. (2025) · doi:10.3917/emi.benta.2025.01.0184
Overcoming the Paradox of Productivity and Self-awareness: The Key to Finding Family Harmony
Prasetyo, E. A., Erfany, M. N., Sholichatun, Y., Mangestuti, R., & Rahayu, I. T. (2025) · Psikoislamika Jurnal Psikologi dan Psikologi Islam · doi:10.18860/psikoislamika.v22i1.33411
The Dynamics of Human-AI Interactions in Organizational Decision-Making
Öz, B., Karran, A. J., Beringer, J., Coursaris, C. K., & Léger, P. (2025) · Progress in IS · doi:10.1007/978-3-031-83512-4_3
Exploring task shifting in hospitals: an application of the Theoretical Framework of Acceptability
Larsen, A. C., Bech, M., Pottegård, A., & Lundby, C. (2025) · Journal of Public Health · doi:10.1007/s10389-025-02553-7
Bánhidi, Z., & Dobos, I. (2024) · Ludovika Egyetemi Kiadó eBooks · doi:10.36250/01181_45
Beyond Access and Skills: Framing Technostress as the Fourth-Level Digital DividePreprint
Mubarak, F. (2025) · SSRN Electronic Journal · doi:10.2139/ssrn.5398468
The Evolution of Research on the Digital EconomyPreprint
Kaiser, F. (2025) · SSRN Electronic Journal · doi:10.2139/ssrn.5399959
Suishan, G. U., Ma, J., Wang, K., Zhou, C., Zhang, M., & Wei, Z. (2025) · SSRN Electronic Journal · doi:10.2139/ssrn.5399975
Obermaier, R., & Schweikl, S. (2023) · Springer eBooks · doi:10.1007/978-3-658-36874-6_27-1
Haes, S. D., Joshi, A., Huygh, T., & Giel, Z. V. (2025) · Management for professionals · doi:10.1007/978-3-031-95886-1_4
The “Value Principle” in Management Practices, Organizational Design, and Industrial Organization
Legros, P., & Newman, A. F. (2025) · Games · doi:10.3390/g16050050
Kurt, S., Raza, A., Kurt, S., Rizvan, S., & Pallewatta, P. (2025) · Journal of Economics Finance and Management Studies · doi:10.47191/jefms/v8-i10-33
Digital Innovation in Microenterprises: Current Trends and New Research AvenuesPreprint
Gómez, J. E., Herrera, A., & Camacho, S. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2510.07519
Patent Wars: Staying Ahead of the Curve
Datta, A., & Jessup, L. (2012) · Emerald Group Publishing Limited eBooks · doi:10.1108/978-1-62396-060-520251012
Comparison of E-Commerce Practices between Large Enterprises and Small to Medium Enterprises
Cho, S., Chung, Y., & Kim, S. C. (2004) · Journal of the Association for Information Systems
Punpugdee, N. (2005) · VTechWorks (Virginia Tech)
Peretz, H. (2008) · Research Repository (Delft University of Technology)
Lines of Advance in Global Information Technology Management: American/West European Approach
Obra, A. R. D. Á., Bruque, S., & Meléndez, A. P. (2003) · Advances in global information management (AGIM) book series · doi:10.4018/978-1-59140-064-6.ch006
Der administrative Bereich als Untersuchungsgebiet
Beinhauer, M. (1996) · Gabler Verlag eBooks · doi:10.1007/978-3-322-90671-7_2
Designing a method for assessing the enterprise architecture business value
Meyer, M. (2015) · Dublin City University Open Access Institutional Repository (Dublin City University)
ICT, Innovation and Firm Performance
Tabatabaie, S. (2008) · Research Repository (Delft University of Technology)
Requirements Development and Management: Supporting the Business Objective
Piper, S. (1998) · Journal of the Association for Information Systems
Key IS Management Issues: a China Perspective *
Chen, G., Wu, R., & Guo, X. (2005) · RePEc: Research Papers in Economics
Challenges in IS evolution benefit assessment
Kankaanpää, I., Koskinen, J., Tilus, T., Sivula, H., Lintinen, H., & Ahonen, J. J. (2006)
Strategic System Landscape Engineering für kleine und mittlere Unternehmen
Kramer, F. (2016) · Digitalen Hochschulbibliothek Sachsen-Anhalt (Universitäts- und Landesbibliothek Sachsen-Anhalt) · doi:10.25673/4471
The paradox of productivity in the age of digitalization
Липов, В. В., & Ushenko, N. (2023) · Borys Grinchenko Kyiv University Institutional repository (Borys Grinchenko Kyiv University)
Towards Bridging Skill Gaps for the Future Industrial Workforce
Braun, G. (2023) · Chalmers Research (Chalmers University of Technology)
Kukkonen, K. (2023) · UTUPub (University of Turku)
Krause, S. L. (2024) · Portuguese National Funding Agency for Science, Research and Technology (RCAAP Project by FCT)
Impact of Information and Communication Technology (ICT) on Business Performance
Nahar, S. (2021) · Open Access at Essex (University of Essex)
Galli, F. (2023) · Archivio istituzionale della ricerca (Alma Mater Studiorum Università di Bologna)
Scheiding, F. C. (2024) · Portuguese National Funding Agency for Science, Research and Technology (RCAAP Project by FCT)
Älykästä tuottavuuden nostoa rakennusteollisuuteen
Laiho, O. (2024) · Jyväskylä University Digital Archive (University of Jyväskylä)
Häkkinen, P. (2025) · Aaltodoc (Aalto University)
Липов, В. В. (2021) · Digital Library of the Belarusian State University (Belarusian State University)
Calia, P. P., Brasili, C., & Mogiła, Z. (2023) · Archivio istituzionale della ricerca (Alma Mater Studiorum Università di Bologna)
Lühr, T., & Kämpf, T. (2025) · RePEc: Research Papers in Economics
de Oliveira, F. C. (2022) · LA Referencia (Red Federada de Repositorios Institucionales de Publicaciones Científicas)
The Effect of Generative AI on the Productivity of Consultants
Brommann, M. (2024) · Portuguese National Funding Agency for Science, Research and Technology (RCAAP Project by FCT)
Sanatpour, N. J. (2024) · Portuguese National Funding Agency for Science, Research and Technology (RCAAP Project by FCT)
The efficiency paradox: How AI affects journalist workflows and organizational dynamics
Fischer, T. (2025) · Aaltodoc (Aalto University)
Navigating AI system implementation
Berretta, S. (2025) · Dokumentenrepositorium der RUB (Ruhr University Bochum) · doi:10.13154/294-13591
Richtiges Handeln vs. statistische Maschinen
Milkau, U. (2025) · Springer eBooks · doi:10.1007/978-3-658-48335-7_3
Bartha, Z. (2025) · Repository of the Academy's Library (Library of the Hungarian Academy of Sciences)
Statisztika+ Kondratyjev konferencia előadásai 2025. szeptember 12.
(2025) · Repository of the Academy's Library (Library of the Hungarian Academy of Sciences)
Granger Causality between Country-Level IT Investment and Economic Growth in the US
Lee, S., & Kim, B.-G. (2025) · Journal of Multimedia Information System · doi:10.33851/jmis.2025.12.4.157
Alignment and Articulation Work in Computer Mediated Organization
Knox, H., O’Doherty, D. P., Vurdubakis, T., & Westrup, C. (2026) · Journal of Organizational Sociology · doi:10.1515/joso-2025-0040
Glossário bilíngue online na área de tecnologia da informação
Holanda, F. S. J. (2023) · LA Referencia (Red Federada de Repositorios Institucionales de Publicaciones Científicas)
Demand for Human Capital and Education Reforms
Fang, C. (2026) · Springer eBooks · doi:10.1007/978-981-95-2461-7_6
Li, B., & Li, D. (2026) · Administrative Sciences · doi:10.3390/admsci16020065
Debating the Speed of Organizational Change
Svärd, O., & Rombach, B. (2026) · Springer eBooks · doi:10.1007/978-3-032-11031-2_1
Industry-specific effects of IT systems: uncovering the winners and losers
Ivanov, E., & Анатольевна, М. М. (2026) · Eurasian economic review : · doi:10.1007/s40821-026-00342-0
A new method for the early detection of important inventionsPreprint
Kemeny, T., Petralia, S., & Storper, M. (2026) · SSRN Electronic Journal · doi:10.2139/ssrn.6315228
Herdana, K. R., Wijaya, R. S., & Perdana, P. (2026) · East Asian Journal of Multidisciplinary Research · doi:10.55927/eajmr.v5i1.553
Göksidan, H. T. (2024) · OpenMETU (Middle East Technical University)
Tuottavuudella ja digitalisaatiolla kestävää kilpailukykyä
Kaivo-oja, J., Vehmas, J., Erkkilä-Välimäki, A., Lakkala, H., Heikkinen, J., Kuoppakangas, P., & Kamal, R. (2025) · UTUPub (University of Turku)
Analyse stratégique et impacts de performance des sites web dans l'hôtellerie française indépendante
Luu, A.-D. (2012) · theses.fr (ABES) · doi:10.70675/b362c8ddz32b3z4c07z8f8cze170cd8e7f42
Nguyen, T. K. Y. (2011) · theses.fr (ABES) · doi:10.70675/4d6abdc4z4666z4000z9436z5339d71226fd
Caractéristiques des déterminants de performance : analyse en terme de cycle de vie de projets (SI)
Missaoui-Lourimi, I. (2012) · theses.fr (ABES) · doi:10.70675/05e2f9d5z7841z4dc3z8c2bz772afd056414
Contribution à l’évaluation du système d’information bancaire
Michel, S. (2011) · theses.fr (ABES) · doi:10.70675/1b4dda1cz49fcz4612zbc75zdee856879674
Multidimensional digital transformation and bank performance in china
Yang, L., & Yang, P. (2026) · Risk Management · doi:10.1057/s41283-026-00203-0
Workforce Impact of AI-Based Automation in Media
Heß, P., & Böhm, S. (2026) · Future of business and finance · doi:10.1007/978-3-032-07605-2_12
Enjeux économiques et environnementaux du tourisme en Tunisie : le cas de l’oasis de Tozeur
Souissi, A. (2017) · theses.fr (ABES) · doi:10.70675/f4cc6dc5za764z446bz9d4azff6d6f515ce5
Approche multimodale pour l'évaluation d'applications de communication innovantes
Rodio, F. (2016) · theses.fr (ABES) · doi:10.70675/894f027cz22e3z403ez96d9za6138cd5bd1b
Productivité du consommateur dans son magasinage et technologies mobiles
Voropanova, E. (2018) · theses.fr (ABES) · doi:10.70675/94c99070z3864z4c59z894az5e42346ce94e
The practice of strategic marketing in today’s digital environment : a paradox perspective
Kerguignas, J. Y. (2020) · theses.fr (ABES) · doi:10.70675/4ab333abzead5z4853zb2bfzb2699daa26f1
Digital inclusion and performance of informal firms in sub-Saharan Africa
Girollet, D. (2023) · theses.fr (ABES) · doi:10.70675/1a753e91z5db4z4e6fz9290z3c180e335ae8
В., С. П. (2025) · Scientific Notes of Lviv University of Business and Law · doi:10.5281/zenodo.19551901
Investigating How Leaders Decide on AI Innovations: Opportunities for HCI
Xie, S., Xiao, S., Peng, C., Mani, G., Zimmerman, J., & Eslami, M. (2026) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3772318.3790484
Genres of Paradoxical IS Theorising: Of Chaos–Puzzles and Spear–Shields
Wang, B., Ciriello, R., & Mathiassen, L. (2026) · Information Systems Journal · doi:10.1111/isj.70045
chen, G. (2026) · SSRN Electronic Journal · doi:10.2139/ssrn.6491082
Фесун, А. С. (2026) · Формування ринкових відносин в Україні · doi:10.66416/2522-1620.2.2026.99-105
Özdamar, S. G., & Ersöz, S. (2026) · Administrative Sciences · doi:10.3390/admsci16050214
Ito, A. (2026) · SSRN Electronic Journal · doi:10.2139/ssrn.6551118
The chief pharmacy officer’s role in integrating artificial intelligence across the enterprise
Aguero, D., Gross, K., Shaw, B. G., Amerine, L. B., & Tryon, J. (2026) · American Journal of Health-System Pharmacy · doi:10.1093/ajhp/zxag142
From AI adoption to organisational stabilisation
Ćwiertniak, R. (2026) · Scientific Papers of Silesian University of Technology Organization and Management Series · doi:10.29119/1641-3466.2026.246.6
Schaefer, S., & Wickert, C. M. J. (2026) · British Journal of Management · doi:10.1111/1467-8551.70076
Towards AI Transformation in Software Engineering - Selecting Generative AI Use CasesPreprint
Saarikallio, M., Kemell, K., & Abrahamsson, P. (2026) · SSRN Electronic Journal · doi:10.2139/ssrn.6826889
Emotional Sustainability in Digitized Work Environments
de Oliveira, L. R., dos Reis, I. P., & Martinho, F. I. F. (2026) · IGI Global eBooks · doi:10.4018/979-8-2600-2178-1.ch010
Theoretical Schumpetarian Background: Toward Global Economic Transformation
Hanusch, H., & Hara, Y. (2026) · SpringerBriefs in economics · doi:10.1007/978-981-92-1005-3_2
Tarasenko, A. V., & Kochetkov, S. V. (2026) · Izvestiya of Saratov University Economics Management Law · doi:10.18500/1994-2540-2026-26-2-133-144
Bhoj, J., Kumar, P., Sharma, S., & Kuhar, D. (2026) · International Journal of Drug Delivery Technology · doi:10.25258/ijddt.16.44s.73
Metadata
- Authors
- Brynjolfsson, E.
- Corresponding author
- Brynjolfsson, Erik
- ORCID
- Brynjolfsson, Erik
- Venue
- Communications of the ACM
- Published
- 1993-12
- Volume
- 36
- Issue
- 12
- Pages
- 66-77
- ISSN
- 0001-0782 (ISSN-L)
- 1557-7317
- OpenAlex
- W1978484347
- Semantic Scholar
- 2b9a95f6e1bc5dd2f1b17bcaafe11e28368aa4ca
- Cited by
- 2,604
- References
- 23
- Citations by year
- 2026: 148 · 2025: 85 · 2024: 72 · 2023: 77 · 2022: 68 · 2021: 70 · 2020: 82 · 2019: 77 · 2018: 79 · 2017: 84 · 2016: 85 · 2015: 104 · 2014: 112 · 2013: 100 · 2012: 129
- FWCI
- 79.59
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Locations
- Communications of the ACM (publishedVersion)
- Topics
- Social Sciences › Economics, Econometrics and Finance › Economics and Econometrics › Economic Growth and Productivity
- Social Sciences › Business, Management and Accounting › Management Information Systems › Information Technology Governance and Strategy
- Social Sciences › Economics, Econometrics and Finance › Economics and Econometrics › ICT Impact and Policies
- Keywords
- information technology, productivity, productivity paradox, computational power, business computing, manufacturing industry, service, IT investment returns
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
A language model drew the claims from the paper on 2026-11-14, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-11-14 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.