The DOI matches its Crossref record; 22 of the 23 references it cites were found in a registry or an index; none of the 5 sources its claims cite is checked for support yet.
The productivity paradox of information technology
Open accessAbstract
The relationship between information technology (IT) and productivity is widely discussed but little understood.Delivered computing power in the U.S. economy has increased by more than two orders of magnitude since 1970 (Figure 1) yet productivity; especially in the B u s i n e s s C o m p u t i n g 1~ble 2. Studies of IT in M a n u f a c t u r i n g 'robl® 3. Studies of IT in Services
Overview
CoChat Summary
TL;DR
Brynjolfsson reviews the “IT productivity paradox”—large increases in computing power and IT investment without clear aggregate productivity gains—and argues the shortfall is at least partly due to measurement and methodological deficiencies rather than solely mismanagement. He organizes explanations into measurement errors, lags, redistribution, and mismanagement, and notes that some firm-level evidence finds high returns to IT.
Key findings
- U.S. delivered computing power increased by more than two orders of magnitude since 1970 while service-sector productivity stagnated; Solow’s summary is quoted: “we see computers everywhere except in the productivity statistics.”
- Roach’s cited statistics indicate output per production worker grew 16.9% between the mid-1970s and 1986, while output per information worker decreased 6.6%.
- Four explanations for the paradox are assessed: measurement errors, lags, redistribution, and mismanagement. The paper argues measurement difficulties may account for “the lion’s share” of the gap; Baily and Gordon’s revisions add 2.3% per year to productivity between 1973 and 1987 in finance, insurance, and real estate.
- Brynjolfsson and Hitt found service firms’ return on investment averaged over 60% per year, and the study with the largest and most detailed data set found no productivity shortfall. Lags are also noted: executives expected up to five years for IT payoffs, and an econometric study found two-to-three-year lags.
Methods
- Review and synthesis, not new primary data collection.
- Based on a computerized literature search of 30 leading journals in information systems and economics, plus discussions with leading researchers.
- Assesses principal empirical studies of IT and productivity across manufacturing and services and evaluates four hypotheses for the paradox.
Limitations
- The paper states there is still no definitive answer to whether IT’s productivity impact has actually been unusually low; research tools remain “blunt,” and the measurement problem is becoming more severe. It also cautions that “a shortfall of evidence is not necessarily evidence of a shortfall.”
- The paper states that studies usually spell out data and method limitations, but media may report only surprising conclusions, and managers tend to overemphasize productivity studies.
- Evident from the text: as a literature review, its conclusions depend on cited studies and their measurement and methodological limitations; it provides no new empirical estimates.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
0 Valid · 0 Not valid · 5 Not checked · 8 Own results and interpretations
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The sharp drop in productivity roughly coincided with the rapid increase in the use of IT (Figure 1).”
§ THE PRODUCTIVITY PARADOX OF INFORMATION TECHNOLOGY > EconomywJde Productivity and the Information Worker
plainstates an association- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A statement the paper makes itself — it cites no source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Econometric estimates have also indicated low IT capital productivity in a variety of manufacturing and service industries.”
§ THE PRODUCTIVITY PARADOX OF INFORMATION TECHNOLOGY > Dimensions of the Paradox
hedged- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“While a number of dimensions of the paradox are disturbing and provoking, we still do not have a definitive answer to the question of whether the productivity impact of IT has actually been unusually low.”
§ THE PRODUCTIVITY PARADOX OF INFORMATION TECHNOLOGY > Conclusion
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
In the paper
“Using a standard production function approach, Brynjolfsson and Hitt Business Computing [7] found that for the service firms in their sample, return on investment averaged over 60% per year.”
§ THE PRODUCTIVITY PARADOX OF INFORMATION TECHNOLOGY > COMMUNI CATI ONS OF THE ACM
What the sources say
- Not matchedcites [7]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Not matched
In the paper
“This accords with a recent econometric study by Brynjolfsson et al. [8] which found lags of two-tothree years before the strongest organizational impacts of IT were felt.”
§ THE PRODUCTIVITY PARADOX OF INFORMATION TECHNOLOGY > Lags
What the sources say
- Not matchedcites [8]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Not matched
5 more claims
Create a free account to see all 13 claims and every source verdict.
- It may state two separate claims as one. 2
- Probably not a substantial claim. 1
Citations
Cites
Reengineering Work: Don’t Automate, Obliterate
Hammer, M. M. (1990) · Cited by 2,908
Does Information Technology Lead to Smaller Firms?
Brynjolfsson, E., Malone, T. W., Gurbaxani, V., & Kambil, A. (1994) · Management Science · doi:10.1287/mnsc.40.12.1628 · Cited by 682
Self-citationThe Business Value of Computers: An Executive's Guide
Strassmann, P. A. (1990) · Medical Entomology and Zoology · Cited by 553
The Productivity Slowdown, Measurement Issues, and the Explosion of Computer Power
Baily, M. N., Gordon, R. J., Nordhaus, W. D., & Romer, D. (1988) · Brookings Papers on Economic Activity · doi:10.2307/2534534 · Cited by 391
Evaluation of strategic investments in information technology
Clemons, E. K. (1991) · Communications of the ACM · doi:10.1145/99977.99985 · Cited by 384
Services under siege--the restructuring imperative.
Roach, S. S. (1991) · PubMed · Cited by 350
Computers, Networks and the Corporation
Malone, T. W., & Rockart, J. F. (1991) · Scientific American · doi:10.1038/scientificamerican0991-128 · Cited by 342
Cron, W. L., & Sobol, M. G. (1983) · Information & Management · doi:10.1016/0378-7206(83)90034-4 · Cited by 290
IS INFORMATION SYSTEMS SPENDING PRODUCTIVE? NEW EVIDENCE AND NEW RESULTS
Brynjolfsson, E., & Hitt, L. M. (1993) · DSpace@MIT (Massachusetts Institute of Technology) · Cited by 205
Self-citationPurchased Services, Outsourcing, Computers, and Productivity in Manufacturing
Siegel, D. S., & Griliches, Z. (1991) · National Bureau of Economic Research · doi:10.3386/w3678 · Cited by 192
Research works printed but not linked: 11
- Alpar P, 1990, Proceedings of the Twenty- Second Hawaiian International Conference On System Science (Honolufu. Hawaii
- Baily M.N., 1988, Brooking~ Papers on Economic A ctivi~,, W.C. Brainard, and G.I., Perry.
- Berndt E.R., 1991, National Bureau of Economic Research Manuscript
- Brooke G, 1991, University of Minnesota
- 10.5555/3217170.3217173 · doi:10.5555/3217170.3217173
- Harris S.E., 1989, Prorceedings of the Twenty--Second Hawaikm International Conqference ~m System Science (Honolulu
- Loveman G.W., July, 1988.
- Noyelle T., Ed., 1990, the Service Sector. Westview Press, Boulder, Col.
- Siegel D., Apr., 1991
- Strassmann A., 1990, Conn.
- Weill P. Do Computers Pay Off? iCII Press Washington D.C. 1990. Weill P. Do Computers Pay Off? iCII Press Washington D.C. 1990.
Cited by
Items 2,201–2,300 of 2,614
Improving alignment between business and information technology using requirements engineering
Ullah, A. (2023) · Figshare · doi:10.26181/21845130
Gastos e governança de TI no governo do estado de São Paulo
Chagas, V. (2016) · Digital Library of Theses and Dissertations (Universidade de São Paulo) · doi:10.11606/d.12.2016.tde-19012016-150057
Az interpretatív rugalmasság eszközei: az információs rendszeren kívüli felhasználói rutinok
Bartis, E. (2014) · CUB Ph.D. Dissertations (Corvinus University of Budapest) · doi:10.14267/phd.2014035
Lee, S. (2012) · ThinkTech (Texas Tech University)
Budgeting in Hotels: A Contingency – Based Study in Northern Cyprus
Ramadan, D. (2013) · Eastern Mediterranean University Institutional Repository (Eastern Mediterranean University)
Measuring the Economic Benefits of Broadband
Bánhidi, Z. (2012)
Study of relationship between ICT and economic growth
Khodaveyrdi, O., Mohandessi, A., & Nemati, H. (2009)
Managing the information systems resource in health care: findings from two IS projects
Tähkäpää, J. (2014) · UTUPub (University of Turku)
Augusto, J., & Baptista, V. (2008)
An Empirical Study of User Perceptions on EMR Standardization Leading Medical & IT Convergence
Lee, J.-E., & Nah, S.-G. (2015) · Journal of Digital Convergence · doi:10.14400/jdc.2015.13.5.111
Filho, R. C. D. J., & Weiss, M. C. (2014) · CONTECSI - International Conference on Information Systems and Technology Management · doi:10.5748/9788599693100-11contecsi/rf-724
Sugiharto, T., & Sulistiowati, N. (2016) · Pressacademia · doi:10.17261/pressacademia.2016116543
Las nuevas fuentes de productividad en
Latina, A., & Torrent‐Sellens, J. (2015)
Vedanthachari, L. N., & Owen, R. (2015) · Middlesex University Research Repository (Middlesex University Of London)
Lee, S.-H., & Park, J. (2015) · The e-Business Studies · doi:10.15719/geba.16.5.201510.135
Microemancipatory practicies in information system development
Johansson, B., & Sudzina, F. (2009) · Journal of the Association for Information Systems
Study on Enterprise Informationization: Model Selection and Path
Yuan, X., Zhang, Y., & He, B. (2015) · RePEc: Research Papers in Economics
Workplace Innovation – Social Innovation Shaping Work Organisation and Working Life
Oeij, P. R. A. (2014) · XVIII ISA World Congress of Sociology (July 13-19, 2014)
Die digitalen Geschäftstechnologien und Total Action
Vervest, P. H. M., & Dunn, A. (2002) · Springer eBooks · doi:10.1007/978-3-642-56028-6_2
Adaptative development of a model for manging it value with strategic flexibility
Wiedenhofer, A. (2014) · LA Referencia (Red Federada de Repositorios Institucionales de Publicaciones Científicas)
Piñeiro-Sánchez, C. (2016) · SSRN Electronic Journal · doi:10.2139/ssrn.2804714
AIS Electronic Library (AISeL)
Johansson, B., & Sudzina, F. (2009)
Can IT Act as a Catalyst for Change in Hospitals? Some New Evidence
Paavola, T. (2010) · IGI Global eBooks · doi:10.4018/9781616920029.ch007
Information Systems and Their Interaction with Organisations
Beynon‐Davies, P. (1998) · doi:10.1007/978-1-349-14931-5_38
Contact Centers: Tool for Effective E-Business
Rijo, R. (2011) · IGI Global eBooks · doi:10.4018/978-1-60960-765-4.ch006
Andersen, J. I., & Hasanaj, E. (2010) · BIBSYS Brage (BIBSYS (Norway))
Andersen, B., & Corley-Coulibaly, M. (2006) · Palgrave Macmillan UK eBooks · doi:10.1057/9780230287709_2
Tetzlaff, J., & Holmström, J. (2010) · IGI Global eBooks · doi:10.4018/978-1-61520-692-6.ch012
Maes, K., Haes, S. D., & Grembergen, W. V. (2015) · Advances in e-business research series · doi:10.4018/978-1-4666-8133-0.ch002
E-Business Strategy and Firm Performance
Quan, J. “. (2011) · IGI Global eBooks · doi:10.4018/978-1-60960-587-2.ch105
Piieiro-SSnchez, C. (2016) · SSRN Electronic Journal · doi:10.2139/ssrn.2805216
Intranets: A New Breed of IT System?
Callaghan, J. (2000) · Palgrave Macmillan UK eBooks · doi:10.1057/9780333977675_16
Practically Applying the Technology Acceptance Model in Information Systems Research
Mojtahed, R., & Peng, G. C. A. (2013) · IGI Global eBooks · doi:10.4018/978-1-4666-2491-7.ch004
Eshraghi, A. (2015) · Advances in marketing, customer relationship management, and e-services book series · doi:10.4018/978-1-4666-8353-2.ch016
Designing an Information Systems Performance Management System: The Case of an Insurance Corporation
Perego, A. (2012) · IGI Global eBooks · doi:10.4018/978-1-4666-0170-3.ch019
Personnel Performance Management in IT eSourcing Environments
Hernández-López, A., Colomo‐Palacios, R., García-Crespo, Á., Martín, F. P., & Soto‐Acosta, P. (2011) · IGI Global eBooks · doi:10.4018/978-1-60566-346-3.ch013
Effectiveness of Organizational Decision Support Systems
Ho, T., & Raman, K. S. (1994) · IEEJ Transactions on Electronics Information and Systems · doi:10.1541/ieejeiss1987.114.3_316
The business value of XBRL reporting for Finnish public organizations
Kravi, A. (2015) · Aaltodoc (Aalto University)
A Model for ROI of IT investment in e-Governance projects
Mahalik, D. K. (2016) · International Conference on Information and Communication Technology for Competitive Strategies (ICTCS) · doi:10.1145/2905055.2905076
Model Base Systems Engineering used in developing a Telescope Manager
Roux, G. L. (2016) · INCOSE International Symposium · doi:10.1002/j.2334-5837.2016.00196.x
Essays on the Interactions of Consumer Behavior and Firm Strategy in Multi-Channel Environments
Li, B. (2016) · OpenCommons at University of Connecticut (University of Connecticut)
Netiesinis matematinis informacinių sistemų kainos ir naudos analizės modelis
Saulis, A. (2009) · Information & Media · doi:10.15388/im.2009.0.3223
Park, J., Kim, Y. S., & Chae, B. C. (2016) · Journal of the Korean society for quality management · doi:10.7469/jksqm.2016.44.2.309
Human Factors and IT Competitive Value
Sánchez, A. V., Hernández, M. J., & Bruque, S. (2004) · Human IT
Magutu, P. O., Muganda, N. O., & Ondimu, G. M. (2011) · Problems of Management in the 21st Century · doi:10.33225/pmc/11.02.121
A CAUTIONARY TALE FOR DIGITAL AGE TRANSITIONING: THE IMPEDING POLARIZATION EFFECTS
Iorgulescu, R. I., & Polimeni, J. M. (2016) · RePEc: Research Papers in Economics
Assessing the use and impact of information systems
Beynon‐Davies, P. (2013) · doi:10.1007/978-1-137-30777-4_9
Evaluating the benefits and ROI of a comprehensive CRM service - Case Itella Asiakkuusmarkkinointi
Aalto, M. (2010) · Aaltodoc (Aalto University)
Piñeiro-Sánchez, C. (2017) · SSRN Electronic Journal · doi:10.2139/ssrn.2934833
Indian and Japanese Software Engineering Students in the “Egoless Space”
Waychal, P., Akiwate, G., & Ohsaki, A. (2020) · ASEE International Forum · doi:10.18260/1-2--17185
Guo, R. (2016) · Illinois Digital Environment for Access to Learning and Scholarship (University of Illinois at Urbana-Champaign)
Proposta para integração de laboratórios forenses via rede de weblabs.
Giova, G. (2016) · Digital Library of Theses and Dissertations (Universidade de São Paulo) · doi:10.11606/t.3.2016.tde-19122016-142036
Essiet, U. M. (2016) · University of Huddersfield Repository (University of Huddersfield)
Son, I. (2011) · Singapore Management University Institutional Knowledge (InK) (Singapore Management University)
Lawrence, R., & Kamery, R. H. (2003) · Journal of economics and economic education research
Does IT have a real business value?
Groznik, A., & Kovačić, A. (2002) · University of Zagreb University Computing Centre (SRCE)
Singh, S., Kiran, R., & Goyal, D. (2017)
The Search for Advantage: Levels of E-Business Adoption by Different Firms
Welling, R., & White, L. (2009)
da Silva, A. L. C. D. L., Daher, S. D. F. D., & Silva, L. C. E. (2017) · Revista Produção Online · doi:10.14488/1676-1901.v17i3.2759
Hung, S., Hu, Y., Ou, C.-S., Chen, K., & Lu, C.-C. (2013) · Pacific Asia journal of the Association for Information Systems · doi:10.17705/1pais.05402
BENAOUNE, T. (2012) · Dirassat Journal Economic Issue · doi:10.34118/djei.v3i2.641
Jansen, S. (2013) · Edward Elgar Publishing eBooks · doi:10.4337/9781781955635.00006
Resistance to Integrate Information Systems in Healthcare Service: A Study on Developing Country
Umme, N. J., & Chowdhury, M. M. H. (2018) · Flexible systems management · doi:10.1007/978-981-10-8929-9_12
Evaluating Business Intelligence Investments : is comparative evaluation enough?
Aarenstrup, J., & Lagerström, A. (2018) · KTH Publication Database DiVA (KTH Royal Institute of Technology)
Exploring the Cloud Computing Loop in the Strategic Alignment Model
Belitski, M., Fernandez, V., Khalil, S., Li, W., & Liu, K. (2018) · IFIP advances in information and communication technology · doi:10.1007/978-3-319-94541-5_12
Koh, C. S. K. (2006) · DR-NTU (Nanyang Technological University) · doi:10.32657/10356/7720
Rodríguez, A., & Vázquez, X. H. (2010) · Hispana
Three Essays on Human Capital and Innovation in the United States.
Dotzel, K. R. (2017) · OhioLink ETD Center (Ohio Library and Information Network)
Wallin, A. (2018) · Aaltodoc (Aalto University)
Classification And Analysis Of Mobile Health Evaluation Through Taxonomy and Method Development
Yang, A. (2018) · Digital Archive @ GSU · doi:10.57709/12438902
Bourk, M. J. (2012) · Policy Quarterly · doi:10.26686/pq.v8i1.4410
Yu, Z., Xu, G., Pennock, M. J., Rouse, W. B., Naylor, M. D., Paul, M. V., Hirschman, K. B., Pepe, K. M., & Xie, H. (2018) · International Conference on Service Systems and Service Management · doi:10.1109/icsssm.2018.8465110
Sourcing IT Skills in Organizations: A Comparison Among European Countries
Batenburg, R. S. (2014) · Communications of the IIMA · doi:10.58729/1941-6687.1147
Introduction: Democracy, Innovation and Growth
Grillo, F., & Nanetti, R. Y. (2018) · Springer eBooks · doi:10.1007/978-3-030-02014-9_1
PRODUCTIVITY PARADOX IN SELECTED SECTORS OF AGRI-FOOD PRODUCTION BRANCH IN POLAND
Jałowiecki, P., Gostkowski, M., Woźniakowski, T., & Zmarzłowski, K. (2018) · Metody Ilościowe w Badaniach Ekonomicznych · doi:10.22630/mibe.2018.19.4.35
Working for Free: Hidden Social and Political Economies of the Internet in the Middle East
Anderson, J. W. (2018) · Oxford University Press eBooks · doi:10.1093/oso/9780190859329.003.0008
An exploratory study on benefits and success factors of information technology applications
Chow, C. W., Wu, A., & Yuen, S. (2001) · PolyU Institutional Research Archive (Hong Kong Polytechnic University)
Teruel hacia la sociedad de la información y el conocimiento
Górriz, C. G., & Castel, A. G. (2008) · Teruel: Revista del Instituto de Estudios Turolenses
Bishnoi, S., & Kumar, D. (2016) · International Journal of Advanced Science and Technology · doi:10.14257/ijast.2016.94.03
Do IT Investments Have a Real Business Value
Groznik, A., Kovačić, A., & Spremić, M. (2016)
Short-Run Pain, Long-Run Gain? Recessions and Technological TransformationPreprint
Kopytov, A., Roussanov, N. L., & Taschereau-Dumouchel, M. (2017) · SSRN Electronic Journal · doi:10.2139/ssrn.3074953
Gärtner, B., Duller, C., & Stadler, A. (2019) · Springer eBooks · doi:10.1007/978-3-658-27723-9_7
A service driven method for evaluating business and IT alignment
Alghamdi, H. (2018) · CentAUR (University of Reading) · doi:10.48683/1926.00084956
Smith, T. (2018) · Carleton University's Institutional Repository (MacOdrum Library, Carleton University) · doi:10.22215/etd/2018-12843
It’s All in the Game: Emancipation in Digitalized Working Environments
Schobin, J., & Staab, P. (2019) · Springer eBooks · doi:10.1007/978-3-030-28258-5_5
Marwah, S., Chan, A., & Herawaty, T. (2019) · Russian Journal of Agricultural and Socio-Economic Sciences · doi:10.18551/rjoas.2019-12.31
Beyond Economy: Impact of National Cultural Values on Nationwide Broadband Difffusion.
Joo, S.-H. (2010) · Deep Blue (University of Michigan)
“The Banquet ” or the art of management
Martin, J. (2019) · Sinergie Italian Journal of Management · doi:10.7433/s107.2018.12
The essence and structure of economic factors of global innovation networks development
Kramarenko, A. (2019) · Economic scope · doi:10.30838/p.es.2224.040719.30.546
Navigating The Leading Edge: A Prototype Curriculum for Software Systems Management
Ulferts, G. W., Shoemaker, D., & Drommi, A. (2001) · Journal of the Association for Information Systems
Choulli, S., & Berényi, L. (2020) · E-conom · doi:10.17836/ec.2020.1.003
MacKinnon, W. (2014) · Carleton University's Institutional Repository (MacOdrum Library, Carleton University) · doi:10.22215/etd/2014-10223
Schryen, G., Wagner, G., & Benlian, A. (2020) · SSRN Electronic Journal · doi:10.2139/ssrn.3581789
COMMUNICATION COMPETENCE TRAINING WITHIN MINORITY-OWNED SMALL BUSINESSES
Baggett, S. (2020) · CSUSB ScholarWorks (California State University, San Bernardino)
Differing Perceptions of Mobile Devices: Company-Issued Devices and Bring Your Own Device (BYOD)
Brown, W. S., & Palvia, P. (2020) · International Journal of Mobile Computing and Multimedia Communications · doi:10.4018/ijmcmc.2020070103
Metadata
- Authors
- Brynjolfsson, E.
- Corresponding author
- Brynjolfsson, Erik
- ORCID
- Brynjolfsson, Erik
- Venue
- Communications of the ACM
- Published
- 1993-12
- Volume
- 36
- Issue
- 12
- Pages
- 66-77
- ISSN
- 0001-0782 (ISSN-L)
- 1557-7317
- OpenAlex
- W1978484347
- Semantic Scholar
- 2b9a95f6e1bc5dd2f1b17bcaafe11e28368aa4ca
- Cited by
- 2,604
- References
- 23
- Citations by year
- 2026: 148 · 2025: 85 · 2024: 72 · 2023: 77 · 2022: 68 · 2021: 70 · 2020: 82 · 2019: 77 · 2018: 79 · 2017: 84 · 2016: 85 · 2015: 104 · 2014: 112 · 2013: 100 · 2012: 129
- FWCI
- 79.59
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Locations
- Communications of the ACM (publishedVersion)
- Topics
- Social Sciences › Economics, Econometrics and Finance › Economics and Econometrics › Economic Growth and Productivity
- Social Sciences › Business, Management and Accounting › Management Information Systems › Information Technology Governance and Strategy
- Social Sciences › Economics, Econometrics and Finance › Economics and Econometrics › ICT Impact and Policies
- Keywords
- information technology, productivity, productivity paradox, computational power, business computing, manufacturing industry, service, IT investment returns
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
A language model drew the claims from the paper on 2026-11-14, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-11-14 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.
