The DOI matches its Crossref record; 125 of the 125 references it cites were found in a registry or an index.
Fail Often, Fail Big, and Fail Fast? Learning from Small Failures and R&D Performance in the Pharmaceutical Industry
Open accessAbstract
Do firms learn from their failed innovation attempts? Answering this question is important because failure is an integral part of exploratory learning. In this study, we explore whether and under what circumstances firms learn from their small failures in experimentation. Building on organizational learning literature, we examine the conditions under which prior failures influence firms’ R&D output amount and quality. An empirical analysis of voluntary patent expirations (i.e., patents that firms give up by not paying renewal fees) in 97 pharmaceutical firms between 1980 and 2002 shows that the number, importance, and timing of small failures are associated with a decrease in R&D output (patent count) but an increase in the quality of the R&D output (forward citations to patents). Exploratory interviews suggest that the results are driven by a multi-level learning process from failures in pharmaceutical R&D. The findings contribute to the organizational learning literature by providing a nuanced view of learning from failures in experimentation.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
(1994) · Journal of the American Dietetic Association · doi:10.1016/0002-8223(94)92216-0 · Cited by 45,910
Absorptive Capacity: A New Perspective on Learning and Innovation
Cohen, W. M., & Levinthal, D. A. (1990) · Administrative Science Quarterly · doi:10.2307/2393553 · Cited by 35,728
Arellano, M., & Bond, S. (1991) · The Review of Economic Studies · doi:10.2307/2297968 · Cited by 33,272
Exploration and Exploitation in Organizational Learning
March, J. G. (1991) · Organization Science · doi:10.1287/orsc.2.1.71 · Cited by 21,942
An Evolutionary Theory of Economic Change.
Loasby, B. J., Nelson, R. R., & Winter, S. G. (1983) · The Economic Journal · doi:10.2307/2232409 · Cited by 21,366
(2019) · AEA Papers and Proceedings · doi:10.1257/pandp.109.612 · Cited by 10,902
Research in Organizational Behavior.
Grimes, A. J., Cummings, L. L., & Staw, B. M. (1986) · Administrative Science Quarterly · doi:10.2307/2392975 · Cited by 10,899
An Evolutionary Theory of Economic Change
Berkowitz, M. K., Nelson, R. R., & Winter, S. G. (1983) · Southern Economic Journal · doi:10.2307/1058233 · Cited by 10,549
Geographic Localization of Knowledge Spillovers as Evidenced by Patent Citations
Jaffe, A. B., Trajtenberg, M., & Henderson, R. (1993) · The Quarterly Journal of Economics · doi:10.2307/2118401 · Cited by 7,791
(1934) · SSRN Electronic Journal · Cited by 7,609
Journal of Economic Literature
(2019) · AEA Papers and Proceedings · doi:10.1257/pandp.109.633 · Cited by 7,468
Levinthal, D. A., & March, J. G. (1993) · Strategic Management Journal · doi:10.1002/smj.4250141009 · Cited by 7,283
Testing for Weak Instruments in Linear IV Regression
Stock, J. H., & Yogo, M. (2005) · Identification and Inference for Econometric Models · doi:10.1017/cbo9780511614491.006 · Cited by 7,211
Patent Statistics as Economic Indicators: A Survey
Griliches, Z. (1990) · National Bureau of Economic Research · doi:10.3386/w3301 · Cited by 5,828
Estimation and Inference in Econometrics.
Chambers, M. J., Davidson, R., & MacKinnon, J. G. (1994) · The Economic Journal · doi:10.2307/2234656 · Cited by 5,413
Collaboration Networks, Structural Holes, and Innovation: A Longitudinal Study
Ahuja, G. (2000) · Administrative Science Quarterly · doi:10.2307/2667105 · Cited by 5,079
Estimating Vector Autoregressions with Panel Data
Holtz-Eakin, D., Newey, W., & Rosen, H. S. (1988) · Econometrica · doi:10.2307/1913103 · Cited by 4,239
Appropriating the Returns from Industrial Research and Development
Levin, R. C., Klevorick, A. K., Nelson, R. R., Winter, S. G., Gilbert, R., & Griliches, Z. (1987) · Brookings Papers on Economic Activity · doi:10.2307/2534454 · Cited by 3,772
Central Problems in the Management of Innovation
Van de Ven, A. H. (1986) · Management Science · doi:10.1287/mnsc.32.5.590 · Cited by 3,746
Threat Rigidity Effects in Organizational Behavior: A Multilevel Analysis
Staw, B. M., Sandelands, L. E., & Dutton, J. E. (1981) · Administrative Science Quarterly · doi:10.2307/2392337 · Cited by 3,629
Econometric Models for Count Data with an Application to the Patents-R & D Relationship
Hausman, J., Hall, B. H., & Griliches, Z. (1984) · Econometrica · doi:10.2307/1911191 · Cited by 3,393
The Estimation of Economic Relationships using Instrumental Variables
Sargan, J. D. (1958) · Econometrica · doi:10.2307/1907619 · Cited by 3,377
Cohen, W., Nelson, R., & Walsh, J. (2000) · National Bureau of Economic Research · doi:10.3386/w7552 · Cited by 3,025
A Behavioral Theory of the Firm
Baumol, W. J., Cyert, R. M., & March, J. G. (1964) · Journal of Marketing Research · doi:10.2307/3150326 · Cited by 3,010
A Penny for Your Quotes: Patent Citations and the Value of Innovations
Trajtenberg, M. (1990) · The RAND Journal of Economics · doi:10.2307/2555502 · Cited by 2,956
Recombinant Uncertainty in Technological Search
Fleming, L. (2001) · Management Science · doi:10.1287/mnsc.47.1.117.10671 · Cited by 2,873
Jaffe, A. (1986) · National Bureau of Economic Research · doi:10.3386/w1815 · Cited by 2,808
Measuring Competence? Exploring Firm Effects in Pharmaceutical Research
Henderson, R., & Cockburn, I. (1994) · Strategic Management Journal · doi:10.1002/smj.4250150906 · Cited by 2,622
Beyond local search: boundary‐spanning, exploration, and impact in the optical disk industry
Rosenkopf, L., & Nerkar, A. (2001) · Strategic Management Journal · doi:10.1002/smj.160 · Cited by 2,610
Self-citationIndustrial market structure and economic performance
Scherer, F. M., & Ross, D. G. (1990) · Cited by 2,607
Ahuja, G., & Morris Lampert, C. (2001) · Strategic Management Journal · doi:10.1002/smj.176 · Cited by 2,501
Technological acquisitions and the innovation performance of acquiring firms: a longitudinal study
Ahuja, G., & Katila, R. (2001) · Strategic Management Journal · doi:10.1002/smj.157 · Cited by 2,404
Built to last: Successful habits of visionary companies
(1996) · Long Range Planning · doi:10.1016/s0024-6301(96)90211-3 · Cited by 2,304
IS SLACK GOOD OR BAD FOR INNOVATION?
NOHRIA, N., & GULATI, R. (1996) · Academy of Management Journal · doi:10.2307/256998 · Cited by 2,135
Knee-deep in the big muddy: a study of escalating commitment to a chosen course of action
Staw, B. M. (1976) · Organizational Behavior and Human Performance · doi:10.1016/0030-5073(76)90005-2 · Cited by 2,061 · cited 1×
“Moreover, later failures may lead to escalation of commitment and cause a firm to continue related investments (Staw, 1976).”
BackgroundA Process Model of Internal Corporate Venturing in the Diversified Major Firm
Burgelman, R. A. (1983) · Administrative Science Quarterly · doi:10.2307/2392619 · Cited by 1,878
Aging, Obsolescence, and Organizational Innovation
Sørensen, J. B., & Stuart, T. E. (2000) · Administrative Science Quarterly · doi:10.2307/2666980 · Cited by 1,862
Testing for Weak Instruments in Linear IV Regression
Stock, J., & Yogo, M. (2002) · doi:10.3386/t0284 · Cited by 1,842
Jaffe, A. B. (1986) · RePEc: Research Papers in Economics · Cited by 1,699
THE LEARNING CURVE: HISTORICAL REVIEW AND COMPREHENSIVE SURVEY
Yelle, L. E. (1979) · Decision Sciences · doi:10.1111/j.1540-5915.1979.tb00026.x · Cited by 1,541
Burgelman, R. A. (1991) · Organization Science · doi:10.1287/orsc.2.3.239 · Cited by 1,469
Darr, E. D., Argote, L., & Epple, D. (1995) · Management Science · doi:10.1287/mnsc.41.11.1750 · Cited by 1,455
Scale, Scope, and Spillovers: The Determinants of Research Productivity in Drug Discovery
Henderson, R., & Cockburn, I. (1996) · The RAND Journal of Economics · doi:10.2307/2555791 · Cited by 1,388
Science as a map in technological search
Fleming, L., & Sorenson, O. (2004) · Strategic Management Journal · doi:10.1002/smj.384 · Cited by 1,370
Rice, T. K. (2014) · Encyclopedia of Special Education · doi:10.1002/9781118660584.ese1088 · Cited by 1,335
DeCarolis, D. M., & Deeds, D. L. (1999) · Strategic Management Journal · doi:10.1002/(sici)1097-0266(199910)20:10<953::aid-smj59>3.0.co;2-3 · Cited by 1,325
Learning Curves in Manufacturing
Argote, L., & Epple, D. (1990) · Science · doi:10.1126/science.247.4945.920 · Cited by 1,321
Learning from Samples of One or Fewer
March, J. G., Sproull, L. S., & Tamuz, M. (1991) · Organization Science · doi:10.1287/orsc.2.1.1 · Cited by 1,258
Absorptive Capacity, Coauthoring Behavior, and the Organization of Research in Drug Discovery
Cockburn, I. M., & Henderson, R. M. (1998) · The Journal of Industrial Economics · doi:10.1111/1467-6451.00067 · Cited by 1,197
The Science of Learning and the Art of Teaching.
Skinner, B. F. (2007) · Cumulative record (enlarged ed.). · doi:10.1037/11324-010 · Cited by 1,137
Learning Through Failure : The Strategy of Small Losses
Sitkin, S. B. (1992) · Research in Organizational Behavior · Cited by 1,128
Footnotes to Organizational Change
March, J. G. (1981) · Administrative Science Quarterly · doi:10.2307/2392340 · Cited by 1,114
Sampson, R. C. (2007) · Academy of Management Journal · doi:10.5465/amj.2007.24634443 · Cited by 1,077
McFadyen, M. A., & Cannella, A. A. (2004) · Academy of Management Journal · doi:10.2307/20159615 · Cited by 1,039
What percentage of innovations are patented? empirical estimates for European firms
Arundel, A., & Kabla, I. (1998) · Research Policy · doi:10.1016/s0048-7333(98)00033-x · Cited by 991
Innovation Contests, Open Innovation, and Multiagent Problem Solving
Terwiesch, C., & Xu, Y. (2008) · Management Science · doi:10.1287/mnsc.1080.0884 · Cited by 923
The Local and Variegated Nature of Learning in Organizations: A Group-Level Perspective
Edmondson, A. C. (2002) · Organization Science · doi:10.1287/orsc.13.2.128.530 · Cited by 920
Wildavsky, A. (1990) · The Journal of Risk and Insurance · doi:10.2307/252851 · Cited by 911
Exploration, exploitation, and financial performance: analysis of S&P 500 corporations
Uotila, J., Maula, M., Keil, T., & Zahra, S. A. (2009) · Strategic Management Journal · doi:10.1002/smj.738 · Cited by 906
Cardinal, L. B. (2001) · Organization Science · doi:10.1287/orsc.12.1.19.10119 · Cited by 860
Audia, P. G., Locke, E. A., & Smith, K. G. (2000) · Academy of Management Journal · doi:10.2307/1556413 · Cited by 852
Optimal Patent Length and Breadth
Gilbert, R., & Shapiro, C. (1990) · The RAND Journal of Economics · doi:10.2307/2555497 · Cited by 839
Built to Last: Successful Habits of Visionary Companies
Kohnen, J. B. (1995) · Quality Management Journal · doi:10.1080/10686967.1995.11918709 · Cited by 821
When do firms learn from their acquisition experience? Evidence from 1990 to 1995
Hayward, M. L. A. (2002) · Strategic Management Journal · doi:10.1002/smj.207 · Cited by 797
Organizational Learning from Performance Feedback: A Behavioral Perspective on Innovation and Change
Greve, H. R. (2003) · Cambridge University Press eBooks · doi:10.1017/cbo9780511615139 · Cited by 771
Do Scientists Pay to Be Scientists?
Stern, S. (2004) · Management Science · doi:10.1287/mnsc.1040.0241 · Cited by 748
Levinthal, D., & Rerup, C. (2006) · Organization Science · doi:10.1287/orsc.1060.0197 · Cited by 744
Survival-Enhancing Learning in the Manhattan Hotel Industry, 1898–1980
Baum, J. A. C., & Ingram, P. (1998) · Management Science · doi:10.1287/mnsc.44.7.996 · Cited by 740
Failing to Learn and Learning to Fail (Intelligently)
Cannon, M. D., & Edmondson, A. C. (2005) · Long Range Planning · doi:10.1016/j.lrp.2005.04.005 · Cited by 716
Adaptation as Information Restriction: The Hot Stove Effect
Denrell, J., & March, J. G. (2001) · Organization Science · doi:10.1287/orsc.12.5.523.10092 · Cited by 715
Hoffman, A. J., & Ocasio, W. (2001) · Organization Science · doi:10.1287/orsc.12.4.414.10639 · Cited by 683
Productivity, R&D, and the Data Constraint
Griliches, Z. (1998) · The Economic Impact of Knowledge · doi:10.1016/b978-0-7506-7009-8.50019-7 · Cited by 679
How Broad Should the Scope of Patent Protection Be?
Klemperer, P. (1990) · The RAND Journal of Economics · doi:10.2307/2555498 · Cited by 664
An empirical analysis of the determinants of global integration
Kobrin, S. J. (1991) · Strategic Management Journal · doi:10.1002/smj.4250120904 · Cited by 654
Madsen, P. M., & Desai, V. (2010) · Academy of Management Journal · doi:10.5465/amj.2010.51467631 · Cited by 652
Brand Loyalty, Entry, and Price Competition in Pharmaceuticals after the 1984 Drug Act
Grabowski, H. G., & Vernon, J. M. (1992) · The Journal of Law and Economics · doi:10.1086/467257 · Cited by 574
Aspiration Performance and Railroads’ Patterns of Learning from Train Wrecks and Crashes
Baum, J. A. C., & Dahlin, K. B. (2007) · Organization Science · doi:10.1287/orsc.1060.0239 · Cited by 551
Strategy making as iterated processes of resource allocation
Noda, T., & Bower, J. L. (2007) · Strategic Management Journal · doi:10.1002/smj.4250171011 · Cited by 546
Strategies of learning from failure.
Edmondson, A. C. (2011) · PubMed · Cited by 510
Learning from Complexity: Effects of Prior Accidents and Incidents on Airlines' Learning
Haunschild, P. R., & Sullivan, B. N. (2002) · Administrative Science Quarterly · doi:10.2307/3094911 · Cited by 494
Nerkar, A., & Roberts, P. W. (2004) · Strategic Management Journal · doi:10.1002/smj.417 · Cited by 481
Self-citationOrganizational learning from performance feedback a behavioral perspective on innovation and change
Greve, H. R. (2003) · Cited by 468
Attentional Triangulation: Learning from Unexpected Rare Crises
Rerup, C. (2009) · Organization Science · doi:10.1287/orsc.1090.0467 · Cited by 460
Econometric Models for Count Data with an Application to the Patents-R&D Relationship
Hausman, J. A., Hall, B. H., & Griliches, Z. (1984) · National Bureau of Economic Research · doi:10.3386/t0017 · Cited by 445
Kim, J.-Y. (., & Miner, A. S. (2007) · Academy of Management Journal · doi:10.5465/amj.2007.25529755 · Cited by 443
Patents as a Measure of Innovative Activity
J. Acs, Z., & Audretsch, D. B. (1989) · Kyklos · doi:10.1111/j.1467-6435.1989.tb00186.x · Cited by 441
Penner‐Hahn, J., & Shaver, J. M. (2005) · Strategic Management Journal · doi:10.1002/smj.436 · Cited by 439
Geographic Distribution of R&D Activity: How Does it Affect Innovation Quality?
Lahiri, N. (2010) · Academy of Management Journal · doi:10.5465/amj.2010.54533233 · Cited by 438
USES AND ABUSES OF PATENT STATISTICS
Pavitt, K. (1988) · Elsevier eBooks · doi:10.1016/b978-0-444-70537-2.50021-0 · Cited by 387
Experimentation Matters: Unlocking the Potential of New Technologies for Innovation
Thomke, S. H. (2003) · Medical Entomology and Zoology · Cited by 385
What Makes Them Tick? Employee Motives and Firm Innovation
Sauermann, H., & Cohen, W. M. (2010) · Management Science · doi:10.1287/mnsc.1100.1241 · Cited by 378
Learning from failures: Why it May Not Happen
Baumard, P., & Starbuck, W. H. (2005) · Long Range Planning · doi:10.1016/j.lrp.2005.03.004 · Cited by 370
Gambardella, A. (1992) · Research Policy · doi:10.1016/0048-7333(92)90001-k · Cited by 353
Paruchuri, S., Nerkar, A., & Hambrick, D. C. (2006) · Organization Science · doi:10.1287/orsc.1060.0207 · Cited by 347
Self-citationPatent Statistics as a Measure of Technical Change
Comanor, W. S., & Scherer, F. M. (1969) · Journal of Political Economy · doi:10.1086/259522 · Cited by 345
The dynamics of the transfer and renewal of patents
Serrano, C. J. (2010) · The RAND Journal of Economics · doi:10.1111/j.1756-2171.2010.00117.x · Cited by 332
Innovation Tournaments: Creating and Selecting Exceptional Opportunities
Terwiesch, C., & Ulrich, K. T. (2009) · Cited by 321
Experimentation matters: unlocking the potential of new technologies for innovation
Seidel, V. (2004) · Journal of Engineering and Technology Management · doi:10.1016/j.jengtecman.2004.05.002 · Cited by 317
Self-Enhancement and Learning from Performance Feedback
Jordan, A. H., & Audia, P. G. (2012) · Academy of Management Review · doi:10.5465/amr.2010.0108 · Cited by 296
Technology sourcing and output of established firms in a regime of encompassing technological change
Nicholls‐Nixon, C. L., & Woo, C. Y. (2003) · Strategic Management Journal · doi:10.1002/smj.329 · Cited by 287
The Role of Volition in Organizational Learning: The Case of Automotive Product Recalls
Haunschild, P. R., & Rhee, M. (2004) · Management Science · doi:10.1287/mnsc.1040.0219 · Cited by 287
De Carolis, D. M. (2003) · Journal of Management · doi:10.1177/014920630302900103 · Cited by 258
Corporate Structure and Performance Feedback: Aspirations and Adaptation in M-Form Firms
Gaba, V., & Joseph, J. (2013) · Organization Science · doi:10.1287/orsc.1120.0788 · Cited by 258
Credit and Classification: The Impact of Industry Boundaries in Nineteenth-Century America
Ruef, M., & Patterson, K. (2009) · Administrative Science Quarterly · doi:10.2189/asqu.2009.54.3.486 · Cited by 241
Eggers, J. P. (2012) · Strategic Management Journal · doi:10.1002/smj.956 · Cited by 238
The Mixed Effects of Inconsistency on Experimentation in Organizations
Lee, F., Edmondson, A. C., Thomke, S., & Worline, M. (2004) · Organization Science · doi:10.1287/orsc.1040.0076 · Cited by 226
Industry Effects and Appropriability Measures in the Stock Markets Valuation of R&D and Patents
Cockburn, I., & Griliches, Z. (1987) · National Bureau of Economic Research · doi:10.3386/w2465 · Cited by 217
Thomke, S., & Kuemmerle, W. (2002) · Strategic Management Journal · doi:10.1002/smj.242 · Cited by 183
The nanotech versus the biotech revolution: Sources of productivity in incumbent firm research
Rothaermel, F. T., & Thursby, M. (2007) · Research Policy · doi:10.1016/j.respol.2007.02.008 · Cited by 176
Alliance Activity as a Dynamic Capability in the Face of a Discontinuous Technological Change
Anand, J., Oriani, R., & Vassolo, R. S. (2010) · Organization Science · doi:10.1287/orsc.1090.0502 · Cited by 175
The impact of global and local cohesion on innovation in the pharmaceutical industry
Guler, I., & Nerkar, A. (2012) · Strategic Management Journal · doi:10.1002/smj.957 · Cited by 172
Self-citationFalling Flat: Failed Technologies and Investment under Uncertainty
Eggers, J. P. (2012) · Administrative Science Quarterly · doi:10.1177/0001839212447181 · Cited by 172
Fleming, L. (2002) · Industrial and Corporate Change · doi:10.1093/icc/11.5.1059 · Cited by 171
Combining Patent Law Expertise with R&D for Patenting Performance
Somaya, D., Williamson, I. O., & Zhang, X. (2007) · Organization Science · doi:10.1287/orsc.1070.0292 · Cited by 163
David, P., Yoshikawa, T., Chari, M. D. R., & Rasheed, A. A. (2006) · Strategic Management Journal · doi:10.1002/smj.523 · Cited by 159
Polidoro, F., & Toh, P. K. (2011) · Academy of Management Journal · doi:10.5465/amj.2011.60263099 · Cited by 150
From T-Mazes to Labyrinths: Learning from Model-Based Feedback
Denrell, J. C., Fang, C., & Levinthal, D. A. (2004) · Management Science · doi:10.1287/mnsc.1040.0271 · Cited by 139
The importance of the first relationship: The ongoing influence of initial network on future status
Milanov, H., & Shepherd, D. A. (2013) · Strategic Management Journal · doi:10.1002/smj.2109 · Cited by 110
Spillover Asymmetry and Why It Matters
Knott, A. M., Posen, H. E., & Wu, B. (2008) · Management Science · doi:10.1287/mnsc.1080.0950 · Cited by 103
FRUITS OF FAILURE: ORGANIZATIONAL FAILURE AND POPULATION LEVEL LEARNING.
Miner, A. S., Kim, J.-K., Holzinger, I., & Haunschild, P. R. (1996) · Academy of Management Proceedings · doi:10.5465/ambpp.1996.4980539 · Cited by 101
Henderson, A. D., & Stern, I. (2004) · Administrative Science Quarterly · doi:10.2307/4131455 · Cited by 92
Organizational learning curves: persistence, transfer and turnover
Argote, L. (2014) · International Journal of Technology Management · Cited by 87
Technological change in the Norwegian whaling industry
Basberg, B. L. (1982) · Research Policy · doi:10.1016/0048-7333(82)90017-8 · Cited by 56
Kettle, K. L., & Häubl, G. (2010) · Psychological Science · doi:10.1177/0956797610363541 · Cited by 38
Patents Associated with High-Cost Drugs in Australia
Christie, A. F., Dent, C., McIntyre, P., Wilson, L. R., & Studdert, D. M. (2013) · PLoS ONE · doi:10.1371/journal.pone.0060812 · Cited by 21
Cited by
Renewing Research on Problemistic Search—A Review and Research Agenda
Posen, H. E., Keil, T., Kim, S., & Meissner, F. D. (2018) · Academy of Management Annals · doi:10.5465/annals.2016.0018 · Cited by 462
Extending Signaling Theory to Rhetorical Signals: Evidence from Crowdfunding
Steigenberger, N., & Wilhelm, H. (2018) · Organization Science · doi:10.1287/orsc.2017.1195 · Cited by 326
Developing machine learning products better and faster at startups
Shams, R. (2018) · IEEE Engineering Management Review · doi:10.1109/emr.2018.2870669 · Cited by 14
N. Lane, J., Friis, S., Cai, T., Menietti, M., Weber, G., & Guinan, E. (2024) · doi:10.2139/ssrn.4769282 · Cited by 3
Metadata
- Authors
- Khanna, R., Guler, I., & Nerkar, A. A.
- Venue
- SSRN Electronic Journal
- Publisher
- Elsevier BV
- Published
- 2015
- Volume
- 59
- Issue
- 2
- Pages
- 436-459
- ISSN
- 0001-4273 (ISSN-L)
- 1556-5068
- OpenAlex
- W2044315762
- Cited by
- 313
- References
- 125
- FWCI
- 43.05
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.