Can There Ever Be Too Many Options? A Meta-Analytic Review of Choice Overload
Open accessThe DOI matches its Crossref record; 126 of the 140 references it cites were found in a registry or an index.
Abstract
The choice overload hypothesis states that an increase in the number of options to choose from may lead to adverse consequences such as a decrease in the motivation to choose or the satisfaction with the finally chosen option. A number of studies found strong instances of choice overload in the lab and in the field, but others found no such effects or found that more choices may instead facilitate choice and increase satisfaction. In a meta-analysis of 63 conditions from 50 published and unpublished experiments (N = 5,036), we found a mean effect size of virtually zero but considerable variance between studies. While further analyses indicated several potentially important preconditions for choice overload, no sufficient conditions could be identified. However, some idiosyncratic moderators proposed in single studies may still explain when and why choice overload reliably occurs; we review these studies and identify possible directions for future research. (c) 2010 by JOURNAL OF CONSUMER RESEARCH, Inc..
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The text we found for this paper looks like another document, so the self-check wasn’t run.
Citations
Cites
Statistical power analysis for the behavioral sciences
(1990) · Computers, Environment and Urban Systems · doi:10.1016/0198-9715(90)90050-4 · Cited by 65,269
Measuring inconsistency in meta-analyses
Higgins, J. P. T., Thompson, S. G., Deeks, J. J., & Altman, D. G. (2003) · BMJ · doi:10.1136/bmj.327.7414.557 · Cited by 63,139
Quantifying heterogeneity in a meta‐analysis
Higgins, J. P. T., & Thompson, S. G. (2002) · Statistics in Medicine · doi:10.1002/sim.1186 · Cited by 36,763
A Theory of Cognitive Dissonance
Festinger, L. (1957) · doi:10.1515/9781503620766 · Cited by 24,241
A Theory of Cognitive Dissonance
(2017) · Macat Library eBooks · doi:10.4324/9781912282432 · Cited by 18,122
A BEHAVIORAL MODEL OF RATIONAL CHOICE
Simon, H. A. (1955) · The Quarterly Journal of Economics · doi:10.2307/1884852 · Cited by 15,877
Statistical Methods for Meta-Analysis
Wasserman, S., Hedges, L. V., & Olkin, I. (1988) · Journal of Educational Statistics · doi:10.2307/1164953 · Cited by 10,326
(2000) · Cited by 9,198
Social Choice and Individual Values.
Shackle, G. L. S., & Arrow, K. J. (1951) · Economica · doi:10.2307/2549613 · Cited by 7,792
(2001) · Empirical Direction in Design and Analysis · doi:10.4324/9781410600004-24 · Cited by 6,808
Research works printed but not linked: 4
- Gingras Isabelle (2003), “Dealing with Too Much Choice,” unpublished dissertation, Stanford University, Stanford, CA.
- Kleinschmidt Silke (2008), “Darf’s auch ein bisschen weniger sein? Der Einfluss von Einschränkung der Anzahl von Optionen auf den choice overload Effekt,” unpublished diploma thesis, University of Würzburg, Germany.
- Lane Robert E. (2000), The Loss of Happiness in Market Economies, New Haven, CT: Yale University Press.
- Miller Neal E. (1944), “Experimental Studies of Conflict,” in Personality and the Behavior Disorders, Vol. 1, ed. Hunt Joseph M. , New York: Ronald Press, 431–65.
Cited by
Items 801–900 of 1,071
Mitchell, S. N., Landor, A. M., & Zeiders, K. H. (2023) · Emerald Group Publishing Limited eBooks · doi:10.1108/s1530-353520230000022001 · Cited by 2
Merchandise and Category Management
Zentes, J., Morschett, D., & Schramm‐Klein, H. (2016) · Springer eBooks · doi:10.1007/978-3-658-10183-1_12 · Cited by 1
The size and distribution of donations: Effects of numbers of potential recipientsPreprint
Hogarth, R. M., & Soyer, E. (2010) · RePEc: Research Papers in Economics · Cited by 1
Ligon, V. (2014) · UA Campus Repository (The University of Arizona) · Cited by 4
Off the reservation: Pushing the bounds of rationality in experimental auctionsPreprint
Chavez, D., Palma, M. A., Chavez, D., et al. (2015) · RePEc: Research Papers in Economics · doi:10.22004/ag.econ.202164 · Cited by 1
Choice Overload and Sampling Risk: A Field Experiment with Actual ShoppersPreprint
Ong, D., & Mengxia, Z. (2011) · SSRN Electronic Journal · doi:10.2139/ssrn.1976270 · Cited by 1
Known Unknowns in Judgment and Choice
Walters, D. J., Fox, C. R., Fernbach, P. M., & Sloman, S. A. (2014) · PsycEXTRA Dataset · doi:10.1037/e509992015-226 · Cited by 1
Branding Implications of Co-Created Social Responsibility
Kull, A. J. (2016) · Digital Commons - University of South Florida (University of South Florida) · Cited by 1
Conjoint analysis for effective use of online video advertising on video sharing websites
Lee, J. (2012) · MOspace Institutional Repository (University of Missouri) · doi:10.32469/10355/43177 · Cited by 1
An Exploratory Study of Genders, Choice Overload,Perception of Variety and Decision Satisfaction
Cruz, S. (2017) · NORMA · Cited by 1
Hotel Online Booking Decisions Based on Price Complexity, Alternative Attractiveness, and Confusion
Xue, P. (2019) · The Atrium (University of Guelph) · Cited by 1
ON THE ROLE OF PSYCHOLOGICAL VARIABLES IN DECISION MAKING
Miller, A. M. (2018) · Research Exchange (Washington State University) · Cited by 1
A Generalized Markov Chain Model to Capture Dynamic Preferences and Choice OverloadPreprint
Goutam, K., Goyal, V., & Soret, A. (2019) · RePEc: Research Papers in Economics · doi:10.48550/arxiv.1911.06716 · Cited by 7
“This is referred to as the choice overload phenomenon and has been observed empirically in practice (see [10] and [18]).”
BackgroundA Comparative Perspective on the Paradox of Choice
Englund, M. D. (2021) · Digital Archive @ GSU · doi:10.57709/22700890 · Cited by 1
A Menu Dependent Luce Rule with a NumerairePreprint
Rehbeck, J. (2021) · SSRN Electronic Journal · doi:10.2139/ssrn.3828283 · Cited by 1
Engelbrecht, N. (2022) · eDiss (Georg-August-Universität Göttingen) · doi:10.53846/goediss-9428 · Cited by 3
When to Sacrifice Prediction Accuracy: Machine Learning or MNL Choice Model for Assortment PlanningPreprint
Peng, Z., Rong, Y., & Zhu, T. (2022) · SSRN Electronic Journal · doi:10.2139/ssrn.4298996 · Cited by 1
Hajisafi, A. (2023) · SSRN Electronic Journal · doi:10.2139/ssrn.4498284 · Cited by 1
Jiang, B., Wang, Z., Xue, C., et al. (2023) · SSRN Electronic Journal · doi:10.2139/ssrn.4504023 · Cited by 1
Elitzur, R., Katz, N., Muttath, P., & Soberman, D. A. (2023) · SSRN Electronic Journal · doi:10.2139/ssrn.4674493 · Cited by 1
Impact of Market Thickness and Heterogeneity on Matches in Online Marketplaces with Active ProvidersPreprint
Roy, R., Sunar, N., & Swaminathan, J. M. (2024) · SSRN Electronic Journal · doi:10.2139/ssrn.4723150 · Cited by 3
Assessing Brand Portfolio Size and its Relationship with Penetration and SalesPreprint
Tanusondjaja, A., Nenycz‐Thiel, M., Dawes, J. G., Kennedy, R., & Dunn, S. (2024) · SSRN Electronic Journal · doi:10.2139/ssrn.4732262 · Cited by 1
Mitigating the Effect of Product Variety on Consumer-Level Food WastePreprint
Alptekinoğlu, A., Dhanorkar, S., & Zou, F. (2025) · SSRN Electronic Journal · doi:10.2139/ssrn.5363717 · Cited by 1
Park, J., Min, B., Son, K., Song, J. Y., Ma, X., & Kim, J. (2026) · ACM International Conference on Intelligent User Interfaces (IUI) · doi:10.1145/3742413.3789107 · Cited by 52
“This lack of support during the initial phases of searching for and understanding the key domain information can increase information overload for unfamiliar decision-making situations [25, 69].”
Click‐Click‐Add – Product Search Strategies in Online Shopping
Schott, K., Papenmeier, A., Hienert, D., & Kern, D. (2025) · Proceedings of the Association for Information Science and Technology · doi:10.1002/pra2.1283 · Cited by 1
“Consequently, consumers may experience information and choice overload, inducing feelings of stress and frustration in users (Kusi et al., 2022) and decreasing their motivation to make a purchase decision (Iyengar & Lepper, 2000; Scheibehenne et al., 2010).”
Investigating Categorization Preferences for Online Dating Sites
Morrissette, S. (2015) · NSUWorks (Nova Southeastern University)
Lazzarini, J. C. (2012) · Digital Library of Theses and Dissertations (Universidade de São Paulo) · doi:10.11606/d.12.2012.tde-14122012-145758
Choice evaluation and context effects
Noguchi, T. (2026) · Warwick Research Archive Portal (University of Warwick) · doi:10.82444/warw.33648505
Eberle, L., Milan, G. S., & Toni, D. D. (2014) · Revista Facultad de Ciencias Económicas · doi:10.18359/rfce.639
Re-Analyzing a Meta-Analysis: Another Look at Choice Overload
Gonzales, G. E. (2016)
Loos, J. (2012) · University writing server of the University of Hohenheim (Universität Hohenheim)
On attitude towards choice. Some experimental evidence of choice aversion
Lec, F. L., & Tarroux, B. (2012) · PsycEXTRA Dataset · doi:10.1037/e629522012-033
Consumers Search and the Choice Overload HypothesisPreprint
Allender, W. J., Richards, T. J., & Park, S. (2013) · SSRN Electronic Journal · doi:10.2139/ssrn.2346994
CONSUMER CONFUSION: A TEST OF THE BEHAVIOURAL PERSPECTIVE MODEL
Anninou, I. (2013) · ORCA Online Research @Cardiff (Cardiff University)
Salience, Coordination and Cooperation in Contributing to Threshold Public GoodsPreprint
Corazzini, L., Cotton, C. S., & Valbonesi, P. (2013) · SSRN Electronic Journal · doi:10.2139/ssrn.2274196
Context-Dependent Choice as Explained by Foraging TheoryPreprint
Li, S., & Yu, N. N. (2015) · SSRN Electronic Journal · doi:10.2139/ssrn.2687279
Econometrics and decision making: Effects of communication of results
Soyer, E. (2012) · Repositori digital de la UPF (Universitat Pompeu Fabra)
Number of Options and Choice-Induced Preference Change
Ritoša, A., & Bajšanski, I. (2015) · Drustvena istrazivanja · doi:10.5559/di.24.2.06
Consumers' evaluation of line extensions that are positioned on atypical attributes
Henrique, Á., de Carvalho, P. E., van Herpen, E., & Trujillo-Barrera, A. (2013)
UNIVERSIDAD COMPLUTENSE DE MADRID FACULTAD DE CIENCIAS ECONÓMICAS Y EMPRESARIALES
Sanchis, R. G. (2013)
Filosofiche, S. (2014)
Three Essays in Operations and Marketing
Ke, T. T. (2015) · eScholarship (California Digital Library)
Beyond rationality : how individual differences result in suboptimal choices
Bogaerts, T. (2014) · Ghent University Academic Bibliography (Ghent University)
Vaia, G., Zingale, R., & Accademico, A. (2014)
When More is Less and Less is More: The Over Choice HypothesisPreprint
Vieira, V. A. (2011) · SSRN Electronic Journal · doi:10.2139/ssrn.1864632
Paradox of Choice: A Possible Explanation
Крейнович, В., & Kosheleva, O. M. (2015) · scholarworks - UTEP (The University of Texas at El Paso)
Belton, C. A. (2016) · RePEc: Research Papers in Economics
Yun, J. T. (2014) · Illinois Digital Environment for Access to Learning and Scholarship (University of Illinois at Urbana-Champaign)
Light, R., & Odden, C. (2015) · SSRN Electronic Journal · doi:10.2139/ssrn.2599640
Information Markets and Aggregation
Phatak, N. M. (2012) · eScholarship (California Digital Library)
Pedersen, P. E., & Nysveen, H. (2010) · NORA - Norwegian Open Research Archives
Smaele, H. D., Wispelaere, S. D., & Stappen, G. V. (2014) · Lirias
RADOVÁ, K. (2016) · Studia Psychologica · doi:10.21909/sp.2016.02.713
“Scheibehenne et al. (2010) proposed that licensing operates through an expression of intent to be virtuous, which reduces negative self-attributions associated with purchasing relative luxuries.”
BackgroundPeo, A. (2025) · Library, Museums and Press - UDSpace (University of Delaware) · doi:10.58088/9f2a-ez37
Pricing Strategy versus Heterogeneous Shopping Behavior under Market Price Dispersion
Álvarez, F., Rey, J., & Sanchis, R. G. (2016) · Abstract and Applied Analysis · doi:10.1155/2016/3254240
Perteklinį pasirinkimą nulemiančių veiksnių vertinimas: žaislų kategorijos atvejis
Kyguolienė, A., & Dromantienė, S. (2016) · Management of Organizations Systematic Research · doi:10.7220/mosr.2335.8750.2016.76.5
Exploring Antecedents, Performance Outcomes And Psychological Processes Of Multi-Device Use
Chen, C.-W. (2015) · CUNY Academic Works (City University of New York)
Impact of Alignability and Size on Brand Lines and Line Extension Performance: Empirical Evidence
Aurier, P., & Mejía, V. D. (2017) · Developments in marketing science: proceedings of the Academy of Marketing Science · doi:10.1007/978-3-319-47331-4_206
Is There In Choice No Beauty? Motivation for Choosing Moderates Choice Overload
Chan, E. Y. (2014) · TSpace (University of Toronto) · Cited by 1
Investors and Choice Overload: Evidence from IPOsPreprint
Chua, A., DeLisle, R. J., & Nasser, T. (2017) · SSRN Electronic Journal · doi:10.2139/ssrn.3022258
“For example, “too-much-choice effect” (Jessup, Veinott, Todd, and Busemeyer, 2009; Scheibehenne, Greifeneder, and Todd, 2009), “tyranny of choice” (Schwartz, 2000; Fasolo, McClelland, and Todd, 2007; White and Hoofrage, 2009), “hyperchoice” (Mick, Broniarczyk, and Haidt, 2004), and “overchoice”…”
Exploring decision processes behind food choices: An eye tracking approach
Perkovic, S. (2017) · White Rose eTheses Online (University of Leeds, The University of Sheffield, University of York) · doi:10.13140/rg.2.2.32718.82249
Zhu, K. (2017) · Nottingham Trent University's Institutional Repository (Nottingham Trent Repository)
Essays on the Industrial Organization of Food Retailing
Shih, T. M. (2013) · eScholarship (California Digital Library)
Content Curatorship and Collaborative Filtering: A Symbolic Interactionist Approach
Chipp, K., Strandberg, C., Nath, A., & Abduljabber, M. (2017) · Developments in marketing science: proceedings of the Academy of Marketing Science · doi:10.1007/978-3-319-66023-3_228
“Nevertheless, not all research on choice has found that this is negative for individuals (Scheibehenne, Greifeneder, & Todd, 2010).”
BackgroundSchool Has a Bad Storyline: Gamification in Educational Environments
Pynn, I. L. (2017) · Journal of International Crisis and Risk Communication Research
Conceptualizing user choice as motivational factor in ad-hoc tumor board scheduling applications
Aydingül, O., Jussupow, E., Spohrer, K., & Heinzl, A. (2018) · TUbilio (Technical University of Darmstadt)
Eng, S. (2018) · Digital Commons - URI (University of Rhode Island) · doi:10.23860/diss-eng-sereikhuoch-2018
Contemporary Issues and Challenges in Marketing Environment Worldwide
Pınarbaşı, F. (2018) · Advances in business strategy and competitive advantage book series · doi:10.4018/978-1-5225-7180-3.ch002
Post-Series Design: a tool for catalysing the diffusion of personalisable design
Malakuczi, V., Lucchio, L. D., COPPOLA, A., et al. (2018) · Proceedings of DRS · doi:10.21606/drs.2018.678
Can Haptic Inputs Mitigate Choice Overload
Thai, N. T., & Yüksel, Ü. (2018) · Research Online (University of Wollongong)
The Influence of Retailer Choices on Consumer Behaviors and Sales Productivity
Russo, G. M., Bozic, M., Cavacece, Y., & Granata, G. (2019) · Advances in marketing, customer relationship management, and e-services book series · doi:10.4018/978-1-5225-7856-7.ch007 · Cited by 1
Essays on financial decision making: how households save, invest, and dissave
Gerhard (2019) · Research Publications (Maastricht University) · doi:10.26481/dis.20190606pg
Disterheft, A., & Gaczek, P. (2018) · Handel Wewnętrzny
The Great Fact and the Good Life
Diamond, A. M. (2019) · Oxford University Press eBooks · doi:10.1093/oso/9780190263669.003.0003
Diamond, A. M. (2019) · Oxford University Press eBooks · doi:10.1093/oso/9780190263669.003.0013
The Benefits: Process Innovations
Diamond, A. M. (2019) · Oxford University Press eBooks · doi:10.1093/oso/9780190263669.003.0005
Diamond, A. M. (2019) · Oxford University Press eBooks · doi:10.1093/oso/9780190263669.003.0002
Diamond, A. M. (2019) · Oxford University Press eBooks · doi:10.1093/oso/9780190263669.003.0007
The Benefits: Morality, Equality, Mobility, Culture, and the Environment
Diamond, A. M. (2019) · Oxford University Press eBooks · doi:10.1093/oso/9780190263669.003.0008
Tradable Earthquake CertificatesPreprint
Dulleman, M., & Woerdman, E. (2017) · SSRN Electronic Journal · doi:10.2139/ssrn.3001859
An Economy of Innovative Dynamism
Diamond, A. M. (2019) · Oxford University Press eBooks · doi:10.1093/oso/9780190263669.003.0001
Innovation Bound or Unbound by Culture and Institutions
Diamond, A. M. (2019) · Oxford University Press eBooks · doi:10.1093/oso/9780190263669.003.0009
Diamond, A. M. (2019) · Oxford University Press eBooks · doi:10.1093/oso/9780190263669.003.0006
Diamond, A. M. (2019) · Oxford University Press eBooks · doi:10.1093/oso/9780190263669.003.0004
Allen, S. (2019) · ERA: Education and Research Archive (University of Alberta) · doi:10.7939/r3-qev8-fb31 · Cited by 1
Volumetric Demand and Set Size VariationPreprint
Hardt, N., & Kurz, P. (2019) · SSRN Electronic Journal · doi:10.2139/ssrn.3418383
The breadth-depth dilemma in a finite capacity model of decision-makingPreprint
Moreno-Bote, R., Ramírez-Ruiz, J., Drugowitsch, J., & Hayden, B. (2020) · bioRxiv · doi:10.1101/2020.03.13.987081
Characteristics of Elderly People’s Purchasing Behavior of Daily Foods
WAKABAYASHI, E., KOMINE, A., Oura, Y., Tamaki, S., & Yamamoto, J. (2020) · Journal of Food System Research · doi:10.5874/jfsr.26.4_301
Identifying the Picky ShopperPreprint
Cheng, A., Baumgartner, H., & Meloy, M. (2018) · SSRN Electronic Journal · doi:10.2139/ssrn.3152610
Choice Aversion in Directed NetworksPreprint
Lorca, J., & Melo, E. (2020) · SSRN Electronic Journal · doi:10.2139/ssrn.3588816
Benefits and Costs of International Trade
Berezvai, Z. (2020) · Studies in European economic law and regulation · doi:10.1007/978-3-030-41920-2_2 · Cited by 1
The Decision-Conflict and Multicriteria LogitPreprint
Gerasímou, G. (2020) · SSRN Electronic Journal · doi:10.2139/ssrn.3610742 · Cited by 1
So Many Choices: An Experimental Study of Digital Television Choice, Customization, and Satisfaction
Hoener, J. (2000) · doi:10.15760/etd.7412
“In a meta-analysis of 50 choice-overload experiments, Scheibehenne, Greifeneder, and Todd (2010) found that “no sufficient conditions could be identified that would lead to a reliable occurrence of choice overload,” (p. 418).”
MethodFactors Contributing to Recommendation Intention on Full-time and Part-time Job Websites
Kato, T. (2020) · Asian Conference on Business and Public Policy, official conference proceedings · doi:10.22492/issn.2189-1001.2020.3
The Real Oscar Curse: The Negative Consequences of Positive Status Shifts
Jensen, M. C., & Kim, H. (2015) · Cornell Peter and Stephanie Nolan School of Hotel Administration (Cornell University)
Is the Recommendation List the Longer the Better?—From Behavior Experiment Evidence
周, 雪. (2021) · E-Commerce Letters · doi:10.12677/ecl.2021.101001
“传统零售领域的研究表明,提供过多的商品选项虽然能刺激消费者购买热情,促使消费者做出更多 选择,但是也可能带来负面影响,比如购买满意度下降,或出现失望、后悔等负面情绪,甚至导致放弃 购买的行为。这种因选择过多带来消极影响现象被定义为“选择过载效应”[1] [2]或“过量选择效应”[3]。 互联网时代爆炸式增长的信息量增加了用户在线搜寻个人感兴趣内容的难度和成本,个性化推荐系 统的应用有助于解决这一问题。因而近年来,以提升推荐算法准确性为目的的研究成为学术热点。但高 准确性的推荐也导致推荐列表中的项目更加趋于同质化[4],提高了用户在与个性化推荐系统交互中的选 择过载效应出现的可能性。尤其在面对更多选项时,用户需要耗费大量时间和精力进…”
Rei, T. A. D. A., & Katsumata, S. (2020) · Kodo Keiryogaku (The Japanese Journal of Behaviormetrics) · doi:10.2333/jbhmk.47.111
“…および属性水準のバランスを操作し,架空の 8種類の 携帯用 CDプレーヤーを作成した.分析の結果,属性 数が多く,属性水準が選択肢間で均一なときに,情報 過負荷の発生確率が高くなることを示している. 膨大な情報を受容することで,消費者は混乱状態 に陥りやすい.Walsh, Hennig-Thurau, & Mitchell (2007)は混乱の 1つに,過負荷による混乱(overload confusion)を挙げ,それを「消費者が選択代替案を識 別,比較,理解するために処理可能な量を超え,過剰な 製品情報や選択代替案と直面した際に生じる困難さ」…”
Predicting Choice Averse and Choice Loving Behavior in a Field Experiment With Actual ShoppersPreprint
Ong, D. (2020) · SSRN Electronic Journal · doi:10.2139/ssrn.3613586
Metadata
- Authors
- Scheibehenne, B., Greifeneder, R., & Todd, P. M.
- Venue
- Journal of Consumer Research
- Publisher
- Oxford University Press (OUP)
- Published
- 2010-10
- Volume
- 37
- Issue
- 3
- Pages
- 409-425
- ISSN
- 0093-5301 (ISSN-L)
- 1537-5277
- OpenAlex
- W2177382657
- Cited by
- 1,070
- References
- 140
- Citations by year
- 2026: 67 · 2025: 79 · 2024: 83 · 2023: 76 · 2022: 73 · 2021: 73 · 2020: 72 · 2019: 99 · 2018: 70 · 2017: 69 · 2016: 62 · 2015: 65 · 2014: 56 · 2013: 49 · 2012: 52
- FWCI
- 27.75
- Type
- journal article
- Language
- en
- Open access
- Licence
- other-oa
- Locations
- Journal of Consumer Research (publishedVersion)
- Archive ouverte UNIGE (University of Geneva) (publishedVersion, other-oa)
- edoc (University of Basel) (acceptedVersion)
- edoc (University of Basel) (submittedVersion, other-oa)
- Max Planck Institute for Plasma Physics (submittedVersion)
- MPG.PuRe (Max Planck Society) (submittedVersion)
- MADOC (University of Mannheim) (submittedVersion)
- Archive ouverte UNIGE (University of Geneva) (submittedVersion, cc-by)
- Topics
- Social Sciences › Decision Sciences › General Decision Sciences › Decision-Making and Behavioral Economics
- Social Sciences › Business, Management and Accounting › Marketing › Consumer Market Behavior and Pricing
- Social Sciences › Business, Management and Accounting › Marketing › Consumer Behavior and Marketing Influence
- Keywords
- choice overload, decision-making, number of options, decision satisfaction, consumer behavior, decision fatigue
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
A second model labelled each claim on 2026-10-07 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.