Algorithmic Transference: People Overgeneralize Failures of AI in the Government
The DOI matches its Crossref record; 50 of the 50 references it cites were found in a registry or an index.
Abstract
Artificial intelligence (AI) is pervading the government and transforming how public services are provided to consumers across policy areas spanning allocation of government benefits, law enforcement, risk monitoring, and the provision of services. Despite technological improvements, AI systems are fallible and may err. How do consumers respond when learning of AI failures? In 13 preregistered studies (N = 3,724) across a range of policy areas, the authors show that algorithmic failures are generalized more broadly than human failures. This effect is termed “algorithmic transference” as it is an inferential process that generalizes (i.e., transfers) information about one member of a group to another member of that same group. Rather than reflecting generalized algorithm aversion, algorithmic transference is rooted in social categorization: it stems from how people perceive a group of AI systems versus a group of humans. Because AI systems are perceived as more homogeneous than people, failure information about one AI algorithm is transferred to another algorithm to a greater extent than failure information about a person is transferred to another person. Capturing AI's impact on consumers and societies, these results show how the premature or mismanaged deployment of faulty AI technologies may undermine the very institutions that AI systems are meant to modernize.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“The spillover of moral attributions from one AI to a group of similar AIs extends previous findings that demonstrated generalization between singular AI agents in HCI [13,43] into a moral context.”
From The AI Double Standard: Humans Judge All AIs for the Actions of One (2025) · cites this paper as [43]
In the citing paper
“Our findings are in tension with Longoni et al. [43], where algorithmic failure generalized more than human failure in the context of AI-assisted government welfare programs, but they parallel Uhlmann et al. [60], where attributions of moral agency generalized between human agents who were biologically similar to a human criminal.”
From The AI Double Standard: Humans Judge All AIs for the Actions of One (2025) · cites this paper as [43]
In the citing paper
“In general, we show how the phenomenon of “algorithm aversion” [15] is echoed by similar dynamics in the moral context, including a direct extension of Longoni et al. [43], which found a spillover of algorithm aversion in the context of government welfare programs.”
From The AI Double Standard: Humans Judge All AIs for the Actions of One (2025) · cites this paper as [43]
In the citing paper
“In Study 2, the lack of spillover to all humans can be interpreted in light of psychological findings that people “represent humans as a heterogeneous group” [43].”
From The AI Double Standard: Humans Judge All AIs for the Actions of One (2025) · cites this paper as [43]
Citations
Cites
(2013) · Cited by 44,563
(1997) · Choice Reviews Online · doi:10.5860/choice.34-3702 · Cited by 4,887
Machines and Mindlessness: Social Responses to Computers
Nass, C., & Moon, Y. (2000) · Journal of Social Issues · doi:10.1111/0022-4537.00153 · Cited by 4,022
Parasuraman, A. (2000) · Journal of Service Research · doi:10.1177/109467050024001 · Cited by 3,328
Perceived locus of causality and internalization: Examining reasons for acting in two domains.
Ryan, R. M., & Connell, J. P. (1989) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.57.5.749 · Cited by 3,311 · cited 2×
“Another potential alternative explanation is based on locus of causality of the failure (internal to the agent versus external; Ryan and Connell 1989).”
BackgroundAlgorithm aversion: People erroneously avoid algorithms after seeing them err.
Dietvorst, B. J., Simmons, J. P., & Massey, C. (2015) · Journal of Experimental Psychology: General · doi:10.1037/xge0000033 · Cited by 3,232 · cited 8×
“…prior research has focused either on changes in reliance on an algo-rithm (benchmarked on changes in reliance on a person; cf. Berger et al. 2021; Dietvorst, Simmons, and Massey 2015; Prahl and Van Swol 2017) or on moral judgments ensuing from learning of algorithmic (vs. human) failures (Awad…”
BackgroundInfluentialSocial identity and intergroup relations.
Abrams, D. (2015) · APA handbook of personality and social psychology, Volume 2: Group processes. · doi:10.1037/14342-008 · Cited by 2,686
Clinical versus statistical prediction: A theoretical analysis and a review of the evidence.
Meehl, P. E. (1954) · University of Minnesota Press eBooks · doi:10.1037/11281-000 · Cited by 2,171
Nass, C., Steuer, J., & Tauber, E. R. (1994) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/191666.191703 · Cited by 2,148 · cited 1×
“…of social categories (Rossen et al. 2008), so much so that according to the computers-as-social-actors paradigm, people mindlessly apply social categories to computers even though they know that computers lack feelings and human motivations (Nass and Moon 2000; Nass, Steuer, and Tauber 1994).”
Algorithm appreciation: People prefer algorithmic to human judgment
Logg, J. M., Minson, J. A., & Moore, D. A. (2019) · Organizational Behavior and Human Decision Processes · doi:10.1016/j.obhdp.2018.12.005 · Cited by 2,061
Resistance to Medical Artificial Intelligence
Longoni, C., Bonezzi, A., & Morewedge, C. K. (2019) · Journal of Consumer Research · doi:10.1093/jcr/ucz013 · Cited by 2,015
Self-citationQuantifying social group evolution
Palla, G., Barabási, A.-L., & Vicsek, T. (2007) · Nature · doi:10.1038/nature05670 · Cited by 1,668 · cited 1×
“Group perception is a fl exible and dynamic process that may vary depending on the situational and social context (Palla, Barabasi, and Vicsek 2007).”
BackgroundTask-Dependent Algorithm Aversion
Castelo, N., Bos, M. W., & Lehmann, D. R. (2019) · Journal of Marketing Research · doi:10.1177/0022243719851788 · Cited by 1,500 · cited 3×
“…algorithm aversion (Cadario, Longoni, and Morewedge 2021; Dietvorst, Simmons, and Massey 2015; Longoni, Bonezzi, and Morewedge 2019, 2020; Longoni et al. 2022), appreciation (Castelo, Bos, and Lehmann 2019; Longoni and Cian 2020; Logg, Minson, and Moore 2019), or indifference (Berger et al. 2021).”
BackgroundMethodTask-Dependent Algorithm Aversion
Castelo, N., Bos, M. W., Bos, M. W., Lehmann, D. R., & Lehmann, D. R. (2019) · Springer eBooks · doi:10.1007/978-3-031-88067-4_21 · Cited by 1,441
Social Identity, Self-Categorization, and the Communication of Group Norms
Hogg, M. A., & Reid, S. A. (2006) · Communication Theory · doi:10.1111/j.1468-2885.2006.00003.x · Cited by 1,399 · cited 1×
“At the foundation of social identity theory is self-categorization, which describes how people categorize themselves and others into different social groups (Ayd ı nog ̆ lu and Cian 2014; Hogg and Reid 2006; Pandya, Cian, and Venkatesan 2022; Turner 1982).”
BackgroundCognitive Aspects of Prejudice1
Tajfel, H. (1969) · Journal of Social Issues · doi:10.1111/j.1540-4560.1969.tb00620.x · Cited by 991
Artificial Intelligence in Utilitarian vs. Hedonic Contexts: The “Word-of-Machine” Effect
Longoni, C., & Cian, L. (2022) · Journal of Marketing · doi:10.1177/0022242920957347 · Cited by 831 · cited 2×
“…algorithm aversion (Cadario, Longoni, and Morewedge 2021; Dietvorst, Simmons, and Massey 2015; Longoni, Bonezzi, and Morewedge 2019, 2020; Longoni et al. 2022), appreciation (Castelo, Bos, and Lehmann 2019; Longoni and Cian 2020; Logg, Minson, and Moore 2019), or indifference (Berger et al. 2021).”
BackgroundSelf-citationThe use of statistical heuristics in everyday inductive reasoning.
Nisbett, R. E., Krantz, D. H., Jepson, C., & Kunda, Z. (1983) · Psychological Review · doi:10.1037/0033-295x.90.4.339 · Cited by 811 · cited 1×
“…by research suggesting that members of homogeneous groups may be viewed as exemplifying the group ’ s central tendency, and therefore information about an individual member of a homogeneous group is more likely to be generalized to the whole group (Nisbett et al. 1983; Quattrone and Jones 1980).”
BackgroundAre Machines Gender Neutral? Gender‐Stereotypic Responses to Computers With Voices
Nass, C., Moon, Y., & Green, N. (1997) · Journal of Applied Social Psychology · doi:10.1111/j.1559-1816.1997.tb00275.x · Cited by 670
Intergroup Cognition and Intergroup Behavior
(2013) · Psychology Press eBooks · doi:10.4324/9780203763575 · Cited by 545
Quattrone, G. A., & Jones, E. E. (1980) · Journal of Personality and Social Psychology · doi:10.1037//0022-3514.38.1.141 · Cited by 513 · cited 2×
“…by research suggesting that members of homogeneous groups may be viewed as exemplifying the group ’ s central tendency, and therefore information about an individual member of a homogeneous group is more likely to be generalized to the whole group (Nisbett et al. 1983; Quattrone and Jones 1980).”
BackgroundSousa, W. G. D., Melo, E. R. P. D., Bermejo, P. H. D. S., Farias, R. A. S., & Gomes, A. O. (2019) · Government Information Quarterly · doi:10.1016/j.giq.2019.07.004 · Cited by 501
Tay, B., Jung, Y., & Park, T. (2014) · Computers in Human Behavior · doi:10.1016/j.chb.2014.05.014 · Cited by 490
The Perceived Utility of Human and Automated Aids in a Visual Detection Task
Dzindolet, M. T., Pierce, L. G., Beck, H. P., & Dawe, L. A. (2002) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1518/0018720024494856 · Cited by 386 · cited 1×
“After observing an advisor err or dispense bad advice, however, reliance on the algorithm decreases more than reliance on the human (Dietvorst, Simmons, and Massey 2015; Dzinzolet et al. 2002; Prahl and Van Swol 2017) unless the algorithm has the capacity to learn (Berger et al. 2021).”
BackgroundSocial Identity, Distinctiveness, and In-Group Homogeneity
Brewer, M. B. (1993) · Social Cognition · doi:10.1521/soco.1993.11.1.150 · Cited by 383 · cited 1×
“Out-group homogeneity has been documented across many naturally occurring groups, such as race, religion, nationality, and profession (Brewer 1993; Park, Judd, and Ryan 1991).”
BackgroundWhen Will a Brand Scandal Spill Over, and how Should Competitors Respond?
Roehm, M. L., & Tybout, A. M. (2006) · Journal of Marketing Research · doi:10.1509/jmkr.43.3.366 · Cited by 380 · cited 1×
“An example would be the case of a scandal related to Burger King ’ s ham-burger meat resulting in lower brand evaluations of Wendy ’ s (Roehm and Tybout 2006).”
BackgroundSocial Categorization: Implications for Creation and Reduction of Intergroup Bias
Wilder, D. A. (1986) · Advances in Experimental Social Psychology · doi:10.1016/s0065-2601(08)60217-8 · Cited by 347 · cited 1×
“For instance, research on intergroup perceptions links out-group homogeneity to need for uniqueness (Quattrone and Jones 1980), need for predictability (Irwin, Tripodi, and Bieri 1967), and need to justify in-group favoritism and out-group hostility (Wilder 1986).”
BackgroundUnderstanding, explaining, and utilizing medical artificial intelligence
Cadario, R., Longoni, C., & Morewedge, C. K. (2021) · Nature Human Behaviour · doi:10.1038/s41562-021-01146-0 · Cited by 342 · cited 3×
“Ourresearch makes a second theoretical contribution to the broader literature on consumer responses to AI systems (Cadario, Longoni, and Morewedge 2021; Castelo, Bos, and Lehmann 2019; Gill 2020; Longoni, Bonezzi, and Morewedge 2019, 2020).”
BackgroundMethodSelf-citationOut-group homogeneity effects in natural and minimal groups.
Ostrom, T. M., & Sedikides, C. (1992) · Psychological Bulletin · doi:10.1037/0033-2909.112.3.536 · Cited by 334 · cited 3×
“…similarity (Tajfel 1969), an effect called out-group homogeneity — the tendency to perceive out-groups as less variable and more homogeneous than members of one ’ s own group (in-groups) on several attributes (Linville and Fischer 1998; Ostrom and Sedikides 1992; Sedikides and Ostrom 1993).”
BackgroundUnderstanding algorithm aversion: When is advice from automation discounted?
Prahl, A., & Van Swol, L. (2017) · Journal of Forecasting · doi:10.1002/for.2464 · Cited by 308 · cited 3×
“One dimension of consumer response has assessed reliance on an algorithmic versus a human advisor before and after learning of the advisor failure rate (Berger et al. 2021; Dietvorst, Simmons, and Massey 2015; Prahl and Van Swol 2017; Srinivasan and Sarial-Abi 2021).”
BackgroundThe most human bot: Female gendering increases humanness perceptions of bots and acceptance of AI
Borau, S., Otterbring, T., Laporte, S., & Fosso Wamba, S. (2021) · Psychology & Marketing · doi:10.1002/mar.21480 · Cited by 272 · cited 1×
“For instance, people apply gender (Borau et al. 2021; Nass, Moon, and Green 1997) and occupation (Tay, Jung, and Park 2014) stereotypes to automated agents, reciprocate acts by helpful computers (Fogg and Nass 1997), and rely on a host of social cues when interacting with arti fi cial agents (Nass…”
BackgroundGovernment by Algorithm: Artificial Intelligence in Federal Administrative Agencies
Engstrom, D. F., Ho, D. E., Sharkey, C. M., & Cuéllar, M.-F. (2020) · SSRN Electronic Journal · doi:10.2139/ssrn.3551505 · Cited by 262
Preference for Human (vs. Robotic) Labor is Stronger in Symbolic Consumption Contexts
Granulo, A., Fuchs, C., & Puntoni, S. (2021) · Journal of Consumer Psychology · doi:10.1002/jcpy.1181 · Cited by 255
Perception of variability in category development: Instance- versus abstraction-based stereotypes.
Park, B., & Hastie, R. (1987) · Journal of Personality and Social Psychology · doi:10.1037//0022-3514.53.4.621 · Cited by 248 · cited 1×
“…as a more varied, heterogenous group, in line with research on intergroup perception showing how third-party communication about the characteristic level of homogeneity of a group shapes people ’ s stored beliefs about the variability of a group (Ostrom and Sedikides 1992; Park and Hastie 1987).”
BackgroundDrivers are blamed more than their automated cars when both make mistakes
Awad, E., Levine, S., Kleiman-Weiner, M., Dsouza, S., Tenenbaum, J. B., Shariff, A., Bonnefon, J., & Rahwan, I. (2019) · Nature Human Behaviour · doi:10.1038/s41562-019-0762-8 · Cited by 212 · cited 2×
“…on an algo-rithm (benchmarked on changes in reliance on a person; cf. Berger et al. 2021; Dietvorst, Simmons, and Massey 2015; Prahl and Van Swol 2017) or on moral judgments ensuing from learning of algorithmic (vs. human) failures (Awad et al. 2020; Gill 2020; Srinivasan and Sarial-Abi 2021).”
BackgroundWhen Algorithms Fail: Consumers’ Responses to Brand Harm Crises Caused by Algorithm Errors
Srinivasan, R., & Sarial-Abi, G. (2021) · Journal of Marketing · doi:10.1177/0022242921997082 · Cited by 196 · cited 3×
“One dimension of consumer response has assessed reliance on an algorithmic versus a human advisor before and after learning of the advisor failure rate (Berger et al. 2021; Dietvorst, Simmons, and Massey 2015; Prahl and Van Swol 2017; Srinivasan and Sarial-Abi 2021).”
BackgroundWatch Me Improve—Algorithm Aversion and Demonstrating the Ability to Learn
Berger, B., Adam, M., Rühr, A., & Benlian, A. (2021) · Business & Information Systems Engineering · doi:10.1007/s12599-020-00678-5 · Cited by 183 · cited 6×
“One dimension of consumer response has assessed reliance on an algorithmic versus a human advisor before and after learning of the advisor failure rate (Berger et al. 2021; Dietvorst, Simmons, and Massey 2015; Prahl and Van Swol 2017; Srinivasan and Sarial-Abi 2021).”
BackgroundInfluentialHow users reciprocate to computers: an experiment that demonstrates behavior change
Fogg, B., & Nass, C. (1997) · CHI '97 extended abstracts on Human factors in computing systems looking to the future - CHI '97 · doi:10.1145/1120212.1120419 · Cited by 131 · cited 1×
“…et al. 2021; Nass, Moon, and Green 1997) and occupation (Tay, Jung, and Park 2014) stereotypes to automated agents, reciprocate acts by helpful computers (Fogg and Nass 1997), and rely on a host of social cues when interacting with arti fi cial agents (Nass and Moon 2000; Reeves and Nass 1996).”
BackgroundNews from Generative Artificial Intelligence Is Believed Less
Longoni, C., Fradkin, A., Cian, L., & Pennycook, G. (2022) · 2022 ACM Conference on Fairness Accountability and Transparency · doi:10.1145/3531146.3533077 · Cited by 120 · cited 2×
“…exhibit algorithm aversion (Cadario, Longoni, and Morewedge 2021; Dietvorst, Simmons, and Massey 2015; Longoni, Bonezzi, and Morewedge 2019, 2020; Longoni et al. 2022), appreciation (Castelo, Bos, and Lehmann 2019; Longoni and Cian 2020; Logg, Minson, and Moore 2019), or indifference (Berger…”
BackgroundSelf-citationBlame It on the Self-Driving Car: How Autonomous Vehicles Can Alter Consumer Morality
Gill, T. (2020) · Journal of Consumer Research · doi:10.1093/jcr/ucaa018 · Cited by 112 · cited 15×
“Another dimension has assessed moral judgments of a failing algorithmic or human agent (Awad et al. 2020; Gill 2020).”
BackgroundInfluentialSocial Categorization and the Representation of Variability Information
Park, B., Judd, C. M., & Ryan, C. S. (1991) · European Review of Social Psychology · doi:10.1080/14792779143000079 · Cited by 110 · cited 1×
“Out-group homogeneity has been documented across many naturally occurring groups, such as race, religion, nationality, and profession (Brewer 1993; Park, Judd, and Ryan 1991).”
BackgroundAffective stimulus value and cognitive complexity.
Irwin, M., Tripodi, T., & Bieri, J. (1967) · Journal of Personality and Social Psychology · doi:10.1037/h0024406 · Cited by 97 · cited 1×
“For instance, research on intergroup perceptions links out-group homogeneity to need for uniqueness (Quattrone and Jones 1980), need for predictability (Irwin, Tripodi, and Bieri 1967), and need to justify in-group favoritism and out-group hostility (Wilder 1986).”
Background(2020) · bepress Legal Repository · Cited by 92
Show me the product, show me the model: Effect of picture type on attitudes toward advertising
Aydınoğlu, N. Z., & Cian, L. (2014) · Journal of Consumer Psychology · doi:10.1016/j.jcps.2014.04.002 · Cited by 86 · cited 1×
“At the foundation of social identity theory is self-categorization, which describes how people categorize themselves and others into different social groups (Ayd ı nog ̆ lu and Cian 2014; Hogg and Reid 2006; Pandya, Cian, and Venkatesan 2022; Turner 1982).”
BackgroundSelf-citationVirtual Humans Elicit Skin-Tone Bias Consistent with Real-World Skin-Tone Biases
Rossen, B., Johnsen, K., Deladisma, A. M., Lind, S. D., & Lok, B. C. L. (2008) · Lecture notes in computer science · doi:10.1007/978-3-540-85483-8_24 · Cited by 77 · cited 1×
“Notably, both embodied and virtual arti fi cial agents seem to trigger application of social categories (Rossen et al. 2008), so much so that according to the computers-as-social-actors paradigm, people mindlessly apply social categories to computers even though they know that computers lack…”
BackgroundCian, L., Longoni, C., & Krishna, A. (2020) · Journal of Marketing Research · doi:10.1177/0022243720904758 · Cited by 65 · cited 1×
“We assessed propensity to apply for public services as a proxy for behavioral consequences for consumers (Cian, Longoni, and Krishna 2020), as the provision of these services is the statutory duty of public agencies, and governments are grappling with underutilization of these bene fi ts (Zipperer…”
MethodSelf-citationThreat of racial and economic inequality increases preference for algorithm decision-making
Bigman, Y. E., Yam, K. C., Marciano, D., Reynolds, S. J., & Gray, K. (2021) · Computers in Human Behavior · doi:10.1016/j.chb.2021.106859 · Cited by 62
Longoni, C., Bonezzi, A., & Morewedge, C. K. (2020) · Judgment and Decision Making · doi:10.1017/s1930297500007233 · Cited by 23 · cited 2×
“Ourresearch makes a second theoretical contribution to the broader literature on consumer responses to AI systems (Cadario, Longoni, and Morewedge 2021; Castelo, Bos, and Lehmann 2019; Gill 2020; Longoni, Bonezzi, and Morewedge 2019, 2020).”
BackgroundSelf-citationPerceptions of Group Variability: Moving from an Uncertain Crawl to a Purposeful Stride
Sedikides, C., & Ostrom, T. M. (1993) · Social Cognition · doi:10.1521/soco.1993.11.1.165 · Cited by 21 · cited 1×
“…similarity (Tajfel 1969), an effect called out-group homogeneity — the tendency to perceive out-groups as less variable and more homogeneous than members of one ’ s own group (in-groups) on several attributes (Linville and Fischer 1998; Ostrom and Sedikides 1992; Sedikides and Ostrom 1993).”
BackgroundWITHDRAWNPreprint
Pandya, S. S., Venkatesan, R., & Cian, L. (2022) · doi:10.31234/osf.io/8r23e · Cited by 1
Self-citation
Research works printed but not linked: 2
- 10.1037/0022-3514.53.4.621 · doi:10.1037/0022-3514.53.4.621 · Paper page
- 10.1037/0022-3514.38.1.141 · doi:10.1037/0022-3514.38.1.141 · Paper page
Cited by
Chatbots and mental health: Insights into the safety of generative AI
De Freitas, J., Uğuralp, A. K., Oğuz‐Uğuralp, Z., & Puntoni, S. (2024) · Journal of Consumer Psychology · doi:10.1002/jcpy.1393 · Cited by 211
Managing with Artificial Intelligence: An Integrative Framework
Hillebrand, L., Raisch, S., & Schad, J. (2025) · Academy of Management Annals · doi:10.5465/annals.2022.0072 · Cited by 256
The Moral Psychology of Artificial Intelligence
Bonnefon, J.-F., Rahwan, I., & Shariff, A. (2024) · Annual Review of Psychology · doi:10.1146/annurev-psych-030123-113559 · Cited by 151
“Second, people may consider that machines are more homogeneous than humans; that is, that a machine being biased is a sign that all machines are comparably biased (Longoni et al. 2022).”
BackgroundArtificial intelligence in interactive marketing: a conceptual framework and research agenda
Peltier, J. W., Dahl, A. J., & Schibrowsky, J. A. (2024) · Journal of Research in Interactive Marketing · doi:10.1108/jrim-01-2023-0030 · Cited by 145
Artificial intelligence and its implications for data privacy
Martin, K. D., & Zimmermann, J. (2024) · Current Opinion in Psychology · doi:10.1016/j.copsyc.2024.101829 · Cited by 120
Metadata
- Authors
- Longoni, C., Cian, L., & Kyung, E. J.
- Affiliations
- Boston University (US)
- University of Virginia (US)
- Babson College (US)
- Corresponding author
- Cian, Luca
- Venue
- Journal of Marketing Research
- Publisher
- SAGE Publications
- Published
- 2022-10-19
- Volume
- 60
- Issue
- 1
- Pages
- 170-188
- ISSN
- 0022-2437 (ISSN-L)
- 1547-7193
- OpenAlex
- W4282981817
- Cited by
- 121
- References
- 49
- Citations by year
- 2026: 43 · 2025: 45 · 2024: 24 · 2023: 9
- FWCI
- 22.64
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- journals.sagepub.com/page/policies/text-and-data-mining-license (tdm)
- Locations
- Journal of Marketing Research (publishedVersion)
- Archivio istituzionale della Ricerca - Bocconi (submittedVersion)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
- Social Sciences › Political Science and International Relations › E-Government and Public Services
- Social Sciences › Business, Management and Accounting › Marketing › AI in Service Interactions
- Keywords
- algorithmic aversion, social categorization, public trust in AI, public services
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.