The DOI matches its Crossref record; 80 of the 81 references it cites were found in a registry or an index.
How WEIRD is CHI?
Open accessPublished version of a preprint
Abstract
Computer technology is often designed in technology hubs in Western countries, invariably making it “WEIRD”, because it is based on the intuition, knowledge, and values of people who are Western, Educated, Industrialized, Rich, and Democratic. Developing technology that is universally useful and engaging requires knowledge about members of WEIRD and non-WEIRD societies alike. In other words, it requires us, the CHI community, to generate this knowledge by studying representative participant samples. To find out to what extent CHI participant samples are from Western societies, we analyzed papers published in the CHI proceedings between 2016-2020. Our findings show that 73% of CHI study findings are based on Western participant samples, representing less than 12% of the world’s population. Furthermore, we show that most participant samples at CHI tend to come from industrialized, rich, and democratic countries with generally highly educated populations. Encouragingly, recent years have seen a slight increase in non-Western samples and those that include several countries. We discuss suggestions for further broadening the international representation of CHI participant samples.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Computer technologies are often shaped by the perspectives of people who are educated, financially secure, and accustomed to stable living conditions [79].”
From Understanding Teen Overreliance on AI Companion Chatbots Through Self-Reported Reddit Narratives (2026) · cites this paper as [79]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The Measurement of Observer Agreement for Categorical Data
Landis, J. R., & Koch, G. G. (1977) · Biometrics · doi:10.2307/2529310 · Cited by 81,148
The weirdest people in the world?
Henrich, J., Heine, S. J., & Norenzayan, A. (2010) · Behavioral and Brain Sciences · doi:10.1017/s0140525x0999152x · Cited by 12,641
Instructional manipulation checks: Detecting satisficing to increase statistical power
Oppenheimer, D. M., Meyvis, T., & Davidenko, N. (2009) · Journal of Experimental Social Psychology · doi:10.1016/j.jesp.2009.03.009 · Cited by 3,493
Beyond the Turk: Alternative platforms for crowdsourcing behavioral research
Peer, E., Brandimarte, L., Samat, S., & Acquisti, A. (2017) · Journal of Experimental Social Psychology · doi:10.1016/j.jesp.2017.01.006 · Cited by 2,957
The neglected 95%: Why American psychology needs to become less American.
Arnett, J. J. (2008) · American Psychologist · doi:10.1037/0003-066x.63.7.602 · Cited by 2,178
The International Telecommunication Union
Jones, R. W. (2002) · Digest - IEEE Antennas and Propagation Society. International Symposium · doi:10.1109/aps.1997.631791 · Cited by 1,903
Casler, K., Bickel, L., & Hackett, E. (2013) · Computers in Human Behavior · doi:10.1016/j.chb.2013.05.009 · Cited by 1,662 · cited 2×
“…existing efforts that have investigated how online research can preserve data quality and allow a wider variety of experiment methodologies (e.g., [8, 66–68, 71], including qualitative While this may sound straightforward, it is not going to be a solution to solely support Westerners in doing…”
BackgroundInternational Standard Classification of Education (ISCED) 2011
(2012) · doi:10.15220/978-92-9189-123-8-en · Cited by 1,130
Racial Inequality in Psychological Research: Trends of the Past and Recommendations for the Future
Roberts, S. O., Bareket-Shavit, C., Dollins, F. A., Goldie, P. D., & Mortenson, E. (2020) · Perspectives on Psychological Science · doi:10.1177/1745691620927709 · Cited by 1,049
The persistent sampling bias in developmental psychology: A call to action
Nielsen, M., Haun, D. B. M., Kärtner, J., & Legare, C. H. (2017) · Journal of Experimental Child Psychology · doi:10.1016/j.jecp.2017.04.017 · Cited by 1,023
The rules of the game called psychological science
Bakker, M., van Dijk, A., & Wicherts, J. M. (2012) · Perspectives on Psychological Science · doi:10.1177/1745691612459060 · Cited by 800
Postcolonial computing: a lens on design and development
Irani, L., Vertesi, J., Dourish, P., Philip, K., & Grinter, R. E. (2010) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/1753326.1753522 · Cited by 780
Science, ethnicity, and bias: Where have we gone wrong?
Sue, S. (1999) · American Psychologist · doi:10.1037/0003-066x.54.12.1070 · Cited by 552
Colour appeal in website design within and across cultures: A multi-method evaluation
Cyr, D., Head, M., & Larios, H. (2010) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2009.08.005 · Cited by 511
Intersectional HCI: Engaging Identity through Gender, Race, and Class
Schlesinger, A., Edwards, W. K., & Grinter, R. E. (2017) · Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3025453.3025766 · Cited by 449
United Nations Development Programme (2019) · Human development report · doi:10.18356/838f78fd-en · Cited by 379
Rank Correlation Methods (5th ed.).
Marden, J. I., Kendall, M. G., & Gibbons, J. D. (1992) · Journal of the American Statistical Association · doi:10.2307/2290477 · Cited by 344
Demographic differences in how students navigate through MOOCs
Guo, P. J., & Reinecke, K. (2014) · ACM Conference on Learning @ Scale (L@S) · doi:10.1145/2556325.2566247 · Cited by 319
Self-citationDell, N. L., Vaidyanathan, V., Medhi, I., Cutrell, E. B., & Thies, W. (2012) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/2207676.2208589 · Cited by 286
Observations on Typing from 136 Million Keystrokes
Dhakal, V., Feit, A. M., Kristensson, P. O., & Oulasvirta, A. (2018) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3173574.3174220 · Cited by 267
The Ins and Outs of HCI for Development
Dell, N. L., & Kumar, N. (2016) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/2858036.2858081 · Cited by 256
CHI '19: Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems
Brewster, S. A., Fitzpatrick, G., Cox, A. J., & Kostakos, V. (2019) · Cited by 238
Triandis, H. C., & Brislin, R. W. (1984) · American Psychologist · doi:10.1037/0003-066x.39.9.1006 · Cited by 182
Applying the technology acceptance model in a three-countries study of smartwatch adoption
Dutot, V., Bhatiasevi, V., & Bellallahom, N. (2019) · The Journal of High Technology Management Research · doi:10.1016/j.hitech.2019.02.001 · Cited by 181
Sample size in psychological research over the past 30 years
Marszalek, J. M., Barber, C., Kohlhart, J., & Cooper, B. H. (2011) · Perceptual and Motor Skills · doi:10.2466/03.11.pms.112.2.331-348 · Cited by 167
Generic language in scientific communication
DeJesus, J. M., Callanan, M. A., Solis, G., & Gelman, S. A. (2019) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1817706116 · Cited by 157
Quantifying visual preferences around the world
Reinecke, K., & Gajos, K. Z. (2014) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/2556288.2557052 · Cited by 149
Self-citationHarrington, C. N., Borgos-Rodriguez, K., & Piper, A. M. (2019) · Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3290605.3300823 · Cited by 148
Contributorship, Not Authorship: Use CRediT to Indicate Who Did What
Holcombe, A. O. (2019) · Publications · doi:10.3390/publications7030048 · Cited by 134
Leavitt, A., Keegan, B., & Clark, J. (2016) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/2858036.2858132 · Cited by 122
Scientometric analysis of the CHI proceedings
Bartneck, C., & Hu, J. (2009) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/1518701.1518810 · Cited by 120
Reinecke, K., & Gajos, K. Z. (2015) · ACM Conference on Computer Supported Cooperative Work (CSCW) · doi:10.1145/2675133.2675246 · Cited by 120
Self-citationSelf-Confidence Trumps Knowledge
Sawaya, Y., Sharif, M., Christin, N., Kubota, A., Nakarai, A., & Yamada, A. (2017) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3025453.3025926 · Cited by 91
Low-Wage Precarious Workers' Sociotechnical Practices Working Towards Addressing Wage Theft
Dombrowski, L. S., Garcia, A. A., & Despard, J. L. (2017) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3025453.3025633 · Cited by 89
Do We Care About Diversity in Human Computer Interaction
Himmelsbach, J., Schwarz, S., Gerdenitsch, C., Wais-Zechmann, B., Bobeth, J., & Tscheligi, M. (2019) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3290605.3300720 · Cited by 88
Reinecke, K., Nguyen, M. K., Bernstein, A., Näf, M., & Gajos, K. Z. (2013) · ACM Conference on Computer Supported Cooperative Work (CSCW) · doi:10.1145/2441776.2441784 · Cited by 85
Self-citationWilson, M. L., Resnick, P., Coyle, D., & Ed, H. (2013) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/2468356.2479636 · Cited by 84
Ram, R. (2015) · Social Indicators Research · doi:10.1007/s11205-015-1009-3 · Cited by 82
The Power of a Single Number: a Political History of GDP
O’Hagan, J. W. (2017) · DBS Business Review · doi:10.22375/dbsbr.v1.14 · Cited by 81
The evolution of IJHCS and CHI: A quantitative analysis
Mannocci, A., Osborne, F., & Motta, E. (2019) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2019.05.009 · Cited by 69
Understanding Perceptions of Problematic Facebook Use
Cheng, J., Burke, M., & Davis, E. (2019) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3290605.3300429 · Cited by 68
Sturm, C., Oh, A. H., Linxen, S., Abdelnour-Nocera, J., Dray, S. M., & Reinecke, K. (2015) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/2702613.2702656 · Cited by 67
Self-citationVines, J., Dunphy, P., & Monk, A. F. (2014) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/2556288.2556961 · Cited by 65
Non-western contexts: The invisible half
Jafari, A., Fırat, F. A., Suerdem, A. K., Askegaard, S., & Dalli, D. (2012) · Marketing Theory · doi:10.1177/1470593111424183 · Cited by 63
Social Reflections on Fitness Tracking Data
Saksono, H., Castaneda‐Sceppa, C., Hoffman, J. A., El‐Nasr, M. S., Morris, V., & Parker, A. G. (2019) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3290605.3300543 · Cited by 59
Social Comparison and Facebook
Burke, M., Cheng, J., & de Gant, B. (2020) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3313831.3376482 · Cited by 57
RepliCHI - CHI should be replicating and validating results more
Wilson, M. L., Mackay, W. E., Ed, H., Bernstein, M. S., Russell, D., & Thimbleby, H. W. (2011) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/1979742.1979491 · Cited by 56
Redmiles, E. M., Kross, S., & Mazurek, M. L. (2017) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3025453.3025673 · Cited by 56
Vaish, R., Gaikwad, S. S., Kovacs, G., Veit, A., Krishna, R., Arrieta-Ibarra, I., Simoiu, C., Wilber, M. J., Belongie, S., Goel, S., et al. (2017) · ACM Symposium on User Interface Software and Technology (UIST) · doi:10.1145/3126594.3126648 · Cited by 48
Dillahunt, T. R., & Lu, A. J. (2019) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3290605.3300808 · Cited by 48
Examining the "Global" Language of Emojis
Kimura-Thollander, P., & Kumar, N. (2019) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3290605.3300725 · Cited by 45
Wilson, M. L., Ed, H., Reeves, S., & Coyle, D. (2014) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/2559206.2559233 · Cited by 43
GNI per capita, PPP (current international $)
Mugisha, E. (2017) · Cited by 42
Gaikwad, S., Morina, D., Nistala, R., Agarwal, M., Cossette, A., Bhanu, R., Savage, S., Narwal, V., Rajpal, K., Regino, J., et al. (2015) · ACM Symposium on User Interface Software and Technology (UIST) · doi:10.1145/2815585.2815739 · Cited by 40
Dillahunt, T. R., & Hsiao, J. C.-Y. (2020) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3313831.3376717 · Cited by 37
Alshehri, T., Kirkham, R., & Olivier, P. L. (2020) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3313831.3376608 · Cited by 31
Wilson, M. L., Mackay, W. E., Ed, H., Bernstein, M. S., & Nichols, J. W. (2012) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/2212776.2212419 · Cited by 27
The Power of a Single Number: A Political History of GDP
Lepenies, P. (2016) · doi:10.7312/lepe17510 · Cited by 27
Cheng, J., Burke, M., & Davis, E. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1905.01911 · Cited by 27
Chaudhry, B. M., Faust, L. J., & Chawla, N. V. (2019) · International Conference on Human-Computer Interaction with Mobile Devices and Services (MobileHCI) · doi:10.1145/3338286.3340118 · Cited by 26
Participation Differences in Q&A Sites Across Countries
Oliveira, N., Andrade, N., & Reinecke, K. (2016) · Nordic Conference on Human-Computer Interaction · doi:10.1145/2971485.2971520 · Cited by 23
Self-citationCitizen Science Opportunities in Volunteer-Based Online Experiments
Oliveira, N., Jun, E., & Reinecke, K. (2017) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3025453.3025473 · Cited by 23
Self-citationBentley, F. R., O'Neill, K., Quehl, K., & Lottridge, D. M. (2020) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3313831.3376671 · Cited by 22
Kumar, N., Dray, S. M., Dearden, A., Dell, N. L., Densmore, M., Grinter, R. E., Liu, Z., Rocha, M. A. M., Peters, A. N., Sari, E. R., et al. (2016) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/2851581.2856507 · Cited by 21
HCI Across Borders and Sustainable Development Goals
Kumar, N., Cannanure, V. K., Gamage, D., Prabhakar, A. S., Sturm, C., Rivera-Loaiza, C., Sabie, D., Bhuiyan, M. M., & Rocha, M. A. M. (2020) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/3334480.3375067 · Cited by 21
Self-citationCultural Cognition in the Thinking-Aloud Method for Usability Evaluation
Clemmensen, T., Hertzum, M., Hornbæk, K., Shi, Q., & Yammiyavar, P. G. (2008) · Journal of the Association for Information Systems · Cited by 20
Kumar, N., Dray, S. M., Sturm, C., Sambasivan, N., Gaytan-Lugo, L. S., Díaz, L. V. M., Dahya, N., & Ahmed, N. (2017) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/3027063.3108901 · Cited by 20
Self-citationFagerlin, A., Zikmund‐Fisher, B. J., Ubel, P. A., Jankovic, A., Derry, H. A., & Smith, D. (2007) · PsycTESTS Dataset · doi:10.1037/t69659-000 · Cited by 19
Kumar, N., Heimerl, K., Nemer, D., Karusala, N., Vashistha, A., Dray, S. M., Sturm, C., Gaytan-Lugo, L. S., Peters, A. N., Ahmed, N., et al. (2018) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/3170427.3170666 · Cited by 18
Self-citationVertesi, J., Lindtner, S., & Shklovski, I. (2011) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/1979742.1979584 · Cited by 15
Huber, B., Reinecke, K., & Gajos, K. Z. (2017) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3025453.3025553 · Cited by 14
Self-citationHCI Across Borders and Intersections
Kumar, N., Sturm, C., Ahmed, S. I., Karusala, N., Wong-Villacrés, M., Morales, L., Orji, R., Dye, M., Ahmed, N., Gaytan-Lugo, L. S., et al. (2019) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/3290607.3299004 · Cited by 13
Self-citationAsian researchers at the CHI conference
Sakamoto, D. (2015) · interactions · doi:10.1145/2692310 · Cited by 10
Understanding Career Choice of African American Men Majoring in Information Technology
Fuller, K., Kvasny, L., Trauth, E. M., & Joshi, K. (2015) · ACM SIGCPR Conference on Computer Personnel Research (SIGCPR) · doi:10.1145/2751957.2751961 · Cited by 10
Observations from Teaching HCI to Chinese Students in Australia
Taylor, J. L., Tsimeris, J., Zhu, X., Stevenson, D., & Gedeon, T. (2015) · doi:10.1145/2776888.2780366 · Cited by 9
Strohmayer, A., MacArthur, C., Spors, V., Muller, M. J., Vigil-Hayes, M., & Alabdulqader, E. A. (2019) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/3290607.3299012 · Cited by 9
Conducting Massively Open Online Social Experiments with Volunteer Science
Keegan, B., Ognyanova, K., Welles, B. F., Riedl, C., Karbeyaz, C., Meleis, W. M., Lazer, D. M. J., Radford, J. P., & Hoye, J. (2014) · Proceedings of the AAAI Conference on Human Computation and Crowdsourcing · doi:10.1609/hcomp.v2i1.13208 · Cited by 3
The new SIGCHI EC's values and strategic initiatives
Mentis, H. M., Lampe, C. A. C., Bernhaupt, R., Joshi, A. N., Fussell, S. R., Dray, S. M., Olsen, D. R., Quigley, A. J., Williamson, J., Sari, E. R., et al. (2018) · interactions · doi:10.1145/3292013 · Cited by 2
CoRE Lab - An Effort to Engage College Hispanic Students in STEM
Lozano-Rolon, W. E. (2020) · ACM SIGKDD International Conference on Knowledge Discovery & Data Mining (KDD) · doi:10.1145/3394486.3411065 · Cited by 2
Research works printed but not linked: 11
- ACM. 2020. Conferences CHI - CHI: Conference on Human Factors in Computing Systems. https://dl.acm.org/conference/chi
- CHI. 2016. CHI ’16: Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems. ACM, New York, NY, USA. https://dl.acm.org/citation.cfm?id=2858036
- CHI. 2017. CHI ’17: Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems. ACM, New York, NY, USA. https://dl.acm.org/citation.cfm?id=3025453
- CHI. 2018. CHI ’18: Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. ACM, New York, NY, USA. https://dl.acm.org/citation.cfm?id=3173574
- CHI. 2019. CHI History Page. https://sigchi.org/conferences/conference-history/chi/
- CHI. 2020. CHI ’20: Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems. ACM, New York, NY, USA.
- CHIuXiD. 2020. CHIuXiD 2020 | 6th International HCI and UX Conference. https://chiuxid.org/
- CSCW. 2021. CSCW 2021. https://cscw.acm.org/2021/
- Samuel P. Huntington. 2011. The clash of civilizations and the remaking of world order (simon & schuster hardcover ed ed.). Simon & Schuster, New York.
- Asian CHI Symposium. 2020. Asian CHI Symposium 2020. https://asian-chi.github.io/2020/
- TOCHI. 2020. TOCHI ACM Transactions on Computer-Human Interaction. http://tochi.acm.org/
Cited by
Sorted by citations
Trust in Generative AI among students: An Exploratory Study
Amoozadeh, M., Daniels, D., Nam, D., Kumar, A., Chen, S., Hilton, M., Ragavan, S. S., & Alipour, M. A. (2023) · arXiv · doi:10.48550/arxiv.2310.04631 · Cited by 143
Flourishing in the Everyday: Moving Beyond Damage-Centered Design in HCI for BIPOC Communities
To, A., Smith, A. D. R., Showkat, D., Adjagbodjou, A. D., & Harrington, C. (2023) · Designing Interactive Systems Conference · doi:10.1145/3563657.3596057 · Cited by 121
Using Thematic Analysis in Healthcare HCI at CHI: A Scoping Review
Bowman, R., Nadal, C., Morrissey, K., Thieme, A., & Doherty, G. (2023) · Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3581203 · Cited by 107
Post-growth Human–Computer Interaction
Sharma, V., Kumar, N., & Nardi, B. A. (2023) · ACM Transactions on Computer-Human Interaction · doi:10.1145/3624981 · Cited by 119
Engaging with Nature through Technology: A Scoping Review of HCI Research
Webber, S. E., Kelly, R., Wadley, G., & Smith, W. (2023) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3581534 · Cited by 112
Metadata
- Authors
- Linxen, S., Sturm, C., Brühlmann, F., Cassau, V., Opwis, K., & Reinecke, K.
- Affiliations
- University of Basel (CH)
- Hamm-Lippstadt University of Applied Sciences (DE)
- University of Washington (US)
- Venue
- Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems
- Publisher
- ACM
- Published
- 2021-05-06
- Pages
- 1-14
- OpenAlex
- W1119960297
- Cited by
- 254
- References
- 81
- Citations by year
- 2026: 36 · 2025: 70 · 2024: 57 · 2023: 46 · 2022: 36 · 2021: 9
- FWCI
- 27.66
- Type
- conference paper
- Language
- en
- Open access
- bronze
- doi.org
- Locations
- CHI Conference on Human Factors in Computing Systems (publishedVersion)
- Funders
- National Science Foundation (1651487)
- Topics
- Physical Sciences › Computer Science › Human-Computer Interaction › Usability and User Interface Design
- Physical Sciences › Computer Science › Human-Computer Interaction › Innovative Human-Technology Interaction
- Social Sciences › Gender Studies › Gender and Technology in Education
- Keywords
- WEIRD populations, cross-cultural research, sample diversity
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
