The DOI matches its Crossref record; 42 of the 42 references it cites were found in a registry or an index.
Reliability of Nominal Data Based on Qualitative Judgments
Abstract
Most research related to the reliability and validity of marketing measures has focused on multi-item quantitative scales. In contrast, little attention has been given to the quality of nominal scale data developed from qualitative judgments. Judgment-based (“coded”) nominal scale data are important and frequently used in marketing research-for example, in analysis of consumer responses to open-ended survey questions, in cognitive response research, in meta-analysis, and in content analysis. The authors address opportunities and challenges involved in evaluating and improving the quality of judgment-based nominal scale data, with specific emphasis on the use of multiple judges. They review approaches commonly used in other disciplines, then develop a new index of reliability that is more appropriate for the type of interjudge data typically found in marketing studies. Data from a cognitive response experiment are used to illustrate the new index and compare it with other common measures. The authors conclude with suggestions on how to improve the design of studies that rely on judgment-coded data.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“When the described coding procedures were applied, the intercoder reliability according to Perreault and Leigh (1989) was .93, which exceeded the required threshold of .8.”
From A Meta-Analysis of Organizational Complaint Handling and Customer Responses (2011) · cites this paper as Perreault and Leigh (1989)
Citations
Cites
The Measurement of Observer Agreement for Categorical Data
Landis, J. R., & Koch, G. G. (1977) · Biometrics · doi:10.2307/2529310 · Cited by 81,148
A Coefficient of Agreement for Nominal Scales
Cohen, J. (1960) · Educational and Psychological Measurement · doi:10.1177/001316446002000104 · Cited by 42,398
A Paradigm for Developing Better Measures of Marketing Constructs
Churchill, G. A. (1979) · Journal of Marketing Research · doi:10.1177/002224377901600110 · Cited by 16,549
Weighted kappa: nominal scale agreement provision for scaled disagreement or partial credit
Cohen, J. (1968) · Psychological Bulletin · doi:10.1037/h0026256 · Cited by 8,736
Measuring nominal scale agreement among many raters.
Fleiss, J. L. (1971) · Psychological Bulletin · doi:10.1037/h0031619 · Cited by 8,733
Reliability of Content Analysis: The Case of Nominal Scale Coding
Scott, W. A. (1955) · Public Opinion Quarterly · doi:10.1086/266577 · Cited by 1,853
Coefficient Kappa: Some Uses, Misuses, and Alternatives
Brennan, R. L., & Prediger, D. J. (1981) · Educational and Psychological Measurement · doi:10.1177/001316448104100307 · Cited by 1,676
Reliability: A Review of Psychometric Basics and Recent Marketing Practices
Peter, J. P. (1979) · Journal of Marketing Research · doi:10.2307/3150868 · Cited by 1,577
Large sample standard errors of kappa and weighted kappa.
Fleiss, J. L., Cohen, J., & Everitt, B. S. (1969) · Psychological Bulletin · doi:10.1037/h0028106 · Cited by 1,536
Bettman, J. R., & Park, C. W. (1980) · Journal of Consumer Research · doi:10.1086/208812 · Cited by 1,344
Cited by
Sorted by citations
Items 401–500 of 1,002
What Makes a Slogan Memorable and Who Remembers It
Reece, B. B., Bergh, B. G. V., & Li, H. (1994) · Journal of Current Issues & Research in Advertising · doi:10.1080/10641734.1994.10505018 · Cited by 67
Nudity of female and male models in primetime TV advertising across seven countries
Nelson, M. R., & Paek, H. (2008) · International Journal of Advertising · doi:10.2501/s0265048708080281 · Cited by 67
Carlson, J. P., & Weathers, D. (2007) · Journal of Business Research · doi:10.1016/j.jbusres.2007.09.005 · Cited by 67
Online auction service failures in Taiwan: Typologies and recovery strategies
Kuo, Y., Yen, S.-T., & Chen, L.-H. (2009) · Electronic Commerce Research and Applications · doi:10.1016/j.elerap.2009.09.003 · Cited by 68
Griffith, D. A., Hoppner, J. J., Lee, H. S., & Schoenherr, T. (2016) · Journal of Marketing Research · doi:10.1509/jmr.13.0319 · Cited by 67
But That’s Not Fair! An Exploratory Study of Student Perceptions of Instructor Fairness
Houston, M. B., & Bettencourt, L. A. (1999) · Journal of Marketing Education · doi:10.1177/0273475399212002 · Cited by 67
Linking servicescape to customer satisfaction: exploring the role of competitive strategy
Miles, P. C., Miles, G., & Cannon, A. R. (2012) · International Journal of Operations & Production Management · doi:10.1108/01443571211250077 · Cited by 66
Conceptualising town centre image and the customer experience
Hart, C., Stachow, G. B., & Cadogan, J. W. (2013) · Journal of Marketing Management · doi:10.1080/0267257x.2013.800900 · Cited by 66
Forbes, L. P. (2008) · Journal of Services Marketing · doi:10.1108/08876040810881713 · Cited by 67
Beyond the fad: a critical review of consumer fashion involvement
Naderi, I. (2011) · International Journal of Consumer Studies · doi:10.1111/j.1470-6431.2011.01041.x · Cited by 65
Consumption dynamics during recession and recovery: A learning journey
Sarmento, M., Marques, S. R. B. D. V., & Galán‐Ladero, M. M. (2019) · Journal of Retailing and Consumer Services · doi:10.1016/j.jretconser.2019.04.021 · Cited by 65
Digitalizing customer journeys in B2B markets
Lundin, L., & Kindström, D. (2023) · Journal of Business Research · doi:10.1016/j.jbusres.2022.113639 · Cited by 64
On the choice of measures of reliability and validity in the content-analysis of texts
Олейник, А., Popova, I., Kirdina, S., & Shatalova, T. (2013) · Quality & Quantity · doi:10.1007/s11135-013-9919-0 · Cited by 64
Service orientation: the derivation of underlying constructs and measures
Oliveira, P., & Roth, A. V. (2012) · International Journal of Operations & Production Management · doi:10.1108/01443571211208614 · Cited by 69
Regulatory Exposure of Deceptive Marketing and Its Impact on Firm Value
Tipton, M. M., Bharadwaj, S. G., & Robertson, D. (2009) · Journal of Marketing · doi:10.1509/jmkg.73.6.227 · Cited by 64
Consumer Perceptions of Sustainability: A Free Elicitation Study
Simpson, B. J. K., & Radford, S. K. (2012) · Journal of Nonprofit & Public Sector Marketing · doi:10.1080/10495142.2012.733654 · Cited by 64
The values of college students in business simulation game: A means-end chain approach
Lin, Y.-L., & Tu, Y.-Z. (2011) · Computers & Education · doi:10.1016/j.compedu.2011.12.005 · Cited by 64
Pelletier, M. J., & Collier, J. E. (2018) · Journal of Service Research · doi:10.1177/1094670518770042 · Cited by 64
Stakeholder engagement via social media: an analysis of third-party logistics companies
Şakar, G. D., & Surucu-Balci, E. (2018) · Service Industries Journal · doi:10.1080/02642069.2018.1561874 · Cited by 67
The dynamics and evolution of the service marketing literature: 1993–2003
Furrer, O., & Sollberger, P. (2006) · Service Business · doi:10.1007/s11628-006-0006-7 · Cited by 64
Developing an Effective Project: Planning and Team Building Combined
Thomas, M., Jacques, P. H., Adams, J. R., & Kihneman-Wooten, J. (2008) · Project Management Journal · doi:10.1002/pmj.20079 · Cited by 64
What content to post? Evaluating the effectiveness of Facebook communications in destinations
Molina, A., Gómez, M., Lyon, A., García, E. A., & Loibl, W. (2020) · Journal of Destination Marketing & Management · doi:10.1016/j.jdmm.2020.100498 · Cited by 63
Modes of service innovation: a typology
Wang, Q., Voss, C., Zhao, X., & Wang, Z. (2015) · Industrial Management & Data Systems · doi:10.1108/imds-03-2015-0067 · Cited by 63
The Nature and Incidence of Private Label Rejection
Nenycz‐Thiel, M., & Romaniuk, J. (2011) · Australasian Marketing Journal (AMJ) · doi:10.1016/j.ausmj.2011.02.001 · Cited by 63
Bardhan, I. R., Krishnan, V., & Lin, S. (2007) · Manufacturing & Service Operations Management · doi:10.1287/msom.1070.0163 · Cited by 63
Long, C. P. (2018) · Accounting Organizations and Society · doi:10.1016/j.aos.2018.05.006 · Cited by 62
Kunkel, T., Lock, D., & Doyle, J. P. (2021) · Psychology and Marketing · doi:10.1002/mar.21467 · Cited by 67
Chen, K., Lin, J.-S., Choi, J. H., & Hahm, J. M. (2015) · Journal of Interactive Advertising · doi:10.1080/15252019.2015.1079508 · Cited by 72
Research approaches in logistics
Craighead, C. W., Hanna, J. B., Gibson, B., & Meredith, J. R. (2007) · The International Journal of Logistics Management · doi:10.1108/09574090710748153 · Cited by 62
Concrete and abstract goals associated with the consumption of environmentally sustainable products
Ramirez, E., Jiménez, F. R., & Gau, R. (2015) · European Journal of Marketing · doi:10.1108/ejm-08-2012-0483 · Cited by 67
Cheong, Y., Kim, K., & Zheng, L. (2010) · Asian Journal of Communication · doi:10.1080/01292980903440848 · Cited by 61
Confirmation and the Effects of Valenced Political Advertising: A Field Experiment
Phillips, J. M., Urbany, J. E., & Reynolds, T. J. (2008) · Journal of Consumer Research · doi:10.1086/523287 · Cited by 61
Bridoux, F., Smith, K. G., & Grimm, C. M. (2011) · Journal of Management · doi:10.1177/0149206311426188 · Cited by 61
Consumer Decision Making for Common, Repeat-Purchase Products
Leong, S. M. (1993) · Journal of Consumer Psychology · doi:10.1207/s15327663jcp0202_05 · Cited by 61
Critical service quality encounters on the Web: an exploratory study
Sweeney, J., & Lapp, W. (2004) · Journal of Services Marketing · doi:10.1108/08876040410542272 · Cited by 61
Television News, Prejudicial Pretrial Publicity, and the Depiction of Race
Dixon, T. L., & Linz, D. G. (2002) · Journal of Broadcasting & Electronic Media · doi:10.1207/s15506878jobem4601_7 · Cited by 61
A Mixed-Method Approach for Developing Market Segmentation Typologies in the Sports Industry
Rohm, A. J., Milne, G. R., & McDonald, M. A. (2006) · Sport Marketing Quarterly · doi:10.1177/106169340601500104 · Cited by 60
Designing cross‐cultural advertising research: a closer look at paired comparisons
Albers‐Miller, N. D. (1996) · International Marketing Review · doi:10.1108/02651339610131397 · Cited by 60
Tan, H. H., & See, H. H. (2004) · Asia Pacific Journal of Management · doi:10.1023/b:apjm.0000024083.66366.b1 · Cited by 60
Une méta-analyse du coefficient alpha de Cronbach
Peterson, R. A. (1995) · Recherche et Applications en Marketing (French Edition) · doi:10.1177/076737019501000204 · Cited by 60
NON-COMPENSATORY (AND COMPENSATORY) MODELS OF CONSIDERATION-SET DECISIONS
Hauser, J. R., Ding, M., & Gaskin, S. P. (2009) · Cited by 60
Delighting Baby Boomers and Millennials: Factors that Matter Most
Beauchamp, M. B., & Barnes, D. C. (2015) · The Journal of Marketing Theory and Practice · doi:10.1080/10696679.2015.1032472 · Cited by 67
Exploring the landscape of qualitative research in international marketing
Andriopoulos, C., & Slater, S. (2013) · International Marketing Review · doi:10.1108/imr-03-2012-0061 · Cited by 76
Do customer relationships mitigate or amplify failure responses?
Kaltcheva, V. D., Winsor, R. D., & Parasuraman, A. (2012) · Journal of Business Research · doi:10.1016/j.jbusres.2011.12.031 · Cited by 59
Bausch, A., & Pils, F. (2009) · Review of Managerial Science · doi:10.1007/s11846-009-0027-4 · Cited by 59
The unintended effects of interactive objects and labels in the science museum
Elliott, L. A., Velez, L., Goudy, D., & Dunbar, K. N. (2008) · Science Education · doi:10.1002/sce.20291 · Cited by 63
Choi, H., Yoo, K., Baek, T. H., Reid, L. N., & Macias, W. (2013) · International Journal of Advertising · doi:10.2501/ija-32-4-587-616 · Cited by 59
Guillet, B. D., Küçükusta, D., & Liu, L. (2015) · Journal of Travel & Tourism Marketing · doi:10.1080/10548408.2015.1064337 · Cited by 59
Impact of Media Context on Advertising Memory
Kwon, E. S., King, K. W., Nyilasy, G., & Reid, L. N. (2018) · Journal of Advertising Research · doi:10.2501/jar-2018-016 · Cited by 59
Searching the web for global brands: how American brands standardise their web sites in Europe
Okazaki, S. (2005) · European Journal of Marketing · doi:10.1108/03090560510572034 · Cited by 59
Nasır, S. (2005) · International Journal of Information Management · doi:10.1016/j.ijinfomgt.2005.06.003 · Cited by 59
Su, L., Yang, X., & Huang, Y. (2022) · Tourism Management · doi:10.1016/j.tourman.2021.104483 · Cited by 60
Supply chain agility and performance: evidence from a meta-analysis
Alfalla-Luque, R., Luján-García, D., & Marin-Garcia, J. A. (2023) · International Journal of Operations & Production Management · doi:10.1108/ijopm-05-2022-0316 · Cited by 63
D’Agostino, A., Sovacool, B. K., Trott, K., Ramos, C. R., Saleem, S., & Ong, Y. (2010) · Energy · doi:10.1016/j.energy.2010.10.013 · Cited by 58
Managing R&D Project Shifts in High‐Tech Organizations: A Multi‐Method Study
Chandrasekaran, A., Linderman, K., Sting, F. J., & Benner, M. J. (2015) · Production and Operations Management · doi:10.1111/poms.12410 · Cited by 59
Data analysis techniques in service quality literature: Essentials and advances
Mohammed, K., & Adil, M. (2013) · Serbian Journal of Management · doi:10.5937/sjm8-3469 · Cited by 58
Robertson, J., Botha, E., Oosthuizen, K., & Montecchi, M. (2025) · Journal of Business Research · doi:10.1016/j.jbusres.2025.115198 · Cited by 73
Service Quality in the Hotel Industry
Tse, E. C., & Ho, S. (2009) · Cornell Hospitality Quarterly · doi:10.1177/1938965509338453 · Cited by 57
Do Shareholders Value Green Information Technology Announcements?
Nishant, R., Teo, T. S. H., & Goh, M. (2017) · Journal of the Association for Information Systems · doi:10.17705/1jais.00466 · Cited by 57
Paek, H. (2005) · Asian Journal of Communication · doi:10.1080/01292980500118292 · Cited by 57
Imrich, D. J., Mullin, C. J., & Linz, D. G. (1995) · Journal of Communication · doi:10.1111/j.1460-2466.1995.tb00745.x · Cited by 57
Perceiving competitive reactions: The value of accuracy (and paranoia)
Clark, B. H., & Montgomery, D. B. (1996) · Marketing Letters · doi:10.1007/bf00434904 · Cited by 57
Internet Exchanges for Used Goods: An Empirical Analysis of Trade Patterns and Adverse SelectionPreprint
Ghose, A. (2008) · SSRN Electronic Journal · doi:10.2139/ssrn.1214725 · Cited by 57
Cousins, R., & Donnell, C. (2011) · Family Practice · doi:10.1093/fampra/cmr077 · Cited by 56
Regret from Postpurchase Discovery of Lower Market Prices: Do Price Refunds Help?
Dutta, S., Biswas, A., & Grewal, D. (2011) · Journal of Marketing · doi:10.1509/jm.10.0271 · Cited by 56
The role of employee emotional competence in service recovery encounters
Fernandes, T., Morgado, M., & Rodrigues, M. A. (2018) · Journal of Services Marketing · doi:10.1108/jsm-07-2017-0237 · Cited by 56
The Information Content of Mutual Fund Print Advertising
Jones, M. A., & Smythe, T. (2003) · Journal of Consumer Affairs · doi:10.1111/j.1745-6606.2003.tb00438.x · Cited by 56
Sprott, D. E., & Miyazaki, A. D. (2002) · Journal of Public Policy & Marketing · doi:10.1509/jppm.21.1.105.17606 · Cited by 56
An Empirical Investigation of Company Response to Data Breaches
Nikkhah, H. R., & Grover, V. (2022) · MIS Quarterly · doi:10.25300/misq/2022/16609 · Cited by 55
Kunkel, T., Doyle, J. P., & Funk, D. C. (2014) · Sport Management Review · doi:10.1016/j.smr.2014.01.004 · Cited by 55
VISUAL DIFFERENCES IN U.S. AND CHINESE TELEVISION COMMERCIALS
Zhou, S., Xue, F., Xue, F., & Zhou, P. (2005) · Journal of Advertising · doi:10.1080/00913367.2005.10639182 · Cited by 55
Frontline Service Employee Compliance With Customer Special Requests
Beatty, S. E., Ogilvie, J. L., Northington, W. M., Harrison, M. P., Holloway, B. B., & Wang, S. (2015) · Journal of Service Research · doi:10.1177/1094670515624978 · Cited by 55
The impact of other group members on tourists’ travel experiences
Yin, C., & Poon, P. (2016) · International Journal of Contemporary Hospitality Management · doi:10.1108/ijchm-07-2014-0340 · Cited by 55
Pérez, A., Gutiérrez, C. L., & Salmones, M. D. M. G. D. L. (2017) · Accounting Auditing & Accountability Journal · doi:10.1108/aaaj-11-2013-1526 · Cited by 55
Consumers’ health-related perceptions of bread – Implications for labeling and health communication
Sandvik, P., Nydahl, M. C., Kihlberg, I., & Marklinder, I. (2017) · Appetite · doi:10.1016/j.appet.2017.11.092 · Cited by 55
Exploring the pursuit of sustainability in reverse supply chains for electronics
Flygansvær, B., Dahlstrom, R. F., & Nygaard, A. (2018) · Journal of Cleaner Production · doi:10.1016/j.jclepro.2018.04.014 · Cited by 60
Beyond gender stereotypes: the missing women in print advertising
Shinoda, L. M., Veludo‐de‐Oliveira, T. M., & Pereira, I. (2020) · International Journal of Advertising · doi:10.1080/02650487.2020.1820206 · Cited by 54
Blome, C., Paulraj, A., Preuss, L., & Roehrich, J. K. (2022) · Industrial Marketing Management · doi:10.1016/j.indmarman.2022.11.006 · Cited by 54
Edmondson, D. R., & Boyer, S. L. (2012) · Journal of Business Research · doi:10.1016/j.jbusres.2012.01.010 · Cited by 54
Pérez, A., Salmones, M. D. M. G. D. L., & Gutiérrez, C. L. (2014) · Journal of Business Ethics · doi:10.1007/s10551-014-2199-3 · Cited by 54
The games people play: How the entertainment value of online ads helps or harms persuasion
Jung, J. M., Min, K. S., & Kellaris, J. J. (2011) · Psychology and Marketing · doi:10.1002/mar.20406 · Cited by 54
Barriers to offering special interest tour products to the Chinese outbound group market
Jin, X., & Sparks, B. (2016) · Tourism Management · doi:10.1016/j.tourman.2016.08.007 · Cited by 54
Meyers, R. A., Seibold, D. R., & Brashers, D. E. (1991) · Western Journal of Speech Communication · doi:10.1080/10570319109374370 · Cited by 54
Gelbrich, K. (2009) · Schmalenbach Business Review · doi:10.1007/bf03396779 · Cited by 53
Procrastinators’ online experience and purchase behavior
Zanjani, S. H. A., Milne, G. R., & Miller, E. G. (2015) · Journal of the Academy of Marketing Science · doi:10.1007/s11747-015-0458-1 · Cited by 55
Advertising effects of songs' nostalgia and lyrics' relevance
Chou, H., & Lien, N. (2010) · Asia Pacific Journal of Marketing and Logistics · doi:10.1108/13555851011062278 · Cited by 53
How professional service firms compete in the market: an exploratory study
Amonini, C., McColl‐Kennedy, J. R., Soutar, G. N., & Sweeney, J. (2010) · Journal of Marketing Management · doi:10.1080/02672570903534662 · Cited by 53
Jozkowski, K. N. (2015) · Violence Against Women · doi:10.1177/1077801215584069 · Cited by 53
Debiasing the supplier selection decision: a taxonomy and conceptualization
Kaufmann, L., Carter, C. R., & Buhrmann, C. (2010) · International Journal of Physical Distribution & Logistics Management · doi:10.1108/09600031011093214 · Cited by 53
Andrews, J. C., Akhter, S. H., Durvasula, S., & Muehling, D. D. (1992) · Journal of Current Issues & Research in Advertising · doi:10.1080/10641734.1992.10504979 · Cited by 53
Bettencourt, L. A., & Houston, M. B. (2001) · Marketing Letters · doi:10.1023/a:1012272305777 · Cited by 53
Empowerment of human brands: Brand meaning co-creation on digital engagement platforms
Anderski, M., Griebel, L., Stegmann, P., & Ströbel, T. (2023) · Journal of Business Research · doi:10.1016/j.jbusres.2023.113905 · Cited by 52
The Development, Change, and Transformation of Rhetorical Style in Magazine Advertisements 1954-1999
Phillips, B. J., & McQuarrie, E. F. (2005) · Advertising & Society Review · doi:10.1353/asr.2006.0010 · Cited by 52
Reichert, T., Childers, C. C., & Reid, L. N. (2012) · Journal of Current Issues & Research in Advertising · doi:10.1080/10641734.2012.675566 · Cited by 52
Salesperson knowledge distinctions and sales performance
Leigh, T. W., DeCarlo, T. E., Allbright, D., & Lollar, J. G. (2014) · Journal of Personal Selling and Sales Management · doi:10.1080/08853134.2014.890902 · Cited by 52
Tourism brochures: Linking message strategies, tactics and brand destination attributes
Brito, P. Q., & Pratas, J. M. (2014) · Tourism Management · doi:10.1016/j.tourman.2014.10.013 · Cited by 52
Retailing In Social Virtual Worlds: Developing A Typology Of Virtual Store Atmospherics
Hassouneh, D., & Brengman, M. (2015) · VUBIR (Vrije Universiteit Brussel) · Cited by 52
Means vs ends: theorizing a definition of human resource development
Wang, G. G., Werner, J. M., Sun, J. Y., Gilley, A., & Gilley, J. W. (2017) · Personnel Review · doi:10.1108/pr-11-2015-0306 · Cited by 52
Saad, S., Alaloul, W. S., Ammad, S., Altaf, M., & Qureshi, A. H. (2021) · Ain Shams Engineering Journal · doi:10.1016/j.asej.2021.06.031 · Cited by 52
Where's Tamika Catchings? A Content Analysis of Female Athlete Endorsers in Magazine Advertisements
Grau, S. L., Roselli, G. R., & Taylor, C. R. (2007) · Journal of Current Issues & Research in Advertising · doi:10.1080/10641734.2007.10505208 · Cited by 52
Metadata
- Authors
- Perreault, W. D., & Leigh, L. E.
- Affiliations
- University of North Carolina at Chapel Hill (US)
- Birmingham–Southern College (US)
- Venue
- Journal of Marketing Research
- Publisher
- JSTOR
- Published
- 1989-05
- Volume
- 26
- Issue
- 2
- Pages
- 135
- ISSN
- 0022-2437 (ISSN-L)
- OpenAlex
- W2069585723
- Cited by
- 1,575
- References
- 42
- Citations by year
- 2026: 19 · 2025: 35 · 2024: 43 · 2023: 44 · 2022: 56 · 2021: 59 · 2020: 60 · 2019: 58 · 2018: 52 · 2017: 39 · 2016: 48 · 2015: 89 · 2014: 77 · 2013: 88 · 2012: 86
- FWCI
- 12.22
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Journal of Marketing Research (publishedVersion)
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Reliability and Agreement in Measurement
- Social Sciences › Decision Sciences › Management Science and Operations Research › Psychometric Methodologies and Testing
- Social Sciences › Sociology and Political Science › Survey Methodology and Nonresponse
- Keywords
- reliability statistics, nominal data, qualitative judgment, marketing activities, measurement validity
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review