The DOI matches its Crossref record; 42 of the 42 references it cites were found in a registry or an index.
Reliability of Nominal Data Based on Qualitative Judgments
Abstract
Most research related to the reliability and validity of marketing measures has focused on multi-item quantitative scales. In contrast, little attention has been given to the quality of nominal scale data developed from qualitative judgments. Judgment-based (“coded”) nominal scale data are important and frequently used in marketing research-for example, in analysis of consumer responses to open-ended survey questions, in cognitive response research, in meta-analysis, and in content analysis. The authors address opportunities and challenges involved in evaluating and improving the quality of judgment-based nominal scale data, with specific emphasis on the use of multiple judges. They review approaches commonly used in other disciplines, then develop a new index of reliability that is more appropriate for the type of interjudge data typically found in marketing studies. Data from a cognitive response experiment are used to illustrate the new index and compare it with other common measures. The authors conclude with suggestions on how to improve the design of studies that rely on judgment-coded data.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“When the described coding procedures were applied, the intercoder reliability according to Perreault and Leigh (1989) was .93, which exceeded the required threshold of .8.”
From A Meta-Analysis of Organizational Complaint Handling and Customer Responses (2011) · cites this paper as Perreault and Leigh (1989)
Citations
Cites
The Measurement of Observer Agreement for Categorical Data
Landis, J. R., & Koch, G. G. (1977) · Biometrics · doi:10.2307/2529310 · Cited by 81,148
A Coefficient of Agreement for Nominal Scales
Cohen, J. (1960) · Educational and Psychological Measurement · doi:10.1177/001316446002000104 · Cited by 42,398
A Paradigm for Developing Better Measures of Marketing Constructs
Churchill, G. A. (1979) · Journal of Marketing Research · doi:10.1177/002224377901600110 · Cited by 16,549
Weighted kappa: nominal scale agreement provision for scaled disagreement or partial credit
Cohen, J. (1968) · Psychological Bulletin · doi:10.1037/h0026256 · Cited by 8,736
Measuring nominal scale agreement among many raters.
Fleiss, J. L. (1971) · Psychological Bulletin · doi:10.1037/h0031619 · Cited by 8,733
Reliability of Content Analysis: The Case of Nominal Scale Coding
Scott, W. A. (1955) · Public Opinion Quarterly · doi:10.1086/266577 · Cited by 1,853
Coefficient Kappa: Some Uses, Misuses, and Alternatives
Brennan, R. L., & Prediger, D. J. (1981) · Educational and Psychological Measurement · doi:10.1177/001316448104100307 · Cited by 1,676
Reliability: A Review of Psychometric Basics and Recent Marketing Practices
Peter, J. P. (1979) · Journal of Marketing Research · doi:10.2307/3150868 · Cited by 1,577
Large sample standard errors of kappa and weighted kappa.
Fleiss, J. L., Cohen, J., & Everitt, B. S. (1969) · Psychological Bulletin · doi:10.1037/h0028106 · Cited by 1,536
Bettman, J. R., & Park, C. W. (1980) · Journal of Consumer Research · doi:10.1086/208812 · Cited by 1,344
Cited by
Sorted by citations
Items 301–400 of 1,002
CONTENT ANALYSIS OF PERSONAL CONSTRUCTS
Feixas, G., Geldschläger, H., & Neimeyer, R. A. (2002) · Journal of Constructivist Psychology · doi:10.1080/107205302753305692 · Cited by 97
Brand Appearances on Prime-Time Television
Ferraro, R., & Avery, R. J. (2000) · Journal of Current Issues & Research in Advertising · doi:10.1080/10641734.2000.10505104 · Cited by 97
A Question of Legitimacy? A Dynamic Perspective on Multinational Firm Control
Brenner, B. L., & Ambos, B. (2012) · Organization Science · doi:10.1287/orsc.1120.0760 · Cited by 100
Investigating the Key Routes to Customer Delight
Barnes, D. C., Ponder, N., & Dugar, K. K. (2011) · The Journal of Marketing Theory and Practice · doi:10.2753/mtp1069-6679190401 · Cited by 98
An agenda for service research at the base of the pyramid
Gebauer, H., & Reynoso, J. (2013) · Journal of service management · doi:10.1108/josm-04-2013-0090 · Cited by 95
Perceived justice and consumption experience evaluations
Aurier, P., & Siadou‐Martin, B. (2007) · International Journal of Service Industry Management · doi:10.1108/09564230710826241 · Cited by 99
State ownership and market orientation in China's public firms: An agency theory perspective
Song, J., Wang, R., & Cavusgil, S. T. (2015) · International Business Review · doi:10.1016/j.ibusrev.2014.12.003 · Cited by 101
Mack, R. W., Mueller, R. D., Crotts, J. C., & Broderick, A. J. (2000) · Managing Service Quality · doi:10.1108/09604520010352256 · Cited by 99
Gatignon, H. (2010) · Statistical Analysis of Management Data · doi:10.1007/978-1-4419-1270-1_4 · Cited by 93
Jap, S. D., Robertson, D. C., Rindfleisch, A., & Hamilton, R. (2012) · Journal of Marketing Research · doi:10.1509/jmr.10.0121 · Cited by 95
Arias-Bolzmann, L. G., Chakraborty, G., & Mowen, J. C. (2000) · Journal of Advertising · doi:10.1080/00913367.2000.10673602 · Cited by 93
International ethnic entrepreneurship: Antecedents, outcomes and environmental context
Nas, T. İ., Şahin, K. T., & ÜK, Z. Ç. (2011) · International Business Review · doi:10.1016/j.ibusrev.2011.02.011 · Cited by 93
The impact of strategic dissent on organizational outcomes: A meta‐analytic integration
Samba, C., van Knippenberg, D., & Miller, C. C. (2017) · Strategic Management Journal · doi:10.1002/smj.2710 · Cited by 98
Roth, M. S. (1996) · Journal of Public Policy & Marketing · doi:10.1177/074391569601500106 · Cited by 93
Customer solutions in the capital goods industry: Examining the impact of the buying center
Töllner, A., Blut, M., & Holzmüller, H. (2011) · Industrial Marketing Management · doi:10.1016/j.indmarman.2011.06.001 · Cited by 107
Marker versus Markerless Augmented Reality. Which Has More Impact on Users?
Brito, P. Q., & Stoyanova, J. (2017) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2017.1393974 · Cited by 92
Dick, P., & Jankowicz, D. (2001) · Policing An International Journal · doi:10.1108/13639510110390936 · Cited by 93
Content Analysis as a Best Practice in Technical Communication Research
Thayer, A., Evans, M. B., McBride, A. A., Queen, M., & Spyridakis, J. H. (2007) · Journal of Technical Writing and Communication · doi:10.2190/tw.37.3.c · Cited by 92
Do you like What you Recognize?
Dens, N., Pelsmacker, P. D., Wouters, M., & Purnawirawan, N. (2012) · Journal of Advertising · doi:10.2753/joa0091-3367410303 · Cited by 95
The blame shift: Robot service failures hold service firms more accountable
Ryoo, Y., Jeon, Y. A., & Kim, W. (2024) · Journal of Business Research · doi:10.1016/j.jbusres.2023.114360 · Cited by 89
Atkinson, L., & Kim, Y. (2015) · Environmental Communication · doi:10.1080/17524032.2014.932817 · Cited by 89
Maximizing earnings and price fairness perceptions in online consumer-to-consumer auctions
Suter, T. A., & Hardesty, D. M. (2005) · Journal of Retailing · doi:10.1016/j.jretai.2005.01.007 · Cited by 89
Grayson, K. A., & Rust, R. T. (2001) · Journal of Consumer Psychology · doi:10.1207/s15327663jcp1001&2_06 · Cited by 89
A meta-analytic review of emotional exhaustion in a sales context
Edmondson, D. R., Matthews, L. M., & Ambrose, S. C. (2019) · Journal of Personal Selling and Sales Management · doi:10.1080/08853134.2019.1592684 · Cited by 88
Age-related cues in retail services advertising: Their effects on younger consumers
Day, E., & Stafford, M. R. (1997) · Journal of Retailing · doi:10.1016/s0022-4359(97)90004-x · Cited by 88
Does It Pay to Compete Aggressively? Contingent Roles of Internal and External Resources
Andrevski, G., & Ferrier, W. J. (2016) · Journal of Management · doi:10.1177/0149206316673718 · Cited by 88
Thompson, D. V., Hamilton, R. W., & Petrova, P. (2009) · Journal of Consumer Research · doi:10.1086/599325 · Cited by 92
The invisible majority? Older models in UK television advertising
Simcock, P., & Sudbury‐Riley, L. (2006) · International Journal of Advertising · doi:10.1080/02650487.2006.11072953 · Cited by 89
Chatzopoulou, E., Filieri, R., & Dogruyol, S. A. (2020) · Journal of Consumer Affairs · doi:10.1111/joca.12329 · Cited by 97
Typologies and touchpoints: designing multi-channel digital strategies
Straker, K., Wrigley, C., & Rosemann, M. (2015) · Journal of Research in Interactive Marketing · doi:10.1108/jrim-06-2014-0039 · Cited by 86
Mosch, P., Schweikl, S., & Obermaier, R. (2021) · International Journal of Production Economics · doi:10.1016/j.ijpe.2021.108141 · Cited by 85
Zhang, J. J., Wang, Y., Ruan, Q., & Yang, Y. (2024) · Tourism Management Perspectives · doi:10.1016/j.tmp.2024.101279 · Cited by 90
Asian Americans in Magazine Advertising: Portrayals of the “Model Minority”
Taylor, C. R., Landreth, S., & Bang, H. (2005) · Journal of Macromarketing · doi:10.1177/0276146705280634 · Cited by 85
Service crisis recovery and firm performance: insights from information breach announcements
Rasoulian, S., Grégoire, Y., Legoux, R., & Sénécal, S. (2017) · Journal of the Academy of Marketing Science · doi:10.1007/s11747-017-0543-8 · Cited by 85
von Berlepsch, D., Lemke, F., & Gorton, M. (2022) · Journal of Business Ethics · doi:10.1007/s10551-022-05268-x · Cited by 98
Corporate Social Responsibility in the Construction Industry
Smallwood, J. (2013) · Routledge eBooks · doi:10.4324/9780203012338 · Cited by 84
The Freegan phenomenon: anti‐consumption or consumer resistance?
Pentina, I., & Amos, C. (2011) · European Journal of Marketing · doi:10.1108/03090561111167405 · Cited by 84
Saeed, K. A., Hwang, Y., & Grover, V. (2002) · International Journal of Electronic Commerce · doi:10.1080/10864415.2002.11044264 · Cited by 84
Bang, H., Raymond, M. A., Taylor, C. R., & Moon, Y. S. (2005) · International Marketing Review · doi:10.1108/02651330510602222 · Cited by 83
A capability perspective on service business development in small and medium-sized suppliers
Gebauer, H., PAIOLA, M. U., & Edvardsson, B. (2012) · Scandinavian Journal of Management · doi:10.1016/j.scaman.2012.07.001 · Cited by 83
Business Turnaround Processes Following Acquisitions
Castrogiovanni, G. J., & Bruton, G. D. (2000) · Journal of Business Research · doi:10.1016/s0148-2963(98)00072-1 · Cited by 82
Self-Relevance and Purchase Goals: Mapping a Consumer Decision
Houston, M. B., & Walker, B. A. (1996) · Journal of the Academy of Marketing Science · doi:10.1177/0092070396243004 · Cited by 82
Mazodier, M., & Rezaee, A. (2013) · Journal of the Academy of Marketing Science · doi:10.1007/s11747-013-0325-x · Cited by 82
Information technology and organizational capabilities: A longitudinal study of the apparel industry
Luo, J., Fan, M., & Zhang, H. (2012) · Decision Support Systems · doi:10.1016/j.dss.2012.01.003 · Cited by 82
Assessment of Interjudge Reliability in the Open-Ended Questions Coding Process
Muñoz‐Leiva, F., Montoro-Ríos, F. J., & Martínez, T. L. (2006) · Quality & Quantity · doi:10.1007/s11135-005-1093-6 · Cited by 86
He, Y., Merz, M. A., & Alden, D. L. (2008) · Journal of International Marketing · doi:10.1509/jimk.16.2.64 · Cited by 83
McCabe, J. M., Tanner, A. E., & Heiman, J. R. (2009) · Sex Roles · doi:10.1007/s11199-009-9723-4 · Cited by 81
Developing a Conceptual Understanding of Consumer-based League Brand Associations
Kunkel, T., Funk, D. C., & King, C. (2014) · Journal of Sport Management · doi:10.1123/jsm.2011-0153 · Cited by 85
Jensen, J. A., & Cornwell, T. B. (2017) · Journal of Sport Management · doi:10.1123/jsm.2016-0232 · Cited by 80
The evolving role of trade fairs in business: A systematic literature review and a research agenda
Sarmento, M., & Simões, C. (2018) · Industrial Marketing Management · doi:10.1016/j.indmarman.2018.02.006 · Cited by 80
Stakeholder engagement in intra- and inter-organizational innovation
Jonas, J. M., Boha, J., Sörhammar, D., & Moeslein, K. M. (2018) · Journal of service management · doi:10.1108/josm-09-2016-0239 · Cited by 90
Gunn, F., Lee, S. H., & Steed, M. (2016) · Marketing Education Review · doi:10.1080/10528008.2016.1255560 · Cited by 79
Interrater reliability estimators tested against true interrater reliabilities
Zhao, X., Feng, G. C., Ao, S. H., & Liu, P. L. (2022) · BMC Medical Research Methodology · doi:10.1186/s12874-022-01707-5 · Cited by 93
The role of context in the multinationality‐performance relationship: A meta‐analytic review
Kirca, A. H., Roth, K., Hult, G. T. M., & Cavusgil, S. T. (2012) · Global Strategy Journal · doi:10.1002/gsj.1032 · Cited by 79
Inter-Coder Agreement in One-to-Many Classification: Fuzzy Kappa
Kirilenko, A., & Stepchenkova, S. O. (2016) · PLoS ONE · doi:10.1371/journal.pone.0149787 · Cited by 85
Gabbott, M., & Hogg, G. (1996) · Journal of Marketing Management · doi:10.1080/0267257x.1996.9964431 · Cited by 78
Customer and employee views of critical service incidents
Chung‐Herrera, B. G., Goldschmidt, N., & Hoffman, K. (2004) · Journal of Services Marketing · doi:10.1108/08876040410542245 · Cited by 81
A YEAR IN THE LIFE OF THE AFRICAN-AMERICAN MALE IN ADVERTISING: A Content Analysis
Bailey, A. A. (2006) · Journal of Advertising · doi:10.2753/joa0091-3367350106 · Cited by 78
Trust formation in outsourcing relationships: A social exchange theoretic perspective
Schoenherr, T., Narayanan, S., & Narasimhan, R. (2015) · International Journal of Production Economics · doi:10.1016/j.ijpe.2015.08.026 · Cited by 77
Rivals’ reactions to mergers and acquisitions
Uhlenbruck, K., Hughes‐Morgan, M., Hitt, M. A., Ferrier, W. J., & Brymer, R. A. (2016) · Strategic Organization · doi:10.1177/1476127016630526 · Cited by 82
Salvador, F., Chandrasekaran, A., & Sohail, T. (2014) · Journal of Operations Management · doi:10.1016/j.jom.2014.02.001 · Cited by 76
Why are Endorsements Effective? Sorting among Theories of Product and Endorser Effects
Mittelstaedt, J. D., Riesz, P. C., & Burns, W. J. (2000) · Journal of Current Issues & Research in Advertising · doi:10.1080/10641734.2000.10505101 · Cited by 76
Ruth, J. A., Brunel, F. F., & Otnes, C. C. (2003) · Psychology and Marketing · doi:10.1002/mar.10114 · Cited by 76
Cross-Unit Competition for a Market Charter: The Enduring Influence of Structure
Houston, M. B., Walker, B. A., Hutt, M. D., & Reingen, P. H. (2001) · Journal of Marketing · doi:10.1509/jmkg.65.2.19.18256 · Cited by 75
What frugal products are and why they matter: A cross-national multi-method study
von Janda, S., Kuester, S., Schuhmacher, M. C., & Shainesh, G. (2019) · Journal of Cleaner Production · doi:10.1016/j.jclepro.2019.118977 · Cited by 75
Brulle, R. J., Turner, L. H., Carmichael, J. T., & Jenkins, J. C. (2007) · Mobilization An International Quarterly · doi:10.17813/maiq.12.3.j08421508773764m · Cited by 74
de Jonge, J., van Trijp, J. C. M., Renes, R. J., & Frewer, L. J. (2009) · Risk Analysis · doi:10.1111/j.1539-6924.2009.01320.x · Cited by 74
Attribution Strategies and Return on Keyword Investment in Paid Search Advertising
Li, H. A., Kannan, P. K., Viswanathan, S., & Pani, A. (2016) · Marketing Science · doi:10.1287/mksc.2016.0987 · Cited by 74
Tsai, W. S., & Men, L. R. (2012) · Journal of Research in Interactive Marketing · doi:10.1108/17505931211241369 · Cited by 73
Albers‐Miller, N. D., & Stafford, M. R. (1999) · Journal of Services Marketing · doi:10.1108/08876049910282682 · Cited by 73
Nonmonotonic Status Effects in New Product Adoption
Hu, Y., & den Bulte, C. V. (2014) · Marketing Science · doi:10.1287/mksc.2014.0857 · Cited by 73
Menon, G. (1997) · Journal of Marketing Research · doi:10.1177/002224379703400303 · Cited by 73
Drivers of Sales Performance: A Contemporary Meta-Analysis
Verbeke, W., Dietz, B., & Verwaal, E. (2010) · RePub (Erasmus University Rotterdam) · Cited by 73
Omni-channel service failures and recoveries: refined typologies using Facebook complaints
Rosenmayer, A., McQuilken, L., Robertson, N. L., & Ogden-Barnes, S. (2018) · Journal of Services Marketing · doi:10.1108/jsm-04-2017-0117 · Cited by 72
Advertising appeals and cultural values in television commercialsA comparison of Hong Kong and Korea
Moon, Y. S., & Chan, K. (2005) · International Marketing Review · doi:10.1108/02651330510581172 · Cited by 72
To Play or Not to Play: An Exploratory Content Analysis of Branded Entertainment in Facebook
Zhang, J., Sung, Y., & Lee, W. (2010) · American Journal of Business · doi:10.1108/19355181201000005 · Cited by 72
Inherited agglomeration effects in hedge fund spawns
Figueiredo, R. J. P. D., Meyer‐Doyle, P., & Rawley, E. (2013) · Strategic Management Journal · doi:10.1002/smj.2048 · Cited by 72
Carlson, L., Grove, S. J., Laczniak, R. N., & Kangun, N. (1996) · Journal of Business Research · doi:10.1016/s0148-2963(96)00073-2 · Cited by 72
Audiences as Media Producers: Content Analysis of 260 Blogs
Papacharissi, Z. (2012) · doi:10.4324/9780203944196-8 · Cited by 72
Luo, J., Fan, M., & Zhang, H. (2016) · Journal of the Association for Information Systems · doi:10.17705/1jais.00429 · Cited by 72
Andrews, J. C., Lysonski, S. J., & Durvasula, S. (1991) · Journal of Advertising · doi:10.1080/00913367.1991.10673210 · Cited by 72
Liao, S., Liu, Z., & Ma, C. (2019) · Technology Analysis and Strategic Management · doi:10.1080/09537325.2019.1601693 · Cited by 71
Gelbrich, K., & Roschk, H. (2010) · Marketing Letters · doi:10.1007/s11002-010-9101-6 · Cited by 77
Motivations and Barriers for Sheep and Goat Meat Consumption in Europe: A Means–End Chain Study
Mandolesi, S., Naspetti, S., Arsenos, G. I., Caramelle-Holtz, E., Latvala, T., Collado, D., Orsini, S., Öztürk, E., & Zanoli, R. (2020) · Animals · doi:10.3390/ani10061105 · Cited by 70
Assurance of Sustainability Information: A Study of Media Pressure
Gillet-Monjarret, C. (2015) · Accounting in Europe · doi:10.1080/17449480.2015.1036894 · Cited by 70
Hoy, M. G., & Andrews, J. C. (2004) · Journal of Public Policy & Marketing · doi:10.1509/jppm.23.2.170.51397 · Cited by 70
Market orientation and innovation performance: The moderating roles of firm ownership structures
Song, J., Wei, Y. S., & Wang, R. (2015) · International Journal of Research in Marketing · doi:10.1016/j.ijresmar.2015.03.005 · Cited by 70
The effect of inconsistent word‐of‐mouth during the service encounter
Wang, X. (2011) · Journal of Services Marketing · doi:10.1108/08876041111143087 · Cited by 69
Attribute-Based Safety Risk Assessment. I: Analysis at the Fundamental Level
Esmaeili, B., Hallowell, M. R., & Rajagopalan, B. (2015) · Journal of Construction Engineering and Management · doi:10.1061/(asce)co.1943-7862.0000980 · Cited by 69
Minorities in Children's Television Commercials: New, Improved, and Stereotyped
Bang, H., & Reece, B. B. (2003) · Journal of Consumer Affairs · doi:10.1111/j.1745-6606.2003.tb00439.x · Cited by 69
Kim, K., Cheong, Y., & Lim, J. S. (2015) · International Journal of Advertising · doi:10.1080/02650487.2015.1006081 · Cited by 69
Exchange-Specific Self-Disclosure, Social Self-Disclosure, and Personal Selling
Jacobs, R. S., Hyman, M. R., & McQuitty, S. (2001) · The Journal of Marketing Theory and Practice · doi:10.1080/10696679.2001.11501885 · Cited by 69
Retail brand experience: scale development and validation
Khan, I. M., & Rahman, Z. (2016) · Journal of Product & Brand Management · doi:10.1108/jpbm-07-2015-0943 · Cited by 69
Thematic trends in event management research
Park, S. B., & Park, K. (2017) · International Journal of Contemporary Hospitality Management · doi:10.1108/ijchm-09-2015-0521 · Cited by 68
En-Gendering Power and Empowerment in Advertising: A Content Analysis
Tsai, W. S., Shata, A., & Tian, S. (2019) · Journal of Current Issues & Research in Advertising · doi:10.1080/10641734.2019.1687057 · Cited by 68
The current practices in food advertising
Kim, K., Cheong, Y., & Zheng, L. (2009) · International Journal of Advertising · doi:10.2501/s0265048709200722 · Cited by 68
Moghaddam, K., Sethi, D., Weber, T., & Wu, J. (2014) · Journal of International Management · doi:10.1016/j.intman.2014.01.002 · Cited by 68
Lwin, M. O., Stanaland, A. J. S., & Chan, D. (2010) · Health Communication · doi:10.1080/10410230903473540 · Cited by 68
Newspaper Portrayals of Child Abuse: Frequency of Coverage and Frames of the Issue
Hove, T. B., Paek, H., Isaacson, T., & Cole, R. T. (2013) · Mass Communication & Society · doi:10.1080/15205436.2011.632105 · Cited by 68
More Than One Way to Tell a Story: A Configurational Approach to Storytelling in Crowdfunding
Anglin, A. H., Reid, S. W., & Short, J. C. (2022) · Entrepreneurship Theory and Practice · doi:10.1177/10422587221082679 · Cited by 70
Metadata
- Authors
- Perreault, W. D., & Leigh, L. E.
- Affiliations
- University of North Carolina at Chapel Hill (US)
- Birmingham–Southern College (US)
- Venue
- Journal of Marketing Research
- Publisher
- JSTOR
- Published
- 1989-05
- Volume
- 26
- Issue
- 2
- Pages
- 135
- ISSN
- 0022-2437 (ISSN-L)
- OpenAlex
- W2069585723
- Cited by
- 1,575
- References
- 42
- Citations by year
- 2026: 19 · 2025: 35 · 2024: 43 · 2023: 44 · 2022: 56 · 2021: 59 · 2020: 60 · 2019: 58 · 2018: 52 · 2017: 39 · 2016: 48 · 2015: 89 · 2014: 77 · 2013: 88 · 2012: 86
- FWCI
- 12.22
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Journal of Marketing Research (publishedVersion)
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Reliability and Agreement in Measurement
- Social Sciences › Decision Sciences › Management Science and Operations Research › Psychometric Methodologies and Testing
- Social Sciences › Sociology and Political Science › Survey Methodology and Nonresponse
- Keywords
- reliability statistics, nominal data, qualitative judgment, marketing activities, measurement validity
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review