The DOI matches its Crossref record; 42 of the 42 references it cites were found in a registry or an index.
Reliability of Nominal Data Based on Qualitative Judgments
Abstract
Most research related to the reliability and validity of marketing measures has focused on multi-item quantitative scales. In contrast, little attention has been given to the quality of nominal scale data developed from qualitative judgments. Judgment-based (“coded”) nominal scale data are important and frequently used in marketing research-for example, in analysis of consumer responses to open-ended survey questions, in cognitive response research, in meta-analysis, and in content analysis. The authors address opportunities and challenges involved in evaluating and improving the quality of judgment-based nominal scale data, with specific emphasis on the use of multiple judges. They review approaches commonly used in other disciplines, then develop a new index of reliability that is more appropriate for the type of interjudge data typically found in marketing studies. Data from a cognitive response experiment are used to illustrate the new index and compare it with other common measures. The authors conclude with suggestions on how to improve the design of studies that rely on judgment-coded data.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“When the described coding procedures were applied, the intercoder reliability according to Perreault and Leigh (1989) was .93, which exceeded the required threshold of .8.”
From A Meta-Analysis of Organizational Complaint Handling and Customer Responses (2011) · cites this paper as Perreault and Leigh (1989)
Citations
Cites
The Measurement of Observer Agreement for Categorical Data
Landis, J. R., & Koch, G. G. (1977) · Biometrics · doi:10.2307/2529310 · Cited by 81,148
A Coefficient of Agreement for Nominal Scales
Cohen, J. (1960) · Educational and Psychological Measurement · doi:10.1177/001316446002000104 · Cited by 42,398
A Paradigm for Developing Better Measures of Marketing Constructs
Churchill, G. A. (1979) · Journal of Marketing Research · doi:10.1177/002224377901600110 · Cited by 16,549
Weighted kappa: nominal scale agreement provision for scaled disagreement or partial credit
Cohen, J. (1968) · Psychological Bulletin · doi:10.1037/h0026256 · Cited by 8,736
Measuring nominal scale agreement among many raters.
Fleiss, J. L. (1971) · Psychological Bulletin · doi:10.1037/h0031619 · Cited by 8,733
Reliability of Content Analysis: The Case of Nominal Scale Coding
Scott, W. A. (1955) · Public Opinion Quarterly · doi:10.1086/266577 · Cited by 1,853
Coefficient Kappa: Some Uses, Misuses, and Alternatives
Brennan, R. L., & Prediger, D. J. (1981) · Educational and Psychological Measurement · doi:10.1177/001316448104100307 · Cited by 1,676
Reliability: A Review of Psychometric Basics and Recent Marketing Practices
Peter, J. P. (1979) · Journal of Marketing Research · doi:10.2307/3150868 · Cited by 1,577
Large sample standard errors of kappa and weighted kappa.
Fleiss, J. L., Cohen, J., & Everitt, B. S. (1969) · Psychological Bulletin · doi:10.1037/h0028106 · Cited by 1,536
Bettman, J. R., & Park, C. W. (1980) · Journal of Consumer Research · doi:10.1086/208812 · Cited by 1,344
Cited by
Sorted by citations
Items 701–800 of 1,002
Kim, K., King, K. W., & Kim, J. (2016) · Journal of Marketing Communications · doi:10.1080/13527266.2015.1129356 · Cited by 28
Perceived Differences Among Countries
Mittelstaedt, J. D., Hopkins, C. D., Raymond, M. A., & Duke, C. R. (2004) · Journal of International Consumer Marketing · doi:10.1300/j046v17n01_02 · Cited by 28
Jones, T., Cunningham, P. H., & Gallagher, K. (2010) · Journal of Advertising · doi:10.2753/joa0091-3367390402 · Cited by 28
Verbal Communication Between Complaining Consumers and Company Service Representatives
Garrett, D. E., & Meyers, R. A. (1996) · Journal of Consumer Affairs · doi:10.1111/j.1745-6606.1996.tb00066.x · Cited by 28
Fillis, I. R. (1999) · Stirling Online Research Repository (University of Stirling) · Cited by 28
The development of a qualitative dynamic attribute value model for healthcare institutes.
Lee, W.-I. (2010) · Europe PMC (PubMed Central) · Cited by 27
Gligor, D. M. (2014) · Cited by 27
Stakeholder engagement and SDGs: the role of social media in the European context
Mehmood, A., Hajdini, J., Iaia, L., Luca, F. D., & Sakka, G. (2022) · EuroMed Journal of Business · doi:10.1108/emjb-11-2021-0173 · Cited by 27
Maker, J. K., & Childs, N. M. (2003) · Journal of Current Issues & Research in Advertising · doi:10.1080/10641734.2003.10505142 · Cited by 27
Market representations in industrial marketing: Could representations influence strategy?
Ruiz, C. A. D., & Kowalkowski, C. (2014) · Industrial Marketing Management · doi:10.1016/j.indmarman.2014.05.015 · Cited by 29
Underlying determinants driving agreement among coders
Feng, G. C. (2012) · Quality & Quantity · doi:10.1007/s11135-012-9807-z · Cited by 31
Ha, L. S., Hu, X. M., Fang, L., Henize, S., Park, S., Stana, A., & Zhang, X. (2015) · Review of Communication · doi:10.1080/15358593.2015.1014401 · Cited by 27
The Bases of Goal Setting in the Self-regulation of Hypertension
Taylor, S. D., Bagozzi, R. P., Gaither, C. A., & Jamerson, K. (2005) · Journal of Health Psychology · doi:10.1177/1359105306058869 · Cited by 27
The Portrayal of African-Americans in Business-To-Business Direct Mail: A Benchmark Study
Stevenson, T. H., & E.Swayne, L. (1999) · Journal of Advertising · doi:10.1080/00913367.1999.10673587 · Cited by 27
Riggle, R. J. (2007) · Digital Commons - University of South Florida (University of South Florida) · Cited by 27
Pass it On: A Framework for Classifying the Content of Word of Mouth
Nguyen, C., & Romaniuk, J. (2014) · Australasian Marketing Journal (AMJ) · doi:10.1016/j.ausmj.2013.12.014 · Cited by 26
Sound and Fury: Digital Vigilantism as a Form of Consumer Voice
Legocki, K. V., Walker, K., & Kiesler, T. (2020) · Journal of Public Policy & Marketing · doi:10.1177/0743915620902403 · Cited by 26
Vafeas, M., & Hughes, T. (2021) · Journal of Business Research · doi:10.1016/j.jbusres.2021.03.038 · Cited by 26
Vlas, C. O., Richard, O. C., Andrevski, G., Konrad, A. M., & Yang, Y. (2021) · Journal of Business Research · doi:10.1016/j.jbusres.2021.11.060 · Cited by 30
Encouraging product reuse and upcycling via creativity priming, imagination and inspiration
Tarabashkina, L., Devine, A., & Quester, P. G. (2022) · European Journal of Marketing · doi:10.1108/ejm-06-2020-0442 · Cited by 27
Rashkova, Y., Moi, L., Marku, E., & Cabiddu, F. (2023) · Journal of Marketing Communications · doi:10.1080/13527266.2023.2177710 · Cited by 26
Tripathi, C. M., Kaurav, R. P. S., & Singh, T. (2023) · Journal of Global Mobility The Home of Expatriate Management Research · doi:10.1108/jgm-01-2023-0006 · Cited by 26
Latest evolution of academic research in corporate social responsibility: an empirical analysis
Alcañiz, J. E. B., Herrera, A. A., Pérez, R. C., & Rivera, J. J. (2010) · Social Responsibility Journal · doi:10.1108/17471111011064726 · Cited by 26
The influence of individualism/collectivism on Mexican and US business negotiation
Heydenfeldt, J. A. (2000) · International Journal of Intercultural Relations · doi:10.1016/s0147-1767(00)00007-9 · Cited by 26
Turning Points and Negotiation: The Case of the 2007–2008 Writers' Strike
Putnam, L. L., & Fuller, R. P. (2014) · Negotiation and Conflict Management Research · doi:10.1111/ncmr.12032 · Cited by 26
Sex Roles in Health Storylines on Prime Time Television: A Content Analysis
Hether, H. J., & Murphy, S. T. (2009) · Sex Roles · doi:10.1007/s11199-009-9654-0 · Cited by 26
Meng, X., Zeng, S., Leung, A. W. T., & Tam, C. M. (2014) · Human and Ecological Risk Assessment An International Journal · doi:10.1080/10807039.2014.926201 · Cited by 26
Spears, N. E., & Germain, R. N. (2007) · Journal of Advertising · doi:10.2753/joa0091-3367360302 · Cited by 26
Environmental justice content in mainstream US, 6–12 environmental education guides
Kushmerick, A., Young, L., & Stein, S. E. (2007) · Environmental Education Research · doi:10.1080/13504620701430745 · Cited by 26
Wymer, W., & Alves, H. (2012) · International Review on Public and Nonprofit Marketing · doi:10.1007/s12208-012-0093-1 · Cited by 26
Wang, Y., Huang, L., Li, J., & Yang, Y. (2019) · Journal of Travel & Tourism Marketing · doi:10.1080/10548408.2019.1568950 · Cited by 26
A Content Analysis of the “Fine Print” in Television Advertising
Kolbe, R. H., & Muehling, D. D. (1992) · Journal of Current Issues & Research in Advertising · doi:10.1080/10641734.1992.10504988 · Cited by 26
Ülker-Demirel, E., Yürük-Kayapınar, P., & KAYAPINAR, Ö. (2020) · Canadian Journal of Administrative Sciences / Revue Canadienne des Sciences de l Administration · doi:10.1002/cjas.1600 · Cited by 25
Gyaurov, D., Fabricatore, C., & Bottino, A. (2022) · International Journal of Qualitative Methods · doi:10.1177/16094069221128491 · Cited by 33
Interactivity Potentials and Usage of German Press-Title Web Sites: An Empirical Investigation
Gerpott, T. J., & Wanke, H. (2004) · Journal of Media Economics · doi:10.1207/s15327736me1704_1 · Cited by 25
The use of humor in television advertising in Hong Kong
Chan, F. F. Y. (2011) · Humor - International Journal of Humor Research · doi:10.1515/humr.2011.003 · Cited by 25
Theories into practice: a content analysis of anti‐smoking websites
Paek, H., Bae, B. J., Hove, T. B., & Yu, H. (2011) · Internet Research · doi:10.1108/10662241111104857 · Cited by 25
The role of a firm’s innovation competence on customer adoption of service innovation
Bhatnagar, N., & Gopalaswamy, A. K. (2017) · Management Research Review · doi:10.1108/mrr-11-2015-0280 · Cited by 29
Theoretical and Methodological Approaches to Social Sciences and Knowledge Management
Azcárate, A. L. (2012) · InTech eBooks · doi:10.5772/2273 · Cited by 25
Assessment of Communication Barriers in Community Pharmacies
Paluck, E., Green, L. W., Frankish, C. J., Fielding, D. W., & Haverkamp, B. E. (2003) · Evaluation & the Health Professions · doi:10.1177/0163278703258104 · Cited by 25
Warden, C. A., HUANG, S., LIU, T., & WU, W. (2007) · Journal of Retailing · doi:10.1016/j.jretai.2007.09.002 · Cited by 25
Winterstein, J., Zhu, B., & Habisch, A. (2023) · Journal of Cleaner Production · doi:10.1016/j.jclepro.2023.140313 · Cited by 24
The Role of Female Directors in the Boardroom: Examining Their Impact on Competitive Dynamics
Kolev, K. D., Hughes‐Morgan, M., & Rehbein, K. A. (2019) · Business & Society · doi:10.1177/0007650319847477 · Cited by 24
Fox, B. C., Şimşek, Z., & Heavey, C. (2021) · Academy of Management Journal · doi:10.5465/amj.2019.0734 · Cited by 24
Rise through coping with service failures in tourism
Su, L., Chen, H., & Lin, Z. (2023) · Annals of Tourism Research · doi:10.1016/j.annals.2023.103643 · Cited by 25
Giving a shout out to Seagram's gin: Extent of and attitudes towards brands in popular songs
de Gregorio, F., & Sung, Y. (2009) · Journal of Brand Management · doi:10.1057/bm.2009.4 · Cited by 24
In search of a common thread revisited: what content does fashion communicate?
Lennon, S. J., Johnson, K. K. P., Noh, M., Zheng, Z., Chae, Y., & Kim, Y. (2014) · International Journal of Fashion Design Technology and Education · doi:10.1080/17543266.2014.942892 · Cited by 24
Tsai, W. S. (2010) · Asian Journal of Communication · doi:10.1080/01292986.2010.496860 · Cited by 24
Carqués, F. J. H. (2007) · Spanish Journal of Finance and Accounting / Revista Española de Financiación y Contabilidad · doi:10.1080/02102412.2007.10779616 · Cited by 24
Applying a voluntary compliance model to a proposed transportation safety regulation
Cantor, D. E., & Terle, M. (2010) · International Journal of Physical Distribution & Logistics Management · doi:10.1108/09600031011093223 · Cited by 24
Cicchirillo, V. J., & Lin, J.-S. (2011) · Journal of Advertising Research · doi:10.2501/jar-51-3-484-498 · Cited by 24
Hospitality-based critical incidents: a cross-cultural comparison
Swanson, S. R., Huang, Y., & Wang, B. (2013) · International Journal of Contemporary Hospitality Management · doi:10.1108/ijchm-03-2012-0033 · Cited by 23
Vidal, D., Fenneteau, H., & Paché, G. A. (2016) · Journal of Business and Industrial Marketing · doi:10.1108/jbim-06-2014-0124 · Cited by 23
Mirc, N., Rouziès, A., & Teerikangas, S. P. (2017) · European Management Review · doi:10.1111/emre.12110 · Cited by 23
Analysis of content strategies of selected brand tweets and its influence on information diffusion
Sridevi, P., Niduthavolu, S., & Vedanthachari, L. N. (2020) · Journal of Advances in Management Research · doi:10.1108/jamr-06-2020-0107 · Cited by 23
Gender portrayal in Hong Kong and Korean children's TV commercials: A cross‐cultural comparison
Moon, Y. S., & Chan, K. (2002) · Asian Journal of Communication · doi:10.1080/01292980209364825 · Cited by 23
Yu, H., Paek, H., & Bae, B. (2008) · Internet Research · doi:10.1108/10662240810912738 · Cited by 23
How food ads communicate ‘health’ with children: a content analysis of Korean television commercials
Moon, Y. S. (2010) · Asian Journal of Communication · doi:10.1080/01292986.2010.496858 · Cited by 23
Deconstructing Subtle Racist Imagery in Television Ads
Shabbir, H. A., Hyman, M. R., Reast, J. D., & Palihawadana, D. (2013) · Journal of Business Ethics · doi:10.1007/s10551-013-1798-8 · Cited by 23
Knowles, P. A., Grove, S. J., & Pickett, G. M. (1999) · Journal of Service Research · doi:10.1177/109467059922006 · Cited by 23
An Empirical Investigation of Corporate Identity Communication on Hong Kong Hotels’ Websites
Mohammed, I., Guillet, B. D., Schuckert, M. R., & Law, R. (2015) · Journal of Hospitality Marketing & Management · doi:10.1080/19368623.2016.1096875 · Cited by 23
Relationship Between Companies and the Public on Facebook: The Portuguese and the Brazilian Context
Loureiro, S. M. C., & Gomes, D. G. (2016) · Journal of Promotion Management · doi:10.1080/10496491.2016.1185493 · Cited by 23
Lysonski, S. J., & Durvasula, S. (1998) · Journal of Marketing Education · doi:10.1177/027347539802000210 · Cited by 23
Urban legends: diffusion processes and the exchange of resources
Donavan, D. T., Mowen, J. C., & Chakraborty, G. (2001) · Journal of Consumer Marketing · doi:10.1108/07363760110404468 · Cited by 22
Putting Things into Context: A Meta-Analysis of Media Context Effects on Attitudinal Outcomes
Kwon, E. S., Nyilasy, G., King, K. W., & Reid, L. N. (2021) · Journal of Advertising · doi:10.1080/00913367.2021.1895920 · Cited by 25
Huang, Q., Lynn, B. J., Dong, C., Ni, S., & Men, L. R. (2022) · International Journal of Business Communication · doi:10.1177/23294884211067805 · Cited by 22
A Content Analysis of Reliability in Advertising Content Analysis Studies.
Wang, W. (2011) · Digital Commons - East Tennessee State University (East Tennessee State University) · Cited by 22
Using Sexual Appeals in Advertising to Sell Cosmetic Surgery: A Content Analysis from 1986 to 2007
Hennink-Kaminski, H. J., & Reichert, T. (2010) · Sexuality & Culture · doi:10.1007/s12119-010-9081-y · Cited by 22
Stevenson, T. H., & E.Swayne, L. (2011) · Journal of Advertising · doi:10.2753/joa0091-3367400407 · Cited by 22
Encroachment Patterns of the “Best Products” from the Last Decade*
Orden, J. V., van der Rhee, B., & Schmidt, G. M. (2011) · Journal of Product Innovation Management · doi:10.1111/j.1540-5885.2011.00834.x · Cited by 22
Generating a Visceral Response
Amos, C., & Spears, N. E. (2010) · Journal of Advertising · doi:10.2753/joa0091-3367390302 · Cited by 22
The role of ethnicity in domestic intercultural service encounters
Rizal, H., Jeng, D., & Chang, H. (2015) · Service Business: An International Journal · doi:10.1007/s11628-015-0267-0
Analyzing Image Fragmentation in Promotional Brochures
Camprubí, R., Guía, J., & Comas, J. (2012) · Journal of Hospitality & Tourism Research · doi:10.1177/1096348012451451 · Cited by 24
Gundlach, G. T., Bradford, K., & Wilkie, W. L. (2010) · Journal of Public Policy & Marketing · doi:10.1509/jppm.29.1.103 · Cited by 22
Product Change Intensity in the Personal Computer Industry: A Study of Firm-Supplier Innovation
Hua, S. Y., & Wemmerlöv, U. (2006) · IEEE Transactions on Engineering Management · doi:10.1109/tem.2006.878108 · Cited by 22
Slater, M. D., & Zimmerman, D. E. (2003) · American Journal of Public Health · doi:10.2105/ajph.93.8.1281 · Cited by 22
Collecting Information from Groups: A Comparison of Two Methods
Sweeney, J., Soutar, G. N., Hausknecht, D. R., Dallin, R. F., & Johnson, L. W. (1997) · Market Research Society Journal · doi:10.1177/147078539703900205 · Cited by 22
Pavlou, P. A., & Dimoka, A. (2005) · SSRN Electronic Journal · Cited by 22
Matching digital companions with customers: The role of perceived similarity
Gelbrich, K., Kerath, A., & Chun, H. H. (2023) · Psychology and Marketing · doi:10.1002/mar.21893 · Cited by 24
Thapa, S., Panda, S., Ghimire, A., & Kim, D. J. (2024) · Decision Support Systems · doi:10.1016/j.dss.2024.114265 · Cited by 25
China ICT Studies: A Review of the Field, 1989–2012
Qiu, J. L., & Bu, W. (2013) · Project Muse (Johns Hopkins University) · Cited by 21
Wei, W., Hu, X., Li, Y., & Peng, P. (2015) · Management Decision · doi:10.1108/md-11-2013-0600 · Cited by 21
Seely, S., Fry, S. W., & Ruppel, M. (2011) · Behavioral & Social Sciences Librarian · doi:10.1080/01639269.2011.565405 · Cited by 21
Kishore, R., Swinarski, M. E., Jackson, E., & Rao, H. R. (2011) · IEEE Transactions on Engineering Management · doi:10.1109/tem.2011.2165287 · Cited by 21
d’Andria, A. (2014) · Revue de l’Entrepreneuriat · doi:10.3917/entre.131.0011 · Cited by 21
The moderating effect of self-esteem on consumer responses to global positioning in advertising
Jun, S., Jeong, Y., Gentry, J. W., & Hyun, Y. J. (2015) · International Journal of Advertising · doi:10.1080/02650487.2015.1094859 · Cited by 22
Developing a Value-Based Measure of Market Orientation in an Interactive Service Relationship
Chen, S., & Quester, P. G. (2005) · Journal of Marketing Management · doi:10.1362/026725705774538408 · Cited by 21
A Comparison of Children's and Prime-Time Fine-Print Advertising Disclosure Practices
Muehling, D. D., & Kolbe, R. H. (1998) · Journal of Advertising · doi:10.1080/00913367.1998.10673561 · Cited by 21
Bang, H., & Moon, Y. S. (2002) · Journal of Services Marketing · doi:10.1108/08876040210436911 · Cited by 21
Disclosures Exposed: Banner Ad Disclosure Adherence to FTC Guidance in the Top 100 U.S. Web Sites
Hoy, M. G., & Lwin, M. O. (2007) · Journal of Consumer Affairs · doi:10.1111/j.1745-6606.2007.00082.x · Cited by 21
Keeping Up with the Joneses: Imitation of Service Capabilities by IT Outsourcing Vendors
Ruckman, K., Saraf, N., & Sambamurthy, V. (2012) · Information Systems Research · doi:10.1287/isre.2014.0555 · Cited by 21
Nicholls, R. (2005) · Cited by 21
The Information Content of Magazine Advertising in Market and Transition Economies
van Herpen, E., Pieters, R. G. M., Fidrmucova, J., & Roosenboom, P. (2000) · Journal of Consumer Policy · doi:10.1023/a:1007138219753 · Cited by 21
Violent Commercials in Television Programs for Children
Shanahan, K. J., Hermans, C. M., & Hyman, M. R. (2003) · Journal of Current Issues & Research in Advertising · doi:10.1080/10641734.2003.10505141 · Cited by 21
When the Cat's Away: A Content Analysis of MNC Overseas Recruitment Print Ads
Leong, S. M., Tan, H. H., & Loh, M. S.-Y. (2004) · Journal of Business Ethics · doi:10.1023/b:busi.0000015845.18419.1d · Cited by 21
Imperatives for Venture Success
Crane, F. G., & Sohl, J. E. (2004) · The International Journal of Entrepreneurship and Innovation · doi:10.5367/000000004773863255 · Cited by 21
U.S. and Korean Consumers: A Cross-Cultural Examination of Product Information-Seeking and -Giving
Cheong, H. J., & Mohammed-Baksh, S. (2020) · Journal of Promotion Management · doi:10.1080/10496491.2020.1745985 · Cited by 21
Studying Heterogeneity in the Subsistence Consumer Market: A Context-Sensitive Approach
von Janda, S., Shainesh, G., & Hillebrand, C. (2020) · Journal of International Marketing · doi:10.1177/1069031x20974326 · Cited by 20
Banerji, D., Saha, V., Singh, N., & Srivastava, R. (2022) · Asia Pacific Journal of Marketing and Logistics · doi:10.1108/apjml-07-2021-0486 · Cited by 20
Yao, S., Zhang, D., & Shen, Q. (2022) · Frontiers in Psychology · doi:10.3389/fpsyg.2022.843858 · Cited by 22
Metadata
- Authors
- Perreault, W. D., & Leigh, L. E.
- Affiliations
- University of North Carolina at Chapel Hill (US)
- Birmingham–Southern College (US)
- Venue
- Journal of Marketing Research
- Publisher
- JSTOR
- Published
- 1989-05
- Volume
- 26
- Issue
- 2
- Pages
- 135
- ISSN
- 0022-2437 (ISSN-L)
- OpenAlex
- W2069585723
- Cited by
- 1,575
- References
- 42
- Citations by year
- 2026: 19 · 2025: 35 · 2024: 43 · 2023: 44 · 2022: 56 · 2021: 59 · 2020: 60 · 2019: 58 · 2018: 52 · 2017: 39 · 2016: 48 · 2015: 89 · 2014: 77 · 2013: 88 · 2012: 86
- FWCI
- 12.22
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Journal of Marketing Research (publishedVersion)
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Reliability and Agreement in Measurement
- Social Sciences › Decision Sciences › Management Science and Operations Research › Psychometric Methodologies and Testing
- Social Sciences › Sociology and Political Science › Survey Methodology and Nonresponse
- Keywords
- reliability statistics, nominal data, qualitative judgment, marketing activities, measurement validity
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review