Cited by 1,575Reliability and Agreement in MeasurementPsychometric Methodologies and TestingSurvey Methodology and Nonresponse

The DOI matches its Crossref record; 42 of the 42 references it cites were found in a registry or an index.

Reliability of Nominal Data Based on Qualitative Judgments

Perreault, William D., Leigh, Laurence E.·1989·Journal of Marketing Research

Abstract

Most research related to the reliability and validity of marketing measures has focused on multi-item quantitative scales. In contrast, little attention has been given to the quality of nominal scale data developed from qualitative judgments. Judgment-based (“coded”) nominal scale data are important and frequently used in marketing research-for example, in analysis of consumer responses to open-ended survey questions, in cognitive response research, in meta-analysis, and in content analysis. The authors address opportunities and challenges involved in evaluating and improving the quality of judgment-based nominal scale data, with specific emphasis on the use of multiple judges. They review approaches commonly used in other disciplines, then develop a new index of reliability that is more appropriate for the type of interjudge data typically found in marketing studies. Data from a cognitive response experiment are used to illustrate the new index and compare it with other common measures. The authors conclude with suggestions on how to improve the design of studies that rely on judgment-coded data.

Overview

Integrity signals

Registry

Crossref · 10.2307/3172601

Cites

42 of 42 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Verification

Claims the paper makes

We couldn’t retrieve this paper’s full text, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Citations

Cites

Show all 42 references

Cited by

Sorted by citations

See all 1,575

Metadata

Authors
Perreault, W. D., & Leigh, L. E.
Affiliations
  • University of North Carolina at Chapel Hill (US)
  • Birmingham–Southern College (US)
Venue
Journal of Marketing Research
Publisher
JSTOR
Published
1989-05
Volume
26
Issue
2
Pages
135
ISSN
0022-2437 (ISSN-L)
OpenAlex
W2069585723
Cited by
1,575
References
42
Citations by year
2026: 19 · 2025: 35 · 2024: 43 · 2023: 44 · 2022: 56 · 2021: 59 · 2020: 60 · 2019: 58 · 2018: 52 · 2017: 39 · 2016: 48 · 2015: 89 · 2014: 77 · 2013: 88 · 2012: 86
FWCI
12.22
Type
journal article
Language
en
Open access
closed
Locations
Journal of Marketing Research (publishedVersion)
Topics
  • Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Reliability and Agreement in Measurement
  • Social Sciences › Decision Sciences › Management Science and Operations Research › Psychometric Methodologies and Testing
  • Social Sciences › Sociology and Political Science › Survey Methodology and Nonresponse
Keywords
reliability statistics, nominal data, qualitative judgment, marketing activities, measurement validity

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review