The DOI matches its Crossref record; 21 of the 21 references it cites were found in a registry or an index.
Intercoder Reliability for Validating Conclusions Drawn from Open-Ended Interview Data
Abstract
Intercoder reliability is a measure of agreement among multiple coders for how they apply codes to text data. Intercoder reliability can be used as a proxy for the validity of constructs that emerge from the data. Popular methods for establishing intercoder reliability involve presenting predetermined text segments to coders. Using this approach, researchers run the risk of altering meanings by lifting text from its original context, or making interpretations about the length of codable text. This article describes a set of procedures that was used to develop and assess intercoder reliability with free-flowing text data, in which the coders themselves determined the length of codable text segments. Content analysis of open-ended interview data collected from twenty third-generation Japanese American men and women generated an intercoder reliability of more than .80 for fifteen of the seventeen themes, an average agreement of .90 across all themes, and consistency among the coders in how they segmented coded text. The findings suggest that these procedures may be useful for validating the conclusions drawn from other qualitative studies using text data.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Basics of Qualitative Research: Grounded Theory Procedures and Techniques.
Ellis, C., Strauss, A., & Corbin, J. (1992) · Contemporary Sociology · doi:10.2307/2074814 · Cited by 29,249
Content Analysis: An Introduction to its Methodology.
Shelley, M., & Krippendorff, K. (1984) · Journal of the American Statistical Association · doi:10.2307/2288384 · Cited by 24,312
(1990) · Cited by 24,217
Qualitative evaluation and research methods
Ellis, D. (1990) · International Journal of Information Management · doi:10.1016/0268-4012(90)90041-p · Cited by 17,943
Basics of Qualitative Research: Grounded Theory Procedures and Techniques
Long, D. R., Strauss, A., & Corbin, J. (1993) · The Modern Language Journal · doi:10.2307/328955 · Cited by 17,576
Content Analysis: An Introduction to Its Methodology
Krippendorff, K. (2019) · doi:10.4135/9781071878781 · Cited by 15,448
Research methods in anthropology: qualitative and quantitative approaches
(2002) · Choice Reviews Online · doi:10.5860/choice.39-4047 · Cited by 5,638
Human Groups and Social Categories: Studies in Social Psychology.
Rose, A., & Tajfel, H. (1983) · Contemporary Sociology · doi:10.2307/2066820 · Cited by 4,110
Ethnic identity in adolescents and adults: Review of research.
Phinney, J. S. (1990) · Psychological Bulletin · doi:10.1037/0033-2909.108.3.499 · Cited by 3,798 · cited 2×
“Unlike racial identity, ethnic identity is neither a self-concept nor a worldview, but a sense of belonging (Tajfel 1981; Phinney 1990).”
BackgroundMethodResearch methods in Anthropology: Qualitative and quantitative approaches
van Arsdale, P. W. (1996) · Evaluation Practice · doi:10.1016/s0886-1633(96)90044-6 · Cited by 2,526
Cited by
Intercoder Reliability in Qualitative Research: Debates and Practical Guidelines
O’Connor, C., & Joffe, H. (2020) · International Journal of Qualitative Methods · doi:10.1177/1609406919899220 · Cited by 3,871
“Reporting ICR can help persuade readers that the analysis was performed conscientiously and consistently (Kurasaki, 2000).”
BackgroundCampbell, J. L., Quincy, C., Osserman, J., & Pedersen, O. K. (2013) · Sociological Methods & Research · doi:10.1177/0049124113500475 · Cited by 2,974
McDonald, N., Schoenebeck, S., & Forte, A. (2019) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3359174 · Cited by 1,206
Process guidelines for establishing Intercoder Reliability in qualitative studies
MacPhail, C., Khoza, N., Abler, L., & Ranganathan, M. (2016) · Qualitative Research · doi:10.1177/1468794115577012 · Cited by 534
A team-based approach to open coding: considerations for creating intercoder consensus
Cascio, M. A., Lee, E., Vaudrin, N., & Freedman, D. A. (2019) · Field Methods · doi:10.1177/1525822x19838237 · Cited by 492
Metadata
- Authors
- Kurasaki, K. S.
- Venue
- Field Methods
- Publisher
- SAGE Publications
- Published
- 2000-08
- Volume
- 12
- Issue
- 3
- Pages
- 179-194
- ISSN
- 1064-8631 (ISSN-L)
- 1525-822X
- 1552-3969
- OpenAlex
- W2147362419
- Cited by
- 462
- References
- 21
- FWCI
- 2.50
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Intercoder Reliability for Validating Conclusions Drawn from Open-Ended Interview Data. https://app.cochat.ai/papers/10.1177/1525822x0001200301
- The paper
- Kurasaki, K. S. (2000). Intercoder Reliability for Validating Conclusions Drawn from Open-Ended Interview Data. Field Methods. https://doi.org/10.1177/1525822x0001200301
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.