The DOI matches its Crossref record; 91 of the 92 references it cites were found in a registry or an index.
Guidelines for Establishing Reliability When Coding Narrative Data
Published version of a preprint
Abstract
The use of quantitative, qualitative, and mixed methods approaches has been foundational to research on emerging adulthood, yet there remain many unresolved methodological issues pertaining to how to handle qualitative data. The purpose of this article is to review best practices for coding and establishing reliability when working with narrative data. In doing so, we highlight how establishing reliability must be seen as an evolving process, rather than simply a focus on the end product. The review is divided into three broad sections. In the first section, we discuss relatively more quantitatively focused methods of coding and establishing reliability, whereas in the second section we discuss relatively more qualitatively focused methods. In the final section, we provide recommendations for researchers interested in coding narrative and other types of open-ended data. This article is intended to serve as an essential resource for researchers working on a variety of topics related to emerging adulthood and beyond.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Chiefly, it allows multiple coders to demonstrate inter-rater reliability, which enhances results’ internal and external validity (Adler et al., 2017; Syed & Nelson, 2015).”
From Narrative identity in the psychosis spectrum: A systematic review and developmental model (2021) · cites this paper as Syed & Nelson, 2015
Citations
Cites
Using thematic analysis in psychology
Braun, V., & Clarke, V. (2006) · Qualitative Research in Psychology · doi:10.1191/1478088706qp063oa · Cited by 194,414
A Coefficient of Agreement for Nominal Scales
Cohen, J. (1960) · Educational and Psychological Measurement · doi:10.1177/001316446002000104 · Cited by 42,398
Intraclass correlations: Uses in assessing rater reliability.
Shrout, P. E., & Fleiss, J. L. (1979) · Psychological Bulletin · doi:10.1037/0033-2909.86.2.420 · Cited by 24,532
Content Analysis: An Introduction to its Methodology.
Shelley, M., & Krippendorff, K. (1984) · Journal of the American Statistical Association · doi:10.2307/2288384 · Cited by 24,346
(2009) · Cited by 21,330
Mixed Methods Research: A Research Paradigm Whose Time Has Come
Johnson, R. B., & Onwuegbuzie, A. J. (2004) · Educational Researcher · doi:10.3102/0013189x033007014 · Cited by 11,170 · cited 1×
“Although qualitative analytic methods are not homogenous in approach, subjectivity is generally valued over consistency in illuminating constructs (Johnson & Onwuegbuzie, 2004).”
BackgroundCicchetti, D. V. (1994) · Psychological Assessment · doi:10.1037/1040-3590.6.4.284 · Cited by 9,349
Social Research Methods: Qualitative and Quantitative Approaches
Djamba, Y. K., & Neuman, W. L. (2002) · Teaching Sociology · doi:10.2307/3211488 · Cited by 8,853
(2011) · Cited by 7,157
Simmons, J. P., Nelson, L. D., & Simonsohn, U. (2011) · Psychological Science · doi:10.1177/0956797611417632 · Cited by 6,567
Research works printed but not linked: 8
- Bakeman R., 1986, Observing behavior: An introduction to sequential analysis
- Cook T. D., 1979, Quasi-experimentation: Design and analysis for field setting
- Guba E. G., 1986, Evaluation Studies Review Annual, 11, 70
- Lincoln Y., 2000, Journal of Management, 23, 409
- Main M., 1994, Adult attachment classification system
- 10.1111/j.1540-4560.1997.tb02453.x · DOI
- Waters T. E., 2014, Journal of Personality
- Wolfe E. W., 2000, Journal of Applied Measurement, 2, 256
Cited by
Sorted by citations
Items 801–803 of 803
Chaney, C., Samsonov, A. E., Galina, V. C., Coates, L., Crider, M., Houston, L. F., Norris-Landry, A., & Sims, J. B. (2026) · Social Science & Medicine · doi:10.1016/j.socscimed.2026.119974
Cognitive dormancy: Supplanting structured learning with AI affordances
Braun, V. (2026) · Computers in Human Behavior Artificial Humans · doi:10.1016/j.chbah.2026.100406
Marin, K. A., Mourani, E., Gage, E. M., Conroy, K., & Petti, J. (2026) · Emerging Adulthood · doi:10.1177/21676968261466867
Metadata
- Authors
- Syed, M., & Nelson, S. C.
- Affiliations
- University of Minnesota (US)
- Corresponding author
- Syed, Moin
- Venue
- Emerging Adulthood
- Publisher
- SAGE Publications
- Published
- 2015-05-26
- Volume
- 3
- Issue
- 6
- Pages
- 375-387
- ISSN
- 2167-6968 (ISSN-L)
- 2167-6984
- OpenAlex
- W2232317411
- Cited by
- 801
- References
- 92
- Citations by year
- 2026: 63 · 2025: 83 · 2024: 106 · 2023: 89 · 2022: 117 · 2021: 126 · 2020: 96 · 2019: 62 · 2018: 28 · 2017: 23 · 2016: 7 · 2015: 1
- FWCI
- 17.94
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Emerging Adulthood (publishedVersion)
- OSF Preprints (OSF Preprints) (submittedVersion)
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Reliability and Agreement in Measurement
- Social Sciences › Education › Qualitative Research Methods and Applications
- Social Sciences › General Social Sciences › Computational and Text Analysis Methods
- Keywords
- narrative data, coding reliability, qualitative data analysis, coding practices, mixed methods
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
