The DOI matches its Crossref record; 91 of the 92 references it cites were found in a registry or an index.
Guidelines for Establishing Reliability When Coding Narrative Data
Published version of a preprint
Abstract
The use of quantitative, qualitative, and mixed methods approaches has been foundational to research on emerging adulthood, yet there remain many unresolved methodological issues pertaining to how to handle qualitative data. The purpose of this article is to review best practices for coding and establishing reliability when working with narrative data. In doing so, we highlight how establishing reliability must be seen as an evolving process, rather than simply a focus on the end product. The review is divided into three broad sections. In the first section, we discuss relatively more quantitatively focused methods of coding and establishing reliability, whereas in the second section we discuss relatively more qualitatively focused methods. In the final section, we provide recommendations for researchers interested in coding narrative and other types of open-ended data. This article is intended to serve as an essential resource for researchers working on a variety of topics related to emerging adulthood and beyond.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Chiefly, it allows multiple coders to demonstrate inter-rater reliability, which enhances results’ internal and external validity (Adler et al., 2017; Syed & Nelson, 2015).”
From Narrative identity in the psychosis spectrum: A systematic review and developmental model (2021) · cites this paper as Syed & Nelson, 2015
Citations
Cites
Using thematic analysis in psychology
Braun, V., & Clarke, V. (2006) · Qualitative Research in Psychology · doi:10.1191/1478088706qp063oa · Cited by 194,414
A Coefficient of Agreement for Nominal Scales
Cohen, J. (1960) · Educational and Psychological Measurement · doi:10.1177/001316446002000104 · Cited by 42,398
Intraclass correlations: Uses in assessing rater reliability.
Shrout, P. E., & Fleiss, J. L. (1979) · Psychological Bulletin · doi:10.1037/0033-2909.86.2.420 · Cited by 24,532
Content Analysis: An Introduction to its Methodology.
Shelley, M., & Krippendorff, K. (1984) · Journal of the American Statistical Association · doi:10.2307/2288384 · Cited by 24,346
(2009) · Cited by 21,330
Mixed Methods Research: A Research Paradigm Whose Time Has Come
Johnson, R. B., & Onwuegbuzie, A. J. (2004) · Educational Researcher · doi:10.3102/0013189x033007014 · Cited by 11,170 · cited 1×
“Although qualitative analytic methods are not homogenous in approach, subjectivity is generally valued over consistency in illuminating constructs (Johnson & Onwuegbuzie, 2004).”
BackgroundCicchetti, D. V. (1994) · Psychological Assessment · doi:10.1037/1040-3590.6.4.284 · Cited by 9,349
Social Research Methods: Qualitative and Quantitative Approaches
Djamba, Y. K., & Neuman, W. L. (2002) · Teaching Sociology · doi:10.2307/3211488 · Cited by 8,853
(2011) · Cited by 7,157
Simmons, J. P., Nelson, L. D., & Simonsohn, U. (2011) · Psychological Science · doi:10.1177/0956797611417632 · Cited by 6,567
Research works printed but not linked: 8
- Bakeman R., 1986, Observing behavior: An introduction to sequential analysis
- Cook T. D., 1979, Quasi-experimentation: Design and analysis for field setting
- Guba E. G., 1986, Evaluation Studies Review Annual, 11, 70
- Lincoln Y., 2000, Journal of Management, 23, 409
- Main M., 1994, Adult attachment classification system
- 10.1111/j.1540-4560.1997.tb02453.x · DOI
- Waters T. E., 2014, Journal of Personality
- Wolfe E. W., 2000, Journal of Applied Measurement, 2, 256
Cited by
Sorted by citations
Items 601–700 of 803
#BlueGirl: A study of collective trauma on Twitter
Abtahi, Z., Zahedi, L., Eizadyar, Z., & Fava, N. M. (2022) · Journal of Traumatic Stress · doi:10.1002/jts.22865 · Cited by 2
Sher‐Censor, E. (2019) · Journal of Visualized Experiments · doi:10.3791/60025-v · Cited by 1
“Traditional”, “Romantic” and “ Bildung ” Hero—Identifying Polish Master Narratives
Kowalska, M., & Zięba, M. (2022) · Journal of Constructivist Psychology · doi:10.1080/10720537.2022.2136807 · Cited by 1
Svačinová, I. (2022) · OMEGA - Journal of Death and Dying · doi:10.1177/00302228221148077 · Cited by 1
Garrouteigt, C., Gana, K., & Décamps, G. (2023) · Pratiques Psychologiques · doi:10.1016/j.prps.2022.12.001 · Cited by 1
Boscolo, A. (2022) · CADMO · doi:10.3280/cad2022-001004 · Cited by 1
Timberlake, A. F. V., & Fesel, D. (2023) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2023.1141768 · Cited by 2
Johnson, K. N., & Mills, M. T. (2023) · American Journal of Speech-Language Pathology · doi:10.1044/2023_ajslp-21-00158 · Cited by 1
Global Automobile Manufacturers Mission Statements and CSR Letters
Li, Y., Vieira, E. T., & Trefalt, Š. (2023) · Symphonya Emerging Issues in Management · doi:10.4468/2023.01.03li.vieira.trefalt · Cited by 1
Elderhood and the Sacrament of Communion: An Orthodox Theological Exploration of Gracefully Aging
Tia, T., COSMA, S. A., & Borza, H. V. (2024) · Religions · doi:10.3390/rel15030304 · Cited by 2
Semiotic mediation of gestures in the teaching of early algebra: the case of the equal sign
Stylianou, D. A., Lee, B., Ristroph, I., Knuth, E., BLANTON, M. L., Stephens, A. C., & Gardiner, A. M. (2024) · Educational Studies in Mathematics · doi:10.1007/s10649-024-10319-3 · Cited by 1
He, S., & Xin, Y. P. (2024) · Mathematical Thinking and Learning · doi:10.1080/10986065.2024.2403044 · Cited by 1
Can technology be good for health? Investigating health-promoting strategies in the private sector
Sigler, B., Porter, K. M. P., Thompson, L. J., Singer, S. J., & Gaskin, D. J. (2024) · Frontiers in Public Health · doi:10.3389/fpubh.2024.1395422 · Cited by 1
Quantitative Reasoning Competencies for Student Success in Introductory Biology
Cleveland, A., Sezen‐Barrie, A., Peterson, F., & Lindsay, S. M. (2024) · The journal of college science teaching · doi:10.1080/0047231x.2024.2402919 · Cited by 1
Mixed Methods Approaches to Emerging Adult Research
Turner, K., Weststrate, N. M., & McLean, K. C. (2024) · Oxford University Press eBooks · doi:10.1093/oso/9780197677797.003.0020 · Cited by 1
Nnam, M. U., Arua, M. C., Dastile, N. P., Arua, C. C., & Eni, O. (2025) · International journal of law, crime and justice · doi:10.1016/j.ijlcj.2025.100745 · Cited by 1
Visualization Task Taxonomy to Understand the Fuzzing Internals
Kummita, S., Miao, M., Bodden, E., & Wei, S. (2025) · ACM Transactions on Software Engineering and Methodology · doi:10.1145/3718346 · Cited by 1
Cheng, T., Stone, A., & Coplan, R. J. (2025) · Social Development · doi:10.1111/sode.70010 · Cited by 1
Break-Up Anxiety in Conflict Narratives Told by Emerging Adult Couples
Liang, E., & Feiring, C. (2020) · Journal of Relationships Research · doi:10.1017/jrr.2020.8 · Cited by 1
Personality in Nonhuman Animals
Bell, A. M., & Bensky, M. K. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108264822.023 · Cited by 1
Weiß, A., & Deary, I. J. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108264822.005 · Cited by 2
Personality and the Unconscious
Perugini, M., Richetin, J., & Costantini, G. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108264822.008 · Cited by 2
Pratiwi, A., Arsyad, S., & Syafryadin, S. (2022) · Journal of Language and Literature · doi:10.24071/joll.v22i1.3502 · Cited by 1
Mitigating the Effects of Withdrawal Behavior on Organizations
Alexander, J. F. (2016) · ScholarWorks (Walden University) · Cited by 1
Edmondstone, C. (2016) · Scholarship at UWindsor (University of Windsor) · Cited by 1
The Use of Assistive Technology in School-Aged Children with Learning Disorders
Kivisto, L. R. (2017) · Scholarship at UWindsor (University of Windsor) · Cited by 1
Master Narratives, Gender Identity, Socialization ProcessesPreprint
McLean, K. C., Fordham, C., Boggs, S., Byers, S., Haraldsson, K. G., Lowe, A., & Syed, M. (2019) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/d47mu · Cited by 1
Self-citationIncoming editorial: Advancing intercultural research and standing on the shoulders of giants
Schwartz, S. J. (2019) · International Journal of Intercultural Relations · doi:10.1016/j.ijintrel.2019.11.008 · Cited by 1
Framework for climate migration readiness for Fiji for relocation of Pacific Islanders to Fiji
Bilimoria, N. (2020) · Queensland University of Technology · doi:10.5204/thesis.eprints.137303 · Cited by 1
Dewhirst, M. (2020) · doi:10.26686/wgtn.17148005.v1 · Cited by 1
Narrative Identity in the Social World: The Press for StabilityPreprint
McLean, K. C., Syed, M., Haraldsson, K. G., & Lowe, A. (2019) · doi:10.31234/osf.io/zqkry · Cited by 1
Self-citationParent Perspectives on Educational Needs of Students with Sex Chromosome AneuploidiesPreprint
Thompson, T., Stinnett, N., Tartaglia, N. R., Davis, S., & Janusz, J. A. (2021) · doi:10.31219/osf.io/kvahb · Cited by 1
Corr, P. J., & Matthews, G. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108264822.001 · Cited by 1
Addendum: Statistical Analyses and Computer Programming in Personality
Corr, P. J., & Matthews, G. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108264822.045 · Cited by 1
A sense of continuity in mortality? Exploring science-oriented Finns’ views on afterdeathPreprint
Haimila, R., & Muraja, E. (2020) · doi:10.31219/osf.io/dxhfs · Cited by 1
Fish, J., Counts, P. K., Ruzzicone, D. J., Ogbeide, I. E., & Syed, M. (2022) · doi:10.31234/osf.io/qthpw · Cited by 1
Self-citationLife Narratives and the Ten Aspects of the Big Five Across Open-ended and Targeted PromptsPreprint
Chou, E., Hedrick, N. I., Westberg, D. W., Udochi, A. L., Rogers, M., Holtzman, N. S., Syed, M., & DeYoung, C. G. (2022) · doi:10.31234/osf.io/wnqru · Cited by 1
Self-citationThe Process of Replication Target Selection in Psychology: What to Consider?Preprint
Pittelkow, M.-M., Field, S. M., Isager, P. M., Veer, A. V. '., Anderson, T., Cole, S., Dominik, T., Giner‐Sorolla, R., Gök, S., Heyman, T., et al. (2022) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/4pw63 · Cited by 1
Troubles Upon Troubles: Do Adverse Childhood Experiences Impact Rehabilitation?
Hiwi, E. T. (2023) · doi:10.26686/wgtn.22335778 · Cited by 1
Booker, J. A., Fıvush, R., Greenhoot, A. F., McLean, K. C., Wainryb, C., & Pasupathi, M. (2024) · doi:10.31234/osf.io/qp5x4 · Cited by 1
Experiencing and Responding to Self-Discrepant Autobiographical Memories
Dyshniku, F. (2017) · Scholarship at UWindsor (University of Windsor)
Practices that Influence Instructional Coaches' Perceptions of Effectiveness
Koehler, L. (2017) · University of North Texas Digital Library (University of North Texas) · doi:10.12794/metadc1062802
Both, A. (2018) · Lund University Publications Student Papers (Lund University)
Cho, K. (2018) · TSpace (University of Toronto)
Nelson, S. C., & Syed, M. (2017) · University of Minnesota Digital Conservancy (University of Minnesota) · doi:10.17605/osf.io/j6erx
Self-citationReflexive dialogue within the supervisory relationship to enhance supervisee learning outcomes
Calvert, F. L. (2019) · Research Online (University of Wollongong)
Sex, Dishonesty, and Psychotherapy
Love, M. (2019) · doi:10.7916/d8-cpz2-yq18
Nugent, M. L. (2019) · NCSU Libraries Repository (North Carolina State University Libraries)
Pesner, E. (2020) · CUNY Academic Works (City University of New York)
Personality Assessment Methods
Boyle, G. J., & Helmes, E. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108264822.011 · Cited by 1
Schermer, J. A., & Saklofske, D. H. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108264822.014
Social Relations and Social Support
Austin, E. Q., Knack, J. M., Jensen‐Campbell, L. A., & Rex‐Lear, M. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108264822.036
Beckman, M., Spännargård, Å., & Alfonsson, S. (2020) · The Cognitive Behaviour Therapist · doi:10.1017/s1754470x20000562 · Cited by 1
Cancio, R. (2021) · Hispanic Journal of Behavioral Sciences · doi:10.1177/0739986321996140
Memory for syntactic differences in mental illness descriptions
Line, E. N., Roberts, S., & Horne, Z. (2020) · Memory & Cognition · doi:10.3758/s13421-021-01208-8
The School Librarian's Role in the Adoption of Open Textbooks
Baker, A. D., Carney, K. A., & Schwark, C. (2021) · School Libraries Worldwide · doi:10.29173/slw8236
Comparing evaluations of social situations for adults who do and do not stutter
Brundage, S. B., Winters, K. L., Armendariz, K., Sabat, R., & Beilby, J. M. (2021) · Journal of Communication Disorders · doi:10.1016/j.jcomdis.2021.106161
Key Principles in Ethical Data Analysis and Handling Conflicts of Interest
Schwartz, S. J. (2021) · Oxford University Press eBooks · doi:10.1093/oso/9780190095918.003.0004
Small moments and public intimacies: Explorations of life story writing group for older adults
de Medeiros, K. (2021) · Wydawnictwo Liberi Libri eBooks · doi:10.47943/lib.9788363487461.rozdzial03
Chądzyńska, M. (2021) · Wydawnictwo Liberi Libri eBooks · doi:10.47943/lib.9788363487461.rozdzial14
Opowieści o związku a jego jakość
Kuncewicz, D., & Jazurek, D. (2021) · Wydawnictwo Liberi Libri eBooks · doi:10.47943/lib.9788363487461.rozdzial08
Krzemińska, B. A. (2021) · Wydawnictwo Liberi Libri eBooks · doi:10.47943/lib.9788363487461.rozdzial10
Słowo nocy. Analiza marzeń sennych więźniów KL Auschwitz-Birkenau narodowości polskiej
Wosińska, W., & Zagórska, W. (2021) · Wydawnictwo Liberi Libri eBooks · doi:10.47943/lib.9788363487461.rozdzial13
Budziszewska, M. (2021) · Wydawnictwo Liberi Libri eBooks · doi:10.47943/lib.9788363487461.rozdzial16
Corr, P. J., & Matthews, G. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108264822.002
Baldwin, S. (2021) · Carleton University's Institutional Repository (MacOdrum Library, Carleton University) · doi:10.22215/etd/2021-14909
Narrative IdentityPreprint
McLean, K. C., & Syed, M. (2017) · doi:10.31234/osf.io/p2y6j
Self-citationUnder what circumstances does autobiographical memory enhance self-control?
Duff, N. (2020) · Open Access Victoria University of Wellington | Te Herenga Waka (Figshare) · doi:10.26686/wgtn.17147285
Corr, P. J., & Matthews, G. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108264822.046
Wu, D., Kasson, E. M., Singh, A. K., Ren, Y., Kaiser, N., Huang, M. S., & Cavazos‐Rehg, P. A. (2022) · doi:10.2196/preprints.39460
Mete, A., & Ghosh, S. (2022) · doi:10.31234/osf.io/drjg8
Chatzikyriakidou, K., & McCartney, M. L. (2022) · Contributions from biology education research · doi:10.1007/978-3-030-98592-9_4
İNALTUN, H. (2022) · Uludağ Üniversitesi Eğitim Fakültesi Dergisi · doi:10.19171/uefad.1099269
Investigating The Autobiographical Memories Of Adolescent Boys In Youth Justice Facilities
Whelan, R. (2022) · Open Access Victoria University of Wellington | Te Herenga Waka (Figshare) · doi:10.26686/wgtn.21076159
Infant sleep: What information do social media posts provide to parents? (Preprint)Preprint
Li, N., & D’Souza, L. (2023) · doi:10.2196/preprints.46751
Gonzalez, A. M., Koepf, I. M., & McLean, K. C. (2023) · doi:10.31234/osf.io/dtq7v
Moran, J. B., Crosby, C. L., Himes, T., & Wade, T. J. (2023) · Sexuality & Culture · doi:10.1007/s12119-023-10086-y
Hadžiomerović, A. I. (2023) · Context Journal of Interdisciplinary Studies · doi:10.55425/23036966.2023.10.1.53
Improved Wellbeing and Resilience via Breathwork Interventions for Computer WorkersPreprint
Montes, C. M., & Penzenstadler, B. (2023) · Research Square · doi:10.21203/rs.3.rs-3192152/v1
Assessing evidence and uncertainty
Pittelkow, M.-M. (2023) · University of Groningen research database (University of Groningen / Centre for Information Technology) · doi:10.33612/diss.762945985
Shared Human and Unique Individual Experiences: Personality Development in Vulnerable Youth
Koster, N. (2023) · Utrecht University Repository (Utrecht University) · doi:10.33540/1845
Kekemelik için kendini açma ifadeleri: Nitel öz bildirim çalışması
Mutlu, A. İ., & Kara, İ. (2023) · Ergoterapi ve Rehabilitasyon Dergisi · doi:10.30720/ered.1272133
Stoddard, B. (2023) · Open Access Victoria University of Wellington | Te Herenga Waka (Figshare) · doi:10.26686/wgtn.24137985
Ehealth intervention to optimize adherence in late adolescents and young adults with type 1 diabetes
AlBurno, H. (2023) · Research Publications (Maastricht University) · doi:10.26481/dis.20240118ha
Género, intimidad y poder: uso de medios digitales en interacciones románticas en jóvenes chilenos
Urrutia, V. G., & Tello-Navarro, F. (2024) · Comunicación y Sociedad · doi:10.32870/cys.v2024.8604
Zarch, R., & McGill, M. M. (2024) · ASEE Annual Conference & Exposition · doi:10.18260/1-2--43474
Hölscher, S. I. E., Schachner, M. K., Juang, L. P., & Schwarzenthal, M. (2024) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/hyv2f
Food Systems Evaluation Methods and Sustainability Assessment
(2024) · Frontiers research topics · doi:10.3389/978-2-8325-4594-2
Metadata
- Authors
- Syed, M., & Nelson, S. C.
- Affiliations
- University of Minnesota (US)
- Corresponding author
- Syed, Moin
- Venue
- Emerging Adulthood
- Publisher
- SAGE Publications
- Published
- 2015-05-26
- Volume
- 3
- Issue
- 6
- Pages
- 375-387
- ISSN
- 2167-6968 (ISSN-L)
- 2167-6984
- OpenAlex
- W2232317411
- Cited by
- 801
- References
- 92
- Citations by year
- 2026: 63 · 2025: 83 · 2024: 106 · 2023: 89 · 2022: 117 · 2021: 126 · 2020: 96 · 2019: 62 · 2018: 28 · 2017: 23 · 2016: 7 · 2015: 1
- FWCI
- 17.94
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Emerging Adulthood (publishedVersion)
- OSF Preprints (OSF Preprints) (submittedVersion)
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Reliability and Agreement in Measurement
- Social Sciences › Education › Qualitative Research Methods and Applications
- Social Sciences › General Social Sciences › Computational and Text Analysis Methods
- Keywords
- narrative data, coding reliability, qualitative data analysis, coding practices, mixed methods
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
