The DOI matches its Crossref record; 91 of the 92 references it cites were found in a registry or an index.
Guidelines for Establishing Reliability When Coding Narrative Data
Published version of a preprint
Abstract
The use of quantitative, qualitative, and mixed methods approaches has been foundational to research on emerging adulthood, yet there remain many unresolved methodological issues pertaining to how to handle qualitative data. The purpose of this article is to review best practices for coding and establishing reliability when working with narrative data. In doing so, we highlight how establishing reliability must be seen as an evolving process, rather than simply a focus on the end product. The review is divided into three broad sections. In the first section, we discuss relatively more quantitatively focused methods of coding and establishing reliability, whereas in the second section we discuss relatively more qualitatively focused methods. In the final section, we provide recommendations for researchers interested in coding narrative and other types of open-ended data. This article is intended to serve as an essential resource for researchers working on a variety of topics related to emerging adulthood and beyond.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Chiefly, it allows multiple coders to demonstrate inter-rater reliability, which enhances results’ internal and external validity (Adler et al., 2017; Syed & Nelson, 2015).”
From Narrative identity in the psychosis spectrum: A systematic review and developmental model (2021) · cites this paper as Syed & Nelson, 2015
Citations
Cites
Using thematic analysis in psychology
Braun, V., & Clarke, V. (2006) · Qualitative Research in Psychology · doi:10.1191/1478088706qp063oa · Cited by 194,414
A Coefficient of Agreement for Nominal Scales
Cohen, J. (1960) · Educational and Psychological Measurement · doi:10.1177/001316446002000104 · Cited by 42,398
Intraclass correlations: Uses in assessing rater reliability.
Shrout, P. E., & Fleiss, J. L. (1979) · Psychological Bulletin · doi:10.1037/0033-2909.86.2.420 · Cited by 24,532
Content Analysis: An Introduction to its Methodology.
Shelley, M., & Krippendorff, K. (1984) · Journal of the American Statistical Association · doi:10.2307/2288384 · Cited by 24,346
(2009) · Cited by 21,330
Mixed Methods Research: A Research Paradigm Whose Time Has Come
Johnson, R. B., & Onwuegbuzie, A. J. (2004) · Educational Researcher · doi:10.3102/0013189x033007014 · Cited by 11,170 · cited 1×
“Although qualitative analytic methods are not homogenous in approach, subjectivity is generally valued over consistency in illuminating constructs (Johnson & Onwuegbuzie, 2004).”
BackgroundCicchetti, D. V. (1994) · Psychological Assessment · doi:10.1037/1040-3590.6.4.284 · Cited by 9,349
Social Research Methods: Qualitative and Quantitative Approaches
Djamba, Y. K., & Neuman, W. L. (2002) · Teaching Sociology · doi:10.2307/3211488 · Cited by 8,853
(2011) · Cited by 7,157
Simmons, J. P., Nelson, L. D., & Simonsohn, U. (2011) · Psychological Science · doi:10.1177/0956797611417632 · Cited by 6,567
Research works printed but not linked: 8
- Bakeman R., 1986, Observing behavior: An introduction to sequential analysis
- Cook T. D., 1979, Quasi-experimentation: Design and analysis for field setting
- Guba E. G., 1986, Evaluation Studies Review Annual, 11, 70
- Lincoln Y., 2000, Journal of Management, 23, 409
- Main M., 1994, Adult attachment classification system
- 10.1111/j.1540-4560.1997.tb02453.x · DOI
- Waters T. E., 2014, Journal of Personality
- Wolfe E. W., 2000, Journal of Applied Measurement, 2, 256
Cited by
Sorted by citations
Items 701–800 of 803
An Experimental Approach: Investigating the Directive Function of Autobiographical Memory
Duff, N. (2024) · Open Access Victoria University of Wellington | Te Herenga Waka (Figshare) · doi:10.26686/wgtn.25567230
Options, Problems and Guidelines for Measuring Interrater Agreement - a Descriptive Approach
Kočišová, L. (2024) · Czech Sociological Review · doi:10.13060/csr.2024.007
İNALTUN, H. (2024) · International Journal of Science Education · doi:10.1080/09500693.2024.2364122
Content Analysis of the Level of Hegemonic Masculine Traits in Ghanaian Alcohol Advertisements
Bonsu-Owu, H. K., & Roca, D. (2024) · European Advertising Academy · doi:10.1007/978-3-658-44713-7_9
Reminiscing Goals and Behavior as Predictors of Child Psychological Functioning
Russell, S., Herbert, J. S., & Bird, A. L. (2024) · Journal of Cognition and Development · doi:10.1080/15248372.2024.2386035
McKay, S., Thomas, V., Lyons, C. W., & Eguiluz, I. (2024) · Emerging Adulthood · doi:10.1177/21676968241278934 · Cited by 3
Pretorius, E. (2024) · Queensland University of Technology · doi:10.5204/thesis.eprints.251668
References to emotional words in criminal sentencings
Mukai, T., Yuyama, Y., Arai, S., Matsuki, Y., Sadamura, M., & Koizumi, R. (2024) · JAPANESE JOURNAL OF RESEARCH ON EMOTIONS · doi:10.4092/jsre.32.1_11
Social Disadvantage and Language Disorder: Is Dissociating Possible?
Rakhlin, N., Li, N., Momotenko, D. A., Sukmanova, A. A., Ivanova, E., Kosikova, A., & Grigorenko, E. L. (2026) · American Journal of Speech-Language Pathology · doi:10.1044/2026_ajslp-25-00442
Examining Patient Safety Events Using the Behaviour Change Wheel: A Cross-Sectional Analysis
Somerville, M., Cassidy, C. E., MacPhee, S., Sinclair, D. E., Palmer, J., Keefe, D. T., Best, S., & Curran, J. (2024) · The Joint Commission Journal on Quality and Patient Safety · doi:10.1016/j.jcjq.2024.11.001
Green, F. L. L., & Binfet, J.-T. (2024) · CABI eBooks · doi:10.1079/9781800626539.0013
Binfet, J.-T., Green, F. L. L., Godard, R., Szypula, M. M., Rousseau, C. X., & Decker, J. (2024) · CABI eBooks · doi:10.1079/9781800626539.0012
Parent involvement in medical play
Dier, S. (2024) · MOspace Institutional Repository (University of Missouri) · doi:10.32469/10355/105880
Bonsu-Owu, H. K., & Roca, D. (2024) · The Journal of Men s Studies · doi:10.1177/10608265241300715
Drobac, A., & Micić, I. (2024) · Zbornik Instituta za pedagoska istrazivanja · doi:10.2298/zipi2402365d
Using Technologies to Spatialize STEM Learning by Co-Creating Symbols with Young Children
Liang, Y., Hu, X., Yelland, N., & Gao, M. L. (2025) · Education Sciences · doi:10.3390/educsci15040431
It’s not just about the cash: The impact of conservation-based employment on human well-being
Swemmer, L. K., Buthelezi, I., Buthelezi, K. M., Marshall, T., Morale, K., Uys, M.-T., Twine, W. C., & Swemmer, A. M. (2025) · Koedoe · doi:10.4102/koedoe.v67i1.1808
Narrative IdentityPreprint
McLean, K. C., & Syed, M. (2017) · doi:10.31234/osf.io/p2y6j_v1
Self-citationJordan, K. H., Phillips, S. M., Abrams, C. M., & Hall, G. A. (2025) · Health Promotion Practice · doi:10.1177/15248399251330215 · Cited by 1
Stability and Change in Gratitude Expressions for the Fulfilment of Human Needs Categories
Nguyen, S. P., & Gordon, C. L. (2025) · Journal of Happiness Studies · doi:10.1007/s10902-025-00895-3
Incorporating Participant Perspectives to Refine Citizen Science Evaluation FrameworksPreprint
Janssen, J., Bogert, J. M., Gold, M. M., & de Vries, S. (2025) · doi:10.31219/osf.io/2x97q_v2
Evaluating Participant Outcomes in the Weather Monitoring Citizen Science Project “Delft Meet Regen”
Janssen, J., Bogert, J. M., Gold, M. M., & Vries, S. D. (2025) · Citizen Science Theory and Practice · doi:10.5334/cstp.757
Suksawat, T., & Goerlich, M. (2025) · The EUrASEANs journal on global socio-economic dynamics · doi:10.35678/2539-5645.4(53).2025.151-166
Teachers’ sensemaking of conducting a public lesson in China: through the lens of activity theory
Liang, Y., Yung, B. H. W., & Yip, V. W. Y. (2025) · Asia Pacific Education Review · doi:10.1007/s12564-025-10068-9
(2025) · Oxford University Press eBooks · doi:10.1093/oso/9780197681039.002.0003
Exploring Narrative Imaginations of Physical Activity and Disability Through Story Completion
Williams, T. L. (2025) · Oxford University Press eBooks · doi:10.1093/oso/9780197681039.003.0008
Kelly, K. R. (2025) · Oxford University Press eBooks · doi:10.1093/oso/9780197681039.003.0001
The Adult Attachment Projective Picture System
Aikins, J. W. (2025) · Oxford University Press eBooks · doi:10.1093/oso/9780197681039.003.0009
Narrative Story Stem Methods for Young Children in “Non-Western” Contexts
Wan, M. W. (2025) · Oxford University Press eBooks · doi:10.1093/oso/9780197681039.003.0004
(2025) · Oxford University Press eBooks · doi:10.1093/oso/9780197681039.002.0006
“Tell Me a Story and Make Me a Picture”
Hayfield, N., & Wood, M. (2025) · Oxford University Press eBooks · doi:10.1093/oso/9780197681039.003.0010
Kelly, K. R. (2025) · Oxford University Press eBooks · doi:10.1093/oso/9780197681039.003.0011
Surveying the Use of Story Stems and Symbolic Play Across the Lifespan in Quantitative Research
Bailey, A. L., Ocular, G., & Kelly, K. R. (2025) · Oxford University Press eBooks · doi:10.1093/oso/9780197681039.003.0002
Listen and Lead Story Stem Protocol in a Family Clinic Setting
Robinson, J. L., & Dealy, J. A. (2025) · Oxford University Press eBooks · doi:10.1093/oso/9780197681039.003.0007
Measures of Representations of Relationships
Laible, D., Cortright, C., Agalar, A., Westfall, M., & Piecuch, A. (2025) · Oxford University Press eBooks · doi:10.1093/oso/9780197681039.003.0005
Children’s Internal Representations as Precursors of Behavioral Outcomes
Coe, J. L., Colton, K. C., & Davies, P. T. (2025) · Oxford University Press eBooks · doi:10.1093/oso/9780197681039.003.0006
Age-Related Variations in Using Solitude as a Resource During the COVID-19 Pandemic
Thomas, V., Callahan, M., Smith, J. L., & Azmitia, M. (2025) · Journal of Adult Development · doi:10.1007/s10804-025-09542-w
He, S. (2025) · Teaching and Teacher Education · doi:10.1016/j.tate.2025.105250
Duff, N., Salmon, K., & Macaskill, A. C. (2025) · Applied Cognitive Psychology · doi:10.1002/acp.70126
Khruawan, M., & Watanapokakul, S. (2025) · rEFLections · doi:10.61508/refl.v32i3.285056
Parent-Child Affect, Communication, and Engagement during Everyday Conflict Resolution InteractionsPreprint
Finch, J. E., Parolek, G. E., Bloemker3, M., Votruba, A. M., & Griffin, M. K. (2025) · Research Square · doi:10.21203/rs.3.rs-7490756/v1
Have we remained strangers to English? University Students Views of English as a Foreign Language
Akoluk, E., Çolak, İ., & Rathert, S. (2025) · Education & Youth Research · doi:10.59041/eyor.1609327
McBee‐Black, K., & Wu, J. (2025) · International Journal of Fashion Design Technology and Education · doi:10.1080/17543266.2026.2688313
Examining Self-Event Connections in Adult Outdoor Adventure Education Narratives
Froehly, M., & Warner, R. P. (2025) · Journal of Experiential Education · doi:10.1177/10538259251406244
Karhulahti, V.-M., & Backe, H.-J. (2021) · Figshare · doi:10.6084/m9.figshare.17037603
van Dulmen, S., Roodbeen, R. T. J., Schulze, L., Prantl, K., Rookmaaker, M. B., van Jaarsveld, B. C., Noordman, J., & Abrahams, A. C. (2022) · Figshare · doi:10.6084/m9.figshare.20356492
Wasinger, G. M., & Costabile, K. A. (2026) · Memory · doi:10.1080/09658211.2025.2608353
CATALYST: learner feedback mining with an LLM-based automated thematic analysis
Kong, L., Shin, J., & Antonenko, P. “. (2026) · Interactive Learning Environments · doi:10.1080/10494820.2026.2617988
Liddell, J. L., Griffith, D., Doria, C. M., Buscaglia, A., & Carlson, T. A. (2026) · Sexuality Research and Social Policy · doi:10.1007/s13178-025-01219-z
Agency and Communion in Racial/Ethnic Narratives and Relations With Racial/Ethnic Identity
Westberg, D. W., Chou, E., Jacobson, R., & Syed, M. (2025) · Collabra Psychology · doi:10.1525/collabra.138504
Self-citationHoang, H. Q., Tran, K. T., & Le, T. D. (2026) · Journal of Asia Business Studies · doi:10.1108/jabs-08-2024-0468
Davidson, A. J., Ingram, G., Mann, M., & Espino, I. (2026) · Emerging Adulthood · doi:10.1177/21676968261426032
We are torn apart by various “Truths”
Mahr, D., & Coenen, C. (2026) · SN Social Sciences · doi:10.1007/s43545-026-01365-0
Ho, P., Li, J., & Yao, Y. (2026) · Journal of Personality · doi:10.1111/jopy.70060
Kedek, S., & BOZKURT, B. Ü. (2026) · Dil Eğitimi ve Araştırmaları Dergisi · doi:10.31464/jlere.1864827
Pestilos, C. C., Hill, P. L., Fetterman, A. K., & Damian, R. I. (2026) · Journal of Research in Personality · doi:10.1016/j.jrp.2026.104723
Malagon, J. C. R., Hernández-Arriaga, B., & Rivarola, A. R. R. (2026) · Latino Studies · doi:10.1057/s41276-026-00569-y
Ethnic-Racial Socialization in Arab, Middle Eastern, and North African American Families
Tomei, I., Abouzied, Z., & Raval, V. V. (2026) · Marriage & Family Review · doi:10.1080/01494929.2026.2639485
Sustainable Value Analysis in Sustainable Business Models for the Base of the Pyramid
Méndez‐León, E. (2022) · theses.fr (ABES) · doi:10.70675/3ae7f213z9da7z48bcz8397z7c04eb4b98ae
Kang, R., & Ellis, A. B. (2026) · School Science and Mathematics · doi:10.1111/ssm.70022 · Cited by 1
The Dosage Dilemma: Implementation Evidence on the Barriers to High-Dosage Tutoring
Shmoys, R. J., McCormick, S., Bretas, S., Ready, D. D., Mccarty, G., & Matulewicz, E. (2026) · Educational Research · doi:10.3102/0013189x261437761
Screened but Not Recognized: Cultural Gaps in Elder Abuse Identification in Rural China
Yang, Y., Salari, S., & Yang, R. (2026) · Journal of Applied Gerontology · doi:10.1177/07334648261445691
Biomedical sciences doctoral students guide future trainees in selecting a mentor
Ferguson, C. L., Tripoli, M., & McCartney, M. L. (2026) · Discover Education · doi:10.1007/s44217-026-01584-w
Knopik, T., Tokarska, U., & Żurawska-Żyła, R. (2026) · Educational Gerontology · doi:10.1080/03601277.2026.2664661
Life Narratives and the Ten Aspects of the Big Five Across Open‐Ended and Targeted Prompts
Chou, E., Dittmer, N. I., Westberg, D. W., Udochi, A. L., Rogers, M. A., Holtzman, N. S., Syed, M., & DeYoung, C. G. (2026) · Journal of Personality · doi:10.1111/jopy.70080
Self-citationGiuliani, A., Sharp, T. H., Chideya, Y., Spurgin, K., Meiser‐Stedman, R., Tomlinson, M., & Halligan, S. L. (2026) · Research on Child and Adolescent Psychopathology · doi:10.1007/s10802-026-01469-4
del Río, M., Sharim, D., & Barrientos, J. (2026) · Psychology and Sexuality · doi:10.1080/19419899.2026.2691504
Posttraumatic growth in mothers of children with special needs: exploring experiences in Türkiye
Yazıcı‐Kabadayı, S., & Gülay, A. (2026) · BMC Psychology · doi:10.1186/s40359-026-05028-w
A life worth living: passing on stories of sense of purpose to family
Bluck, S., & Koch, M. K. (2026) · Frontiers in Developmental Psychology · doi:10.3389/fdpys.2026.1847686
Song, S., & Hao, Y. (2026) · Frontiers in Psychology · doi:10.3389/fpsyg.2026.1701414
Reischer, H. N., Fivecoat, H. C., Blum, L., Cunningham, C. N., Ho, S., & Lawrence, E. E. (2026) · Family Process · doi:10.1111/famp.70176
Identity Map: A Step-By-Step Guide to Using Self-Portraits in Identity Research
Sica, L. S. (2026) · Identity · doi:10.1080/15283488.2026.2695600
Graßl, I. (2026) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1145/3786581.3786931
Narrating the Dark Night of the Soul: The Psychosocial Study of Low Point Stories
Jennings, S. C., Siskel, N. P., & McAdams, D. P. (2026) · Journal of Personality · doi:10.1111/jopy.70086
Bridging Research on Autobiographical Memory and Narrative Identity
Camia, C. (2026) · Identity · doi:10.1080/15283488.2026.2702026
Using a Master Narrative Framework to Examine Conversations About Race and Ethnicity
Westberg, D. W., Moffitt, U., McLean, K. C., & Syed, M. (2026) · Journal of Personality · doi:10.1111/jopy.70089
Self-citationTa, V. P., Meca, A., Cruz, B., Swafford, I. M., & Kountakis, V. (2026) · Identity · doi:10.1080/15283488.2026.2702023
A Scoping Review of School Psychology Research on Serving Individuals With Down Syndrome
Zakrzewski, S., & Grapin, S. L. (2026) · Canadian Journal of School Psychology · doi:10.1177/08295735261472969
Kolenatý, M., Winter, V., Činčera, J., & Möller, A. (2026) · Journal of Science Teacher Education · doi:10.1080/1046560x.2026.2713401
Pitt, K. M., Thiessen, A., Fowler, G., & Butler, E. (2026) · American Journal of Speech-Language Pathology · doi:10.1044/2026_ajslp-26-00032
Aftermath Concerns in Legacy Narratives
Bluck, S., & Koch, M. K. (2026) · Oxford University Press eBooks · doi:10.1093/9780197827994.003.0009
Jha, S., Basu, S., & Patnaik, S. (2026) · International Marketing Review · doi:10.1108/imr-03-2025-0154
Wagner, C. (2026) · The Australian Journal of Language and Literacy · doi:10.1007/s44020-026-00125-0
Stanton, A. M., Foley, J. D., McKetchnie, S. M., Hinchey, J., Muten, J., Chai, P. R., Fitch, C., Onofrey, S., Batchelder, A., Psaros, C., et al. (2026) · Culture Health & Sexuality · doi:10.1080/13691058.2026.2724028
Plotting the Whole Story: The Use of Polynomial Regression in Narrative Identity Research
Wasinger, G. M., Costabile, K. A., & Sotola, L. K. (2026) · Identity. An International Journal of Theory and Research · doi:10.1080/15283488.2026.2715510
Teacher Feedback in Beginning and Intermediate Piano Lessons
Blackwell, J., McPherson, G. E., Matherne, N., & Seavello, M. (2026) · Journal of Research in Music Education · doi:10.1177/00224294261472527
Swindle, T., Rutledge, J. M., Rushing, T., Zhang, D., & Curran, G. M. (2026) · Implementation Science · doi:10.1186/s13012-026-01537-9
Mapping the Health Management Journey of Patients With Urostomy: A Qualitative Study
Zhang, L., Wang, Y., Tian, J., Zhang, X., Gao, W., & Tang, C. (2026) · Journal of Clinical Nursing · doi:10.1111/jocn.70541
Othman, R., & Ameer, R. (2026) · Meditari Accountancy Research · doi:10.1108/medar-09-2025-3321
Person, A. I., & Syed, M. (2026) · Advances in Methods and Practices in Psychological Science · doi:10.1177/25152459261474853
Self-citationRelations Between Attachment Security and Life Story Development
Waters, T. E. A., & Lee, Y. (2026) · Applied Cognitive Psychology · doi:10.1002/acp.70288
Haehner, P., & Jennings, S. C. (2026) · Social and Personality Psychology Compass · doi:10.1111/spc3.70178
Sharma, S. K., Conway, T., Humphrey, A. B., & Kenney, M. A. (2026) · Natural Hazards Review · doi:10.1061/nhrefo.nheng-2843
Industry 4.0 and the premises for organizational decision-making: a multi-layer analysis
Fritzsche, A., & Gölzer, P. (2026) · Management Decision · doi:10.1108/md-01-2026-0384
Categories of children’s understandings of function tables and graphs
Strachota, S., Brizuela, B. M., BLANTON, M. L., Gardiner, A. M., & López, M. A. (2026) · Mathematical Thinking and Learning · doi:10.1080/10986065.2026.2745000
Fortin, J., Paquin, A., Leblanc, R., Hamimi, L., & Marin, M. (2026) · European Journal of Psychotraumatology · doi:10.1080/20008066.2026.2739193
Wang, B., Zhang, C., Cai, Y., & Li, Z. (2026) · Behavior Research Methods · doi:10.3758/s13428-026-03212-9
Metadata
- Authors
- Syed, M., & Nelson, S. C.
- Affiliations
- University of Minnesota (US)
- Corresponding author
- Syed, Moin
- Venue
- Emerging Adulthood
- Publisher
- SAGE Publications
- Published
- 2015-05-26
- Volume
- 3
- Issue
- 6
- Pages
- 375-387
- ISSN
- 2167-6968 (ISSN-L)
- 2167-6984
- OpenAlex
- W2232317411
- Cited by
- 801
- References
- 92
- Citations by year
- 2026: 63 · 2025: 83 · 2024: 106 · 2023: 89 · 2022: 117 · 2021: 126 · 2020: 96 · 2019: 62 · 2018: 28 · 2017: 23 · 2016: 7 · 2015: 1
- FWCI
- 17.94
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Emerging Adulthood (publishedVersion)
- OSF Preprints (OSF Preprints) (submittedVersion)
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Reliability and Agreement in Measurement
- Social Sciences › Education › Qualitative Research Methods and Applications
- Social Sciences › General Social Sciences › Computational and Text Analysis Methods
- Keywords
- narrative data, coding reliability, qualitative data analysis, coding practices, mixed methods
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review