A team-based approach to open coding: considerations for creating intercoder consensus
Abstract
In this article, we discuss methodological opportunities related to using a team-based approach for iterative-inductive analysis of qualitative data involving detailed open coding of semistructured interviews and focus groups. Iterative-inductive methods generate rich thematic analyses useful in sociology, anthropology, public health, and many other applied fields. A team-based approach to analyzing qualitative data increases confidence in dependability and trustworthiness, facilitates analysis of large data sets, and supports collaborative and participatory research by including diverse stakeholders in the analytic process. However, it can be difficult to reach consensus when coding with multiple coders. We report on one approach for creating consensus when open coding within an iterative-inductive analytical strategy. The strategy described may be used in a variety of settings to foster efficient and credible analysis of larger qualitative data sets, particularly useful in applied research settings where rapid results are often required.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The coding process used a consensus-based inter-coding approach, with two authors coding the data and two more researchers checking codes and ratings, and discrepancies resolved through discussion until agreement was achieved.
“First, two authors coded the data and scored each reflection on whether they demonstrated the code's process/learning/capability to a low, medium or high level.Then these codes and ratings were checked by two more researchers and if there were any discrepancies in interpretations, the research team discussed, using a consensus-based intercoding process, until agreement was achieved.”
From Mastering knowledge: the impact of generative AI on student learning outcomes (2026) · cites this paper as Cascio et al. 2019
Ensuring rigor and consistency of coding procedures is core to meeting validity and reliability standards in qualitative research.
“The core of the coding process lies in ensuring the rigor and consistency of the coding procedures, to meet the standards of validity and reliability in qualitative research (41).”
From Caring alone: older adult care burdens, practices, and structural imbalances among China's one-child generation (2025) · cites this paper as [41]
All coding steps involved consensus among all 3 coders, eliminating the need for quantitative intercoder reliability calculations.
“All coding steps involved consensus among all 3 coders, eliminating the need for quantitative intercoder reliability calculations [45].”
Cites
Qualitative Inquiry and Research Design: Choosing Among Five Approaches
Lewis, S. (2015) · Health Promotion Practice · doi:10.1177/1524839915580941 · Cited by 22,105 · see citing works
(2014) · Cited by 15,747 · see citing works
(1998) · Cited by 13,501 · see citing works
Research Design: Qualitative, Quantitative, and Mixed Methods Approaches
ภู่พันธ์, ศ. (2018) · วารสารวิธีวิทยาการวิจัย (Journal of Research Methodology: JRM) · Cited by 12,777 · see citing works
Basics of Qualitative Research: Techniques and Procedures for Developing Grounded Theory
Wuetherick, B. (2010) · Canadian Journal of University Continuing Education · doi:10.21225/d5g01t · Cited by 8,327 · see citing works
Rigor in Qualitative Research: The Assessment of Trustworthiness
Krefting, L. (1991) · American Journal of Occupational Therapy · doi:10.5014/ajot.45.3.214 · Cited by 4,174 · see citing works
Content Analysis in Mass Communication: Assessment and Reporting of Intercoder Reliability
Lombard, M., Snyder-Duch, J., & Bracken, C. C. (2002) · Human Communication Research · doi:10.1111/j.1468-2958.2002.tb00826.x · Cited by 3,068 · see citing works
Campbell, J. L., Quincy, C., Osserman, J., & Pedersen, O. K. (2013) · Sociological Methods & Research · doi:10.1177/0049124113500475 · Cited by 2,974 · see citing works
Analyzing Qualitative Data: Systematic Approaches
Bernard, H. R., & Ryan, G. W. (2009) · Cited by 2,373 · see citing works
Wandersman, A., Duffy, J., Flaspohler, P., Noonan, R., Lubell, K., Stillman, L., Blachman, M., Dunville, R., & Saul, J. (2008) · American Journal of Community Psychology · doi:10.1007/s10464-008-9174-z · Cited by 1,339 · see citing works
Reliability in content analysis: some common misconceptions and recommendations.
Krippendorff, K. (2004) · Human Communication Research · doi:10.1093/hcr/30.3.411 · Cited by 1,027 · see citing works
The Place of Inter-Rater Reliability in Qualitative Research: An Empirical Study
Armstrong, D., Gosling, A., Weinman, J., & Marteau, T. (1997) · Sociology · doi:10.1177/0038038597031003015 · Cited by 1,008 · see citing works
Reliability in Coding Open-Ended Data: Lessons Learned from HIV Behavioral Research
Hruschka, D. J., Schwartz, D., St.John, D. C., Picone-Decaro, E., Jenkins, R. A., & Carey, J. W. (2004) · Field Methods · doi:10.1177/1525822x04266540 · Cited by 829 · see citing works
Educational Technology Research and Development
(2013) · Educational Technology Research and Development · doi:10.1007/11423.1556-6501 · Cited by 789 · see citing works
Burla, L., Knierim, B., Barth, J., Liewald, K., Duetz, M. S., & Abel, T. (2008) · Nursing Research · doi:10.1097/01.nnr.0000313482.33917.7d · Cited by 702 · see citing works
Intercoder Reliability for Validating Conclusions Drawn from Open-Ended Interview Data
Kurasaki, K. S. (2000) · Field Methods · doi:10.1177/1525822x0001200301 · Cited by 462 · see citing works
O’Reilly, K. (2004) · Routledge eBooks · doi:10.4324/9780203320068 · Cited by 211 · see citing works
Essential ethnographic methods : a mixed methods approach
Schensul, J. J., & LeCompte, M. D. (2013) · Cited by 188 · see citing works
Trotter, R. T., Needle, R. H., Goosby, E., Bates, C. J., & Singer, M. C. (2001) · Field Methods · doi:10.1177/1525822x0101300202 · Cited by 145 · see citing works
Developing a codebook to guide content analysis of expressive writing transcripts
Fonteyn, M. E., Vettese, M., Lancaster, D. R., & Bauer‐Wu, S. (2008) · Applied Nursing Research · doi:10.1016/j.apnr.2006.08.005 · Cited by 134 · see citing works
Addressing some Common Problems in Transcript Analysis
Fahy, P. J. (2001) · The International Review of Research in Open and Distributed Learning · doi:10.19173/irrodl.v1i2.321 · Cited by 124 · see citing works
COMMUNITY READINESS AND PREVENTION PROGRAMS
Donnermeyer, J. F., Plested, B., Edwards, R. W., Oetting, G., & Littlethunder, L. (1997) · Community Development · doi:10.1080/15575339709489795 · Cited by 107 · see citing works
Lu, C.-J., & Shulman, S. W. (2008) · International Journal of Multiple Research Approaches · doi:10.5172/mra.455.2.1.105 · Cited by 95 · see citing works
Ryan, G. W. (1999) · Human Organization · doi:10.17730/humo.58.3.g224147522545rln · Cited by 93 · see citing works
Assessment of Interjudge Reliability in the Open-Ended Questions Coding Process
Muñoz‐Leiva, F., Montoro-Ríos, F. J., & Martínez, T. L. (2006) · Quality & Quantity · doi:10.1007/s11135-005-1093-6 · Cited by 82 · see citing works
Application of the Community Readiness Model for Childhood Obesity Prevention
Findholt, N. E. (2007) · Public Health Nursing · doi:10.1111/j.1525-1446.2007.00669.x · Cited by 80 · see citing works
Increasing the visibility of coding decisions in team-based qualitative research in nursing
Thompson, C. A., McCaughan, D., Cullum, N. A., Sheldon, T., & Raynor, P. (2003) · International Journal of Nursing Studies · doi:10.1016/j.ijnurstu.2003.03.001 · Cited by 70 · see citing works
Some views on agreement to be used in content analysis studies
Popping, R. (2009) · Quality & Quantity · doi:10.1007/s11135-009-9258-3 · Cited by 65 · see citing works
Bringing Rigour in Qualitative Social Research: The Use of a CAQDAS
Rambaree, K. (2007) · DiVA (University of Gävle) · Cited by 46 · see citing works
Assessing Readiness for Establishing a Farmers’ Market at a Community Health Center
Freedman, D. A., Whiteside, Y. O., Brandt, H. M., Young, V., Friedman, D. B., & Hébert, J. R. (2011) · Journal of Community Health · doi:10.1007/s10900-011-9419-x · Cited by 39 · see citing works
Self-citationCoding Issues in Modality Analysis
Popping, R., & Roberts, C. W. (2009) · Field Methods · doi:10.1177/1525822x09333433 · Cited by 26 · see citing works
Consensus modeling to develop the farmers’ market readiness assessment and decision instrument
Lee, E., Dalton, J. E., Ngendahimana, D., Bebo, P., Davis, A., Remley, D. T., Smathers, C. A., & Freedman, D. A. (2017) · Translational Behavioral Medicine · doi:10.1007/s13142-017-0504-2 · Cited by 14 · see citing works
Self-citationChapter 2 Qualitative Methodological Approach
Haley, D. F., Vo, L., Parker, K. A., et al. (2016) · Springer eBooks · doi:10.1007/978-3-319-43833-7_2 · Cited by 2 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
Inter-Coder Agreement in Qualitative Coding: Considerations for its Use
Halpin, S. N. (2024) · American Journal of Qualitative Research · doi:10.29333/ajqr/14887 · Cited by 149 · see citing works
Moy, A. J., Hobensack, M., Marshall, K., Vawdrey, D. K., Kim, E. Y., Cato, K. D., & Rossetti, S. C. (2023) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocad038 · Cited by 98 · see citing works
Mastering knowledge: the impact of generative AI on student learning outcomes
Pallant, J. L., Blijlevens, J., Campbell, A., & Jopp, R. (2026) · Studies in Higher Education · doi:10.1080/03075079.2025.2487570 · Cited by 94 · see citing works
Artificial Intelligence Integration: Pedagogical Strategies and Policies at Leading Universities
Alqahtani, N., & Wafula, Z. (2025) · Innovative Higher Education · doi:10.1007/s10755-024-09749-x · Cited by 84 · see citing works
Xiang, S., Xiang, H., Ren, Q., & Deng, Q. (2025) · Frontiers in Public Health · doi:10.3389/fpubh.2025.1694636 · Cited by 6 · see citing works
Kim, M., Jeon, M., Lee, Y., Lee, S., Kim, H., & Jung, D. (2025) · Journal of Medical Internet Research · doi:10.2196/81803
- Authors
- Cascio, M. A., Lee, E., Vaudrin, N., & Freedman, D. A.
- Affiliations
- Montreal Clinical Research Institute (CA)
- Case Western Reserve University (US)
- Independent Scholar, Phoenix, AZ, USA
- Corresponding author
- Cascio, M. Ariel
- Venue
- Field Methods
- Publisher
- SAGE Publications
- Published
- 2019-03-27
- Volume
- 31
- Issue
- 2
- Pages
- 116-130
- ISSN
- 1064-8631 (ISSN-L)
- 1525-822X
- 1552-3969
- OpenAlex
- W2929139003
- Cited by
- 492
- References
- 33
- Citations by year
- 2026: 115 · 2025: 91 · 2024: 99 · 2023: 80 · 2022: 63 · 2021: 37 · 2020: 5 · 2019: 2
- FWCI
- 72.23
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Field Methods (publishedVersion)
- Funders
- U.S. Department of Agriculture
- Central Michigan University
- Centers for Disease Control and Prevention
- Topics
- Social Sciences › Education › Qualitative Research Methods and Applications
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Reliability and Agreement in Measurement
- Social Sciences › Sociology and Political Science › Focus Groups and Qualitative Methods
- Keywords
- open coding, qualitative data analysis, semi-structured interviews, focus groups, research collaboration, stakeholder engagement, large data sets
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
