The DOI matches its Crossref record; 63 of the 64 references it cites were found in a registry or an index.
Shedding the cobra effect: problematising thematic emergence, triangulation, saturation and member checking
Open accessAbstract
Context: Qualitative research is widely accepted as a legitimate approach to inquiry in health professions education ( HPE ). To secure this status, qualitative researchers have developed a variety of strategies (e.g. reliance on post‐positivist qualitative methodologies, use of different rhetorical techniques, etc.) to facilitate the acceptance of their research methodologies and methods by the HPE community. Although these strategies have supported the acceptance of qualitative research in HPE , they have also brought about some unintended consequences. One of these consequences is that some HPE scholars have begun to use terms in qualitative publications without critically reflecting on: (i) their ontological and epistemological roots; (ii) their definitions, or (iii) their implications. Objectives: In this paper, we share our critical reflections on four qualitative terms popularly used in the HPE literature: thematic emergence; triangulation; saturation, and member checking. Methods: We discuss the methodological origins of these terms and the applications supported by these origins. We reflect critically on how these four terms became expected of qualitative research in HPE , and we reconsider their meanings and use by drawing on the broader qualitative methodology literature. Conclusions: Through this examination, we hope to encourage qualitative scholars in HPE to avoid using qualitative terms uncritically and non‐reflexively.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“In the reviewed articles, for example, authors made reference to concepts, concerns and practices that reflect (post) positivist concerns – and ones which are often entirely normalised within disciplinary contexts.”
In the citing paper
“Luckily, qualitative methodologists have already done a lot of the heavy lifting here (e.g., Braun & Clarke, 2021b;Smith & McGannon, 2018;Varpio et al., 2017Varpio et al., , 2021)), presenting thoughtful considerations of what's assumed and at stake in various supposedly universal criteria.”
From Toward good practice in thematic analysis: Avoiding common problems and be(com)ing a knowing researcher (2023) · cites this paper as Varpio et al., 2017
In the citing paper
“This concept is widely debated, however, and Varpio et al. provides a great description of why information power might be a better concept.6”
From How to … assess the quality of qualitative research (2020) · cites this paper as [6]
In the citing paper
“Varpio et al. further explain how the concepts of triangulation or crystallisation are used as a quality marker in somewhat different ways, depending on the paradigm.6”
From How to … assess the quality of qualitative research (2020) · cites this paper as [6]
Citations
Cites
Wagner, H. R., Glaser, B. G., & Strauss, A. L. (1968) · Social Forces · doi:10.2307/2575405 · Cited by 46,525
Lincoln, Y. S., Guba, E. G., & Pilotta, J. J. (1985) · International Journal of Intercultural Relations · doi:10.1016/0147-1767(85)90062-8 · Cited by 45,787
Tong, A., Sainsbury, P., & Craig, J. (2007) · International Journal for Quality in Health Care · doi:10.1093/intqhc/mzm042 · Cited by 42,509
The Discovery of Grounded Theory; Strategies for Qualitative Research
Glaser, B. G., Strauss, A. L., & Strutzel, E. (1968) · Nursing Research · doi:10.1097/00006199-196807000-00014 · Cited by 39,449
Qualitative Inquiry and Research Design: Choosing Among Five Approaches
Lewis, S. (2015) · Health Promotion Practice · doi:10.1177/1524839915580941 · Cited by 22,105
How Many Interviews Are Enough?: An Experiment with Data Saturation and Variability
Guest, G., Bunce, A., & Johnson, L. (2006) · Field Methods · doi:10.1177/1525822x05279903 · Cited by 20,808
Convergent and discriminant validation by the multitrait-multimethod matrix.
Campbell, D. T., & Fiske, D. W. (1959) · Psychological Bulletin · doi:10.1037/h0046016 · Cited by 17,116
(2014) · Cited by 15,747
Sample Size in Qualitative Interview Studies: Guided by Information Power
Malterud, K., Siersma, V. D., & Guassora, A. D. (2016) · Qualitative Health Research · doi:10.1177/1049732315617444 · Cited by 12,703
Standards for Reporting Qualitative Research: A Synthesis of Recommendations
O’Brien, B. C., Harris, I. B., Beckman, T. J., Reed, D. A., & Cook, D. A. (2014) · Academic Medicine · doi:10.1097/acm.0000000000000388 · Cited by 12,211
Self-citationGrounded theory research: Procedures, canons, and evaluative criteria
Corbin, J. M., & Strauss, A. (1990) · Qualitative Sociology · doi:10.1007/bf00988593 · Cited by 11,133
The SAGE handbook of qualitative research
(2005) · Choice Reviews Online · doi:10.5860/choice.43-1330 · Cited by 10,178
Strategies for ensuring trustworthiness in qualitative research projects
Shenton, A. K. (2004) · Education for Information · doi:10.3233/efi-2004-22201 · Cited by 9,748
(1998) · Cited by 9,332
Ethnography: Principles and Practice
Hammersley, M., & Atkinson, P. (1983) · Cited by 7,730
Introduction: The discipline and practice of qualitative research.
Denzin, N. K., & Lincoln, Y. S. (2005) · Cited by 7,526
(2011) · Cited by 7,157
Paradigmatic Controversies, Contradictions, and Emerging Confluences.
Guba, E. G., & Lincoln, Y. S. (2005) · Cited by 6,640
Qualitative research: standards, challenges, and guidelines
Malterud, K. (2001) · The Lancet · doi:10.1016/s0140-6736(01)05627-6 · Cited by 5,014
Verification strategies for establishing reliability and validity in qualitative research
Morse, J. M., Barrett, M., Mayan, M., Olson, K., & Spiers, J. (2002) · International Journal of Qualitative Methods · doi:10.1177/160940690200100202 · Cited by 4,978
Ethnography: Principles in Practice
Stebbins, R. A., Hammersley, M., & Atkinson, P. (1985) · The Canadian Journal of Sociology · doi:10.2307/3340052 · Cited by 4,082
Qualitative research in health care: Assessing quality in qualitative research
Mays, N. (2000) · BMJ · doi:10.1136/bmj.320.7226.50 · Cited by 3,742
What is an adequate sample size? Operationalising data saturation for theory-based interview studies
Francis, J. J., Johnston, M., Robertson, C., Glidewell, L., Entwistle, V., Eccles, M. P., & Grimshaw, J. M. (2010) · Psychology & Health · doi:10.1080/08870440903194015 · Cited by 3,429
Critical analysis of strategies for determining rigor in qualitative inquiry
Morse, J. M. (2015) · Qualitative Health Research · doi:10.1177/1049732315588501 · Cited by 2,809
Sample Size and Saturation in PhD Studies Using Qualitative Interviews
Mason, M. (2010) · Forum Qualitative Sozialforschung / Forum: Qualitative Social Research · doi:10.17169/fqs-11.3.1428 · Cited by 2,786
Naturalistic inquiry and the saturation concept: a research note
Bowen, G. A. (2008) · Qualitative Research · doi:10.1177/1468794107085301 · Cited by 2,749
Checklists for improving rigour in qualitative research: a case of the tail wagging the dog?
Barbour, R. S. (2001) · BMJ · doi:10.1136/bmj.322.7294.1115 · Cited by 2,613
Getting Personal: Reflexivity, Positionality, and Feminist Research∗
England, K. V. L. (1994) · The Professional Geographer · doi:10.1111/j.0033-0124.1994.00080.x · Cited by 2,075
O’Reilly, M., & Parker, N. (2013) · Qualitative Research · doi:10.1177/1468794112446106 · Cited by 1,943
The conduit metaphor: A case of frame conflict in our language about language
Reddy, M. J. (1993) · Cambridge University Press eBooks · doi:10.1017/cbo9781139173865.012 · Cited by 1,754
Qualitative Research: The essential guide to theory and practice
Savin‐Baden, M., & Major, C. H. (2012) · Cited by 1,642
Does Sample Size Matter in Qualitative Research?: A Review of Qualitative Interviews in is Research
Marshall, B., Cardon, P., Poddar, A., & Fontenot, R. (2013) · Journal of Computer Information Systems · doi:10.1080/08874417.2013.11645667 · Cited by 1,636
The SAGE Dictionary of Qualitative Inquiry
Schwandt, T. A. (2007) · Sage eBooks · doi:10.4135/9781412986281 · Cited by 1,518
Introduction to Qualitative Research
Ellett, M. L. C., & Beausang, C. C. (2002) · Gastroenterology Nursing · doi:10.1097/00001610-200201000-00004 · Cited by 1,295
Evaluating Interpretive Inquiry: Reviewing the Validity Debate and Opening the Dialogue
Angen, M. (2000) · Qualitative Health Research · doi:10.1177/104973230001000308 · Cited by 1,150
(1999) · Cited by 1,140
Morse, J. M. (2015) · Qualitative Health Research · doi:10.1177/1049732315576699 · Cited by 821
Critically appraising qualitative research
Kuper, A., Lingard, L., & Levinson, W. (2008) · BMJ · doi:10.1136/bmj.a1035 · Cited by 784
On Writing Qualitative Research: Living by Words
Ely, M., Vinz, R., Downing, M., & Anzul, M. (1998) · College Composition and Communication · doi:10.2307/358568 · Cited by 773
Baker, S., & Edwards, R. (2018) · University of Brighton Repository (University of Brighton) · doi:10.25905/5bfdc2c62d9dc · Cited by 671
Power Relations in Qualitative Research
Karnieli‐Miller, O., Strier, R., & Pessach, L. (2008) · Qualitative Health Research · doi:10.1177/1049732308329306 · Cited by 643
Language Socialization into Academic Discourse Communities
Duff, P. A. (2010) · Annual Review of Applied Linguistics · doi:10.1017/s0267190510000048 · Cited by 614
Grounded theory in medical education research: AMEE Guide No. 70
Watling, C., & Lingard, L. (2012) · Medical Teacher · doi:10.3109/0142159x.2012.704439 · Cited by 600
Narrative Turn or Blind Alley?
Atkinson, P. (1997) · Qualitative Health Research · doi:10.1177/104973239700700302 · Cited by 533
"Emergence" vs. "Forcing" of Empirical Data? A Crucial Problem of "Grounded Theory" Reconsidered
Kelle, U. (2005) · Forum Qualitative Sozialforschung / Forum: Qualitative Social Research · doi:10.17169/fqs-6.2.467 · Cited by 416
(2002) · Journal of the Association for Information Systems · Cited by 366
“Isms” in information science: constructivism, collectivism and constructionism
Talja, S., Tuominen, K., & Savolainen, R. (2005) · Journal of Documentation · doi:10.1108/00220410510578023 · Cited by 364
Appraising qualitative research articles in medicine and medical education
Côté, L., & Turgeon, J. (2005) · Medical Teacher · doi:10.1080/01421590400016308 · Cited by 312
Goldblatt, H., Karnieli‐Miller, O., & Neumann, M. (2011) · Patient Education and Counseling · doi:10.1016/j.pec.2010.12.016 · Cited by 209
Wray, N., Marković, M., & Manderson, L. H. (2007) · Qualitative Health Research · doi:10.1177/1049732307308308 · Cited by 195
Redefining Qualitative Methods: Believability in the Fifth Moment
Lewis, J. A. (2009) · International Journal of Qualitative Methods · doi:10.1177/160940690900800201 · Cited by 192
OʼBrien, B. C., Cooke, M., & Irby, D. M. (2007) · Academic Medicine · doi:10.1097/acm.0b013e31814a4fd5 · Cited by 186
Self-citationSampling Richness and Qualitative Integrity: Challenges for Research With Families
Roy, K., Zvonkovic, A., Goldberg, A., Sharp, E., & LaRossa, R. (2015) · Journal of Marriage and Family · doi:10.1111/jomf.12147 · Cited by 180
A guide and glossary on postpositivist theory building for population health
Carpiano, R. M., & Daley, D. M. (2006) · Journal of Epidemiology & Community Health · doi:10.1136/jech.2004.031534 · Cited by 167
Grounded Theory in Medical Education Research
Tavakol, M., Torabi, S., & Zeinaloo, A. A. (2006) · Medical Education Online · doi:10.3402/meo.v11i.4607 · Cited by 143
Learning to Reason: A Journey of Professional Socialisation
Ajjawi, R., & Higgs, J. (2008) · Advances in Health Sciences Education · doi:10.1007/s10459-006-9032-4 · Cited by 137
Self-citationRees, C. E., & Shepherd, M. H. (2004) · Medical Education · doi:10.1111/j.1365-2929.2004.02030.x · Cited by 105
Self-citationEmerging Themes: The Researcher’s Experience
Tesch, R. (1987) · Phenomenology + Pedagogy · doi:10.29173/pandp15058 · Cited by 89
Public Sources of the Personal Mind
Harré, R. (2002) · Theory & Psychology · doi:10.1177/0959354302012005895 · Cited by 72
Qualitative research methodologies: embracing methodological borrowing, shifting and importing
Varpio, L., Martimianakis, M., & Mylopoulos, M. (2015) · Wiley eBooks · doi:10.1002/9781118838983.ch21 · Cited by 59
Self-citationVarpio, L., Schryer, C. F., & Lingard, L. (2009) · Medical Education · doi:10.1111/j.1365-2923.2009.03395.x · Cited by 45
Self-citationTechniques for the study of learning in animals: Analysis and classification.
Bitterman, M. E. (1962) · Psychological Bulletin · doi:10.1037/h0044431 · Cited by 26
Monrouxe, L. V. (2006) · Medical Humanities · doi:10.1136/jmh.2006.000238 · Cited by 18
Self-citation
Flagged first, then by citations
1 of the 64 references couldn’t be matched to a known paper.
Research works printed but not linked: 4
- Association of American Medical Colleges, 2015, Academic Medicine's Reviewer Guidebook: Review Criteria for Research Manuscripts
- Webb EJ, 1966, Unobtrusive Measures: Nonreactive Measures in the Social Sciences
- Lincoln YS, 2011, The Sage Handbook of Qualitative Research, 191
- Guba E, 1990, The Paradigm Dialogue
Cited by
Sorted by citations
Thematic analysis of qualitative data: AMEE Guide No. 131
Kiger, M. E., & Varpio, L. (2020) · Medical Teacher · doi:10.1080/0142159x.2020.1755030 · Cited by 3,787
Self-citationBraun, V., & Clarke, V. (2023) · International Journal of Transgender Health · doi:10.1080/26895269.2022.2129597 · Cited by 2,878
A practical guide to reflexivity in qualitative research: AMEE Guide No. 149.
Olmos-Vega, F. M., Stalmeijer, R. E., Varpio, L., & Kahlke, R. (2023) · Medical Teacher · doi:10.1080/0142159x.2022.2057287 · Cited by 2,014
Self-citationTwelve tips for conducting qualitative research interviews
McGrath, C., Palmgren, P. J., & Liljedahl, M. (2018) · Medical Teacher · doi:10.1080/0142159x.2018.1497149 · Cited by 898
Braun, V., & Clarke, V. (2024) · Palliative Medicine · doi:10.1177/02692163241234800 · Cited by 954
“29,30 For example, some described ‘small samples’ or a lack of (statistical) generalisability as limitations of the research; some described saturation as a criterion for stopping data generation (unsurprisingly perhaps, as saturation is widely advocated for and referenced in both COREQ and SRQR;…”
Background
Metadata
- Authors
- Varpio, L., Ajjawi, R., Monrouxe, L. V., O'Brien, B. C., & Rees, C. E.
- Affiliations
- Uniformed Services University of the Health Sciences (US)
- Deakin University (AU)
- Chang Gung Memorial Hospital (TW)
- Department of Medicine University of California San Francisco San Francisco California USA
- Monash University (AU)
- Corresponding author
- Varpio, Lara
- Venue
- Medical Education
- Publisher
- Wiley
- Published
- 2016-12-16
- Volume
- 51
- Issue
- 1
- Pages
- 40-50
- ISSN
- 0308-0110 (ISSN-L)
- 1365-2923
- OpenAlex
- W2562778769
- Semantic Scholar
- f6cc49a0d5ae5b26dadfdbc5c52c7ebf8dea5908
- Cited by
- 1,028
- References
- 64
- Citations by year
- 2026: 146 · 2025: 169 · 2024: 167 · 2023: 138 · 2022: 137 · 2021: 108 · 2020: 59 · 2019: 44 · 2018: 41 · 2017: 16 · 2016: 2
- FWCI
- 152.39
- Type
- journal article
- Language
- en
- Open access
- green
- figshare.com
- Locations
- Medical Education (publishedVersion)
- PubMed (publishedVersion)
- Figshare (submittedVersion, cc-by)
- NOVA (University of Newcastle Australia) (submittedVersion)
- Topics
- Social Sciences › Education › Qualitative Research Methods and Applications
- Social Sciences › Education › Innovations in Medical Education
- Social Sciences › Sociology and Political Science › Qualitative Research Methods and Ethics
- Keywords
- qualitative research methodology, health professions education, triangulation, saturation, member checking, reflexivity, ontological and epistemological assumptions, research legitimacy
- MeSH terms
- Health Occupations, Humans, Research Design, Qualitative Research
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review