The DOI matches its Crossref record; 38 of the 38 references it cites were found in a registry or an index.
Assessing and demonstrating data saturation in qualitative inquiry supporting patient-reported outcomes research
Abstract
In the patient-reported outcomes (PROs) field, strict regulatory requirements must be met for qualitative research that contributes to labeling claims for medicinal products. These requirements not only emphasize the importance of reaching saturation but also of providing documentary evidence that saturation has been reached. This paper reviews qualitative literature for useful definitions of the concept and for practical approaches for assessing saturation. The paper considers approaches in light of the rigorous regulatory requirements for PRO research that are used to support labeling claims for medicinal products and the wider requirements for flexibility and creativity in qualitative research in general. This assessment is facilitated by the use of examples from our past qualitative PRO studies. Based on conclusions from this assessment, we offer preliminary recommendations for future qualitative PRO studies for assessing and documenting saturation.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Using thematic analysis in psychology
Braun, V., & Clarke, V. (2006) · Qualitative Research in Psychology · doi:10.1191/1478088706qp063oa · Cited by 194,414
The Discovery of Grounded Theory; Strategies for Qualitative Research
Glaser, B. G., Strauss, A. L., & Strutzel, E. (1968) · Nursing Research · doi:10.1097/00006199-196807000-00014 · Cited by 39,449
The Discovery of Grounded Theory: Strategies for Qualitative Research
Glaser, B. G., & Strauss, A. L. (2017) · Aldine (Routledge reprint) · doi:10.4324/9780203793206 · Cited by 25,789
How Many Interviews Are Enough?: An Experiment with Data Saturation and Variability
Guest, G., Bunce, A., & Johnson, L. (2006) · Field Methods · doi:10.1177/1525822x05279903 · Cited by 20,808
Wild, D., Grove, A., Martin, M., Eremenco, S., McElroy, S., Verjee-Lorenz, A., & Erikson, P. (2005) · Value in Health · doi:10.1111/j.1524-4733.2005.04054.x · Cited by 5,521
Self-citationVerification strategies for establishing reliability and validity in qualitative research
Morse, J. M., Barrett, M., Mayan, M., Olson, K., & Spiers, J. (2002) · International Journal of Qualitative Methods · doi:10.1177/160940690200100202 · Cited by 4,978
Sample size in qualitative research
Sandelowski, M. (1995) · Research in Nursing & Health · doi:10.1002/nur.4770180211 · Cited by 4,372
Qualitative Psychology: A Practical Guide to Research Methods
(2008) · QMiP Bulletin · doi:10.53841/bpsqmip.2008.1.6.47 · Cited by 4,351
Sampling for qualitative research
Marshall, M. N. (1996) · Family Practice · doi:10.1093/fampra/13.6.522 · Cited by 4,293
Morse, J. M. (2000) · Qualitative Health Research · doi:10.1177/104973200129118183 · Cited by 3,215
U.S. Department of Health and Human Services FDA Center for Drug Evaluation and Research, U.S. Department of Health and Human Services FDA Center for Biologics Evaluation and Research, & U.S. Department of Health and Human Services FDA Center for Devices and Radiological Health (2006) · Health and Quality of Life Outcomes · doi:10.1186/1477-7525-4-79 · Cited by 2,856
Naturalistic inquiry and the saturation concept: a research note
Bowen, G. A. (2008) · Qualitative Research · doi:10.1177/1468794107085301 · Cited by 2,749
The Significance of Saturation
Morse, J. M. (1995) · Qualitative Health Research · doi:10.1177/104973239500500201 · Cited by 2,663
Dilemmas in qualitative health research
Yardley, L. (2000) · Psychology & Health · doi:10.1080/08870440008400302 · Cited by 2,310
Validity in qualitative research
Whittemore, R., Chase, S. K., & Mandle, C. L. (2001) · Qualitative Health Research · doi:10.1177/104973201129119299 · Cited by 2,144
Book Review: Conversation is a lot more than just talk
McGrath, J. E. (2005) · Experimental Psychology · doi:10.1027/1618-3169.52.1.80 · Cited by 2,022
Codebook Development for Team-Based Qualitative Analysis
MacQueen, K. M., McLellan, E., Kay, K., & Milstein, B. (1998) · CAM Journal · doi:10.1177/1525822x980100020301 · Cited by 1,675
‘Clear as Mud’: Toward Greater Clarity in Generic Qualitative Research
Caelli, K., Ray, L., & Mill, J. (2003) · International Journal of Qualitative Methods · doi:10.1177/160940690300200201 · Cited by 1,256
Strategies for Qualitative Research
Glaser, B. G. (1967) · Medical Entomology and Zoology · Cited by 971
Qualitative research and content validity: developing best practices based on science and experience
Brod, M., Tesler, L. E., & Christensen, T. L. (2009) · Quality of Life Research · doi:10.1007/s11136-009-9540-9 · Cited by 935
Research Methods for Clinical and Health Psychology
Marks, D., & Yardley, L. (2004) · SAGE Publications Ltd eBooks · doi:10.4135/9781849209793 · Cited by 901
A Call for Qualitative Power Analyses
Onwuegbuzie, A. J., & Leech, N. L. (2007) · Quality & Quantity · doi:10.1007/s11135-005-1098-1 · Cited by 829
Patient-Reported Outcomes to Support Medical Product Labeling Claims: FDA Perspective
Patrick, D. L., Burke, L. B., Powers, J. H., Scott, J. A., Rock, E. P., Dawisha, S., O'Neill, R., & Kennedy, D. L. (2007) · Value in Health · doi:10.1111/j.1524-4733.2007.00275.x · Cited by 726
Demonstrating Validity in Qualitative Psychology
Yardley, L. (2024) · Qualitative Psychology: A Practical Guide to Research Methods · doi:10.4135/9781036232764.n12 · Cited by 658
The SAGE handbook of qualitative research in psychology
(2009) · Choice Reviews Online · doi:10.5860/choice.46-4720 · Cited by 546
Coons, S. J., Gwaltney, C. J., Hays, R. D., Lundy, J. J., Sloan, J. A., Revicki, D. A., Lenderking, W. R., Cella, D., & Basch, E. (2009) · Value in Health · doi:10.1111/j.1524-4733.2008.00470.x · Cited by 537
Rothman, M., Burke, L., Erickson, P., Leidy, N. K., Patrick, D. L., & Petrie, C. D. (2009) · Value in Health · doi:10.1111/j.1524-4733.2009.00603.x · Cited by 435
Quality of Life Research: A Critical Introduction
Rapley, M. (2003) · Cited by 292
Qualitative Data Analysis Software
(2002) · Handbook of Research Design & Social Measurement · doi:10.4135/9781412984386.n38 · Cited by 242
Patient-Reported Outcomes: Conceptual Issues
Rothman, M. L., Beltran, P., Cappelleri, J. C., Lipscomb, J., & Teschendorf, B. (2007) · Value in Health · doi:10.1111/j.1524-4733.2007.00269.x · Cited by 221
Leidy, N. K., & Vernon, M. (2008) · PharmacoEconomics · doi:10.2165/00019053-200826050-00002 · Cited by 204
Patient-Reported Outcomes: Instrument Development and Selection Issues
Turner, R. R., Quittner, A. L., Parasuraman, B. M., Kallich, J. D., & Cleeland, C. S. (2007) · Value in Health · doi:10.1111/j.1524-4733.2007.00271.x · Cited by 165
Qualitative Data Collection: Interviews and Focus Groups
Marks, D. F., & Yardley, L. (2004) · SAGE Publications Ltd eBooks · doi:10.4135/9781849209793.n3 · Cited by 147
Mixing Qualitative and Quantitative Methods: A Pragmatic Approach
Yardley, L., & Bishop, F. L. (2008) · SAGE Publications Ltd eBooks · doi:10.4135/9781848607927.n20 · Cited by 116
Burke, L., Dl, K., Miskala, P., Papadopoulos, E., & Trentacosti, A. M. (2008) · Clinical Pharmacology & Therapeutics · doi:10.1038/clpt.2008.128 · Cited by 87
Gallop, K., Wild, D., Verdian, L., Kerr, M., Jacoby, A., Baker, G., Nixon, A., & Cramer, J. A. (2010) · Seizure · doi:10.1016/j.seizure.2009.10.007 · Cited by 65
Self-citationAdair, C. E., Marcoux, G., Williams, A., & Reimer, M. A. (2006) · Qualitative Health Research · doi:10.1177/1049732305285850 · Cited by 25
Silent Debates in Qualitative Inquiry
Morse, J. M. (1999) · Qualitative Health Research · doi:10.1177/104973299129121730 · Cited by 12
Cited by
Sample sizes for saturation in qualitative research: A systematic review of empirical tests
Hennink, M., & Kaiser, B. N. (2022) · Social Science & Medicine · doi:10.1016/j.socscimed.2021.114523 · Cited by 6,311
Braun, V., & Clarke, V. (2021) · Qualitative Research in Sport, Exercise and Health · doi:10.1080/2159676x.2019.1704846 · Cited by 4,776
Code Saturation Versus Meaning Saturation: How Many Interviews Are Enough?
Hennink, M. M., Kaiser, B. N., & Marconi, V. C. (2017) · Qualitative Health Research · doi:10.1177/1049732316665344 · Cited by 4,597
“Most sample size recommendations for qualitative research are thus experiential or “rules of thumb” (Bryman, 2012; Guest et al., 2006; Kerr et al., 2010; Morse, 1995; Sandelowski, 1995).”
BackgroundInfluentialAre We There Yet? Data Saturation in Qualitative Research
Fusch, P., & Ness, L. (2015) · The Qualitative Report · doi:10.46743/2160-3715/2015.2281 · Cited by 4,460
Vasileiou, K., Barnett, J., Thorpe, S., & Young, T. (2018) · BMC Medical Research Methodology · doi:10.1186/s12874-018-0594-7 · Cited by 3,115
Metadata
- Authors
- Kerr, C., Nixon, A., & Wild, D.
- Venue
- Expert Review of Pharmacoeconomics & Outcomes Research
- Publisher
- Informa UK Limited
- Published
- 2010-06
- Volume
- 10
- Issue
- 3
- Pages
- 269-281
- ISSN
- 1473-7167 (ISSN-L)
- 1744-8379
- OpenAlex
- W2149395822
- Cited by
- 551
- References
- 38
- FWCI
- 25.31
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.