The DOI matches its Crossref record; 34 of the 34 references it cites were found in a registry or an index.
Preregistering qualitative research
Open accessAbstract
The threat to reproducibility and awareness of current rates of research misbehavior sparked initiatives to better academic science. One initiative is preregistration of quantitative research. We investigate whether the preregistration format could also be used to boost the credibility of qualitative research. A crucial distinction underlying preregistration is that between prediction and postdiction. In qualitative research, data are used to decide which way interpretation should move forward, using data to generate hypotheses and new research questions. Qualitative research is thus a real-life example of postdiction research. Some may object to the idea of preregistering qualitative studies because qualitative research generally does not test hypotheses, and because qualitative research design is typically flexible and subjective. We rebut these objections, arguing that making hypotheses explicit is just one feature of preregistration, that flexibility can be tracked using preregistration, and that preregistration would provide a check on subjectivity. We then contextualize preregistrations alongside another initiative to enhance credibility in qualitative research: the confirmability audit. Besides, preregistering qualitative studies is practically useful to combating dissemination bias and could incentivize qualitative researchers to report constantly on their study's development. We conclude with suggested modifications to the Open Science Framework preregistration form to tailor it for qualitative studies.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Qualitative Data Analysis: An Expanded Sourcebook
(1994) · Journal of Environmental Psychology · doi:10.1016/s0272-4944(05)80231-2 · Cited by 48,420
The Discovery of Grounded Theory: Strategies for Qualitative Research.
Wagner, H. R., Glaser, B. G., & Strauss, A. L. (1968) · Social Forces · doi:10.2307/2575405 · Cited by 46,361
Lincoln, Y. S., Guba, E. G., & Pilotta, J. J. (1985) · International Journal of Intercultural Relations · doi:10.1016/0147-1767(85)90062-8 · Cited by 45,787
Handbook of Qualitative Research
Crozier, G., Denzin, N., & Lincoln, Y. (1994) · British Journal of Educational Studies · doi:10.2307/3121684 · Cited by 26,666
(2013) · Cited by 12,072
Qualitative research practice: a guide for social science students and researchers
(2003) · Choice Reviews Online · doi:10.5860/choice.41-1319 · Cited by 10,543
Why Most Published Research Findings Are False
Ioannidis, J. P. A. (2005) · PLoS Medicine · doi:10.1371/journal.pmed.0020124 · Cited by 10,505
Handbook of qualitative research
Griffin, T. F. (1999) · Psychology and Marketing · doi:10.1002/(sici)1520-6793(199907)16:4<371::aid-mar7>3.0.co;2-k · Cited by 9,037
Why Most Published Research Findings Are False
Ioannidis, J. P. A. (2005) · CHANCE · doi:10.1080/09332480.2005.10722754 · Cited by 4,702
A manifesto for reproducible science
Munafò, M. R., Nosek, B. A., Bishop, D. V. M., Button, K. S., Chambers, C. D., Percie du Sert, N., Simonsohn, U., Wagenmakers, E.-J., Ware, J. J., & Ioannidis, J. P. A. (2017) · Nature Human Behaviour · doi:10.1038/s41562-016-0021 · Cited by 3,397
Promoting an open research culture
Nosek, B. A., Alter, G., Banks, G. C., Borsboom, D., Bowman, S. D., Breckler, S. J., Buck, S., Chambers, C. D., Chin, G., Christensen, G., et al. (2015) · Science · doi:10.1126/science.aab2374 · Cited by 2,708 · cited 1×
“More and more journals and editors across fields encourage preregistration of quantitative studies (Nosek et al. 2015).”
BackgroundThe Enlightened Eye: Qualitative Inquiry and the Enhancement of Educational Practice
Gray, J., & Eisner, E. W. (1994) · Studies in Art Education · doi:10.2307/1320828 · Cited by 2,469
The preregistration revolution
Nosek, B. A., Ebersole, C. R., DeHaven, A. C., & Mellor, D. T. (2018) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1708274114 · Cited by 1,998 · cited 8×
“Preregistrations are said to be helpful to both the scientist and the scientific field (Nosek et al. 2018).”
BackgroundInfluentialFanelli, D. (2009) · PLoS ONE · doi:10.1371/journal.pone.0005738 · Cited by 1,911 · cited 1×
“First, researchers don ’ t always behave as they should; researchers even admit to engaging in research misbehaviours that range from fabrication of data to leaving out outliers without a valid reason to do so (Martinson, Anderson, and de Vries 2005; Fanelli 2009).”
BackgroundQualitative Research Practice : A Guide for Social Science Students and Researchers
อรุณภาคย์, ก. (2012) · Journal of Social Sciences and Humanities Kasetsart University · Cited by 1,779
Encyclopedia of Case Study Research
Mills, A., Durepos, G., & Wiebe, E. (2010) · doi:10.4135/9781412957397 · Cited by 1,235
Martinson, B. C., Anderson, M. S., & de Vries, R. (2005) · Nature · doi:10.1038/435737a · Cited by 1,096
Hierarchy of evidence: a framework for ranking evidence evaluating healthcare interventions
Evans, D. (2003) · Journal of Clinical Nursing · doi:10.1046/j.1365-2702.2003.00662.x · Cited by 993 · cited 1×
“In this debate, qualitative research is grouped among the weaker forms of evidence, together with consensus and opinion (Grypdonck 2006; Evans 2003).”
BackgroundThe enlightened eye qualitative inquiry and the enhancement of educational practice
Eisner, E. W. (1998) · Cited by 595
The Rise of Anthropological Theory: A History of Theories of Culture.
Gillin, J. P., & Harris, M. (1969) · American Sociological Review · doi:10.2307/2095998 · Cited by 519
Humphreys, M., Sanchez de la Sierra, R., & van der Windt, P. (2013) · Political Analysis · doi:10.1093/pan/mps021 · Cited by 298
Approaches to Social Enquiry: Advancing Knowledge
Locke, S. (2008) · Sociological Research Online · doi:10.1177/136078040801200604 · Cited by 238
Qualitative Health Research in the Era of Evidence-Based Practice
Grypdonck, M. (2006) · Qualitative Health Research · doi:10.1177/1049732306294089 · Cited by 188
Fisher, Neyman-Pearson or NHST? A tutorial for teaching data testing
Perezgonzalez, J. D. (2015) · Frontiers in Psychology · doi:10.3389/fpsyg.2015.00223 · Cited by 162
Reforming Science: Methodological and Cultural Reforms
Casadevall, A., & Fang, F. C. (2012) · Infection and Immunity · doi:10.1128/iai.06183-11 · Cited by 156 · cited 1×
“The threat to reproducibility, combined with the awareness that current rates of research misbehavior may only reflect the “ tip of the iceberg ” (Casadevall and Fang 2012), sparked initiatives to better academic science (Munafò et al. 2017).”
BackgroundPre-Analysis Plans Have Limited Upside, Especially Where Replications Are Feasible
Coffman, L. C., & Niederle, M. (2015) · Journal of Economic Perspectives · doi:10.1257/jep.29.3.81 · Cited by 156
Many psychology papers fail replication test
Bohannon, J. (2015) · Science · doi:10.1126/science.349.6251.910 · Cited by 122
Patient Involvement in Health Technology Assessment
de Wit, M., Gossec, L., Facey, K. M., Ploug Hansen, H., & Single, A. N. V. (2017) · Springer eBooks · doi:10.1007/978-981-10-4068-9 · Cited by 105
Linking Auditing and Metaevaluation
Schwandt, T. A., & Halpern, E. S. (1988) · Sage eBooks · doi:10.4135/9781412984768 · Cited by 78
Pre-Analysis Plans for Qualitative Research
Rodríguez, R. P., & Rosenblatt, F. (2016) · Revista de ciencia política · doi:10.4067/s0718-090x2016000300009 · Cited by 58
Toews, I., Booth, A., Berg, R. C., Lewin, S. A., Glenton, C., Munthe‐Kaas, H. M., Noyes, J., Schroter, S., & Meerpohl, J. J. (2017) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2017.04.010 · Cited by 58
Exploring Pre-registration and Pre-analysis Plans for Qualitative Inference
Kern, F. G., & Gleditsch, K. S. (2017) · doi:10.13140/rg.2.2.14428.69769 · Cited by 40
HEALTH TECHNOLOGY ASSESSMENT: THE CONTRIBUTION OF QUALITATIVE RESEARCH
Leys, M. (2003) · International Journal of Technology Assessment in Health Care · doi:10.1017/s026646230300028x · Cited by 36
Qualitative Evidence Synthesis
Booth, A. (2017) · Springer eBooks · doi:10.1007/978-981-10-4068-9_15 · Cited by 25
Cited by
Pham, C. H. (2024) · Advances in Educational Technologies and Instructional Design · doi:10.4018/979-8-3693-2603-9.ch005 · Cited by 702
The past, present and future of Registered Reports
Chambers, C. D., & Tzavella, L. (2021) · Nature Human Behaviour · doi:10.1038/s41562-021-01193-7 · Cited by 499
Ensuring the quality and specificity of preregistrations
Bakker, M., Veldkamp, C. L. S., van Assen, M. A. L. M., Crompvoets, E. A. V., Ong, H. H., Nosek, B. A., Soderberg, C. K., Mellor, D., & Wicherts, J. M. (2020) · PLOS Biology · doi:10.1371/journal.pbio.3000937 · Cited by 138
The Replication Crisis Has Led to Positive Structural, Procedural, and Community Changes
Korbmacher, M., Azevedo, F., Pennington, C. R., Hartmann, H., Pownall, M., Schmidt, K., Elsherif, M., Breznau, N., Robertson, O., Kalandadze, T., et al. (2023) · Communications Psychology · doi:10.1038/s44271-023-00003-2 · Cited by 137
Study preregistration: An evaluation of a method for transparent reporting
Toth, A. A., Banks, G. C., Mellor, D., O’Boyle, E. H., Dickson, A., Davis, D. J., DeHaven, A., Bochantin, J., & Borns, J. (2021) · Journal of Business and Psychology · doi:10.1007/s10869-020-09695-3 · Cited by 73
Metadata
- Authors
- L. Haven, T., & Van Grootel, D. L.
- Venue
- Accountability in Research
- Publisher
- Informa UK Limited
- Published
- 2019-03
- Volume
- 26
- Issue
- 3
- Pages
- 229-244
- ISSN
- 0898-9621 (ISSN-L)
- 1545-5815
- OpenAlex
- W2914918441
- Cited by
- 311
- References
- 34
- FWCI
- 92.39
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.