A Review of the Quality Indicators of Rigor in Qualitative Research
Open accessAbstract
Attributes of rigor and quality and suggested best practices for qualitative research design as they relate to the steps of designing, conducting, and reporting qualitative research in health professions educational scholarship are presented. A research question must be clear and focused and supported by a strong conceptual framework, both of which contribute to the selection of appropriate research methods that enhance trustworthiness and minimize researcher bias inherent in qualitative methodologies. Qualitative data collection and analyses are often modified through an iterative approach to answering the research question. Researcher reflexivity, essentially a researcher’s insight into their own biases and rationale for decision-making as the study progresses, is critical to rigor. This article reviews common standards of rigor, quality scholarship criteria, and best practices for qualitative research from design through dissemination.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
10 of 66 cited sources checked · 7 supported · 0 flagged · accuracy not yet measured
- Premisecitation
If the research participants or topic are too familiar or personal, this may influence data collection or analysis and interpretation of the results.
“However, if the research participants or topic are too familiar or personal, this may also influence data collection or analysis and interpretation of the results.33”
Quote in the paperNot a substantial claim1 of 1 sources checked- cites [33] 33. Patton MQ. Enhancing the quality and credibility of qualitative analysis. Health Serv Res. 1999; 34(5 Pt 2):1189-1208.
- Premisecitation
Any researcher biases not adequately addressed or errors in judgement can affect the quality of data and subsequent research results.
“Any researcher biases not adequately addressed or errors in judgement can affect the quality of data and subsequent research results.33”
Quote in the paperSubstantial claim1 of 1 sources checked- cites [33] 33. Patton MQ. Enhancing the quality and credibility of qualitative analysis. Health Serv Res. 1999; 34(5 Pt 2):1189-1208.
- Premisecitation
The confirmability of the results is influenced by reducing or at a minimum explaining any researcher influence on the result by applying and meeting standards of rigor such as member checking, triangulation, and peer review.
“The confirmability of the results is influenced by reducing or at a minimum explaining any researcher influence on the result by applying and meeting standards of rigor such as member checking, triangulation, and peer review.29,33”
Quote in the paperSubstantial claim1 of 2 sources checked- cites [29] 29. Marshall MN. Sampling for qualitative research. Fam Pract. 1996;13(6):522-525. source
- cites [33] 33. Patton MQ. Enhancing the quality and credibility of qualitative analysis. Health Serv Res. 1999; 34(5 Pt 2):1189-1208.
- Premisecitation
Researcher characteristics such as facial expressions, spoken language, body language, style of dress, age, race, gender, social status, culture, and relationship with participants may influence either participants' responses or how the researcher interprets those responses.
“Facial expressions, spoken language, body language, style of dress, age, race, gender, social status, culture, and the researcher's relationship with the participants may potentially influence either participants' responses or how the researcher interprets those responses.33”
Quote in the paperSubstantial claim1 of 1 sources checked- cites [33] 33. Patton MQ. Enhancing the quality and credibility of qualitative analysis. Health Serv Res. 1999; 34(5 Pt 2):1189-1208.
Split into 2 atoms — 1 confirmed, 1 partially supported, 0 disputed, 0 misattributed, 0 unverifiable. Expand the claim to see per-atom verdicts.
Experimental — accuracy not yet measured
- Premisecitation
If a theme or theory can be arrived at and validated using multiple sources of data, the result of the study has greater credibility and confirmability.
“If a theme or theory can be arrived at and validated using multiple sources of data, the result of the study has greater credibility and confirmability.16,33,36”
Quote in the paperSubstantial claim1 of 3 sources checked- cites [16] 16. Creswell J. Qualitative, quantitative, and mixed methods approaches. Res Des. 2013:1-26.
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- cites [33] 33. Patton MQ. Enhancing the quality and credibility of qualitative analysis. Health Serv Res. 1999; 34(5 Pt 2):1189-1208.
- cites [36] 36. Johnson RB. Examining the validity structure of qualitative research. Education. 1997;118(2):282.
- Interpretationreasoning
The idea of fully achieving data saturation may be unrealistic when applied to some populations or research questions.
“Thus, the idea of fully achieving data saturation may be unrealistic when applied to some populations or research questions.”
Quote in the paperNot a substantial claim- Rests on an assumption: Other considerations related to sampling bias may impact the quantity and quality of data generated and therefore the quality of the study result.
- Interpretationcitation
A poor decision regarding sample size is a direct consequence of sampling strategy and quality of data generated, which leaves the researcher unable to fully answer the research question in sufficient depth.
“A poor decision regarding sample size is a direct consequence of sampling strategy and quality of data generated, which leaves the researcher unable to fully answer the research question in sufficient depth.30”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [30] 30. Cleary M, Horsfall J, Hayter M. Data collection and sampling in qualitative research: does size matter? J Adv Nurs. 2014;70(3):473-475. source
- Interpretationreasoning
Accurately predicting a sample size during the planning phases of qualitative research can be challenging.
“Thus, accurately predicting a sample size during the planning phases of qualitative research can be challenging.30”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [30] 30. Cleary M, Horsfall J, Hayter M. Data collection and sampling in qualitative research: does size matter? J Adv Nurs. 2014;70(3):473-475. source
- Premisecitation
Huberman and Miles caution qualitative researchers about developing and using a framework to the extent that it influences qualitative design deductively because this would violate the very principles of induction that define the qualitative research paradigm.
“While a conceptual framework is important to rigor in qualitative research, Huberman and Miles caution qualitative researchers about developing and using a framework to the extent that it influences qualitative design deductively because this would violate the very principles of induction that define the qualitative research paradigm.25”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [25] 25. Miles MB, Huberman M. Qualitative Data Analysis: An Expanded Sourcebook, 2nd ed. Thousand Oaks, CA: Sage; 1994.
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Premisecitation
Some journals within the field of health professions education have established best practice guidance, as opposed to strict criteria or a checklist, for qualitative research.
“Some journals within the field of health professions education have also established best practice guidance, as opposed to strict criteria or a checklist, for qualitative research.These have been disseminated as guiding questions or evaluation categories.In 2015, Academic Medicine produced an expanded second edition of a researcher/author manual that includes specific criteria with extensive expla”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [14] 14. Durning SJ, Carline J, eds. Review criteria for research manuscripts, 2 nd ed. Washington, DC: Association of American Medical Colleges; 2015.
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Premisecitation
Determination of a final sample size is largely based on having sufficient opportunity to collect relevant data until new information is no longer emerging from data collection, new coding is not feasible, and/or no new themes are emerging; that is, reaching data saturation, a common standard of rigor for data collection in qualitative studies.
“Determination of a final sample size is largely based on having sufficient opportunity to collect relevant data until new information is no longer emerging from data collection, new coding is not feasible, and/or no new themes are emerging; that is, reaching data saturation, a common standard of rigor for data collection in qualitative studies.”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [30] 30. Cleary M, Horsfall J, Hayter M. Data collection and sampling in qualitative research: does size matter? J Adv Nurs. 2014;70(3):473-475. source
- Interpretationcitation
Ongoing application of researcher reflexivity is critical to the rigor of the study and quality of sampling.
“Thus, ongoing application of previously mentioned researcher reflexivity is critical to the rigor of the study and quality of sampling.29,30”
Quote in the paperSubstantial claim0 of 2 sources checked - Interpretationcitation
Participants' perceptions of ethical conduct are fundamental to a relationship likely to generate high quality data.
“Participants' perceptions of ethical conduct are fundamental to a relationship likely to generate high quality data.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [8] 8. Stige B, Malterud K, Midtgarden T. Toward an agenda for evaluation of qualitative research. Qual Health Res. 2009;19(10):1504-16. source
- Premisecitation
Some authors have published best practice guidelines for use by researchers and peer reviewers to achieve and assess methodological rigor and research quality.
“As an alternative, some of these authors have published best practice guidelines for use by researchers and peer reviewers to achieve and assess methodological rigor and research quality.12,13”
Quote in the paperNot a substantial claim0 of 2 sources checked - Interpretationcitation
Researcher reflexivity, or acknowledgement of researcher bias, is absolutely critical to the credibility and trustworthiness of data collection and analysis in such study designs.
“Researcher reflexivity, or acknowledgement of researcher bias, is absolutely critical to the credibility and trustworthiness of data collection and analysis in such study designs.32”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [32] 32. Knox S, Burkard AW. Qualitative research interviews. Psychother Res. 2009;19(45):566-575. source
- Premisecitation
Descriptions of sampling factors also contribute to the credibility of the results and readers' determination of transfer to their and other contexts.
“Such descriptions also contribute to the credibility of the results and readers' determination of transfer to their and other contexts.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [40] 40. Shenton AK. Strategies for ensuring trustworthiness in qualitative research projects. Educ Inf. 2004;22(2):63-75. source
- Premisecitation
The more detailed and complete the researcher notes, the more accurate and useful they can be in data analysis or in auditing processes for enhancing rigor in the interpretation phase of the study.
“The more detailed and complete the notes, the more accurate and useful they can be in data analysis or in auditing processes for enhancing rigor in the interpretation phase of the study.34”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [34] 34. Mulhall A. In the field: Notes on observation in qualitative research. J Adv Nurs. 2003;41(3):306-313. source
- Premisecitation
Review of an audit trail by an independent peer reviewer prior to manuscript development enhances study confirmability.
“Review of this audit trail occurs prior to manuscript development and enhances study confirmability.1,16”
Quote in the paperNot a substantial claim0 of 2 sources checked- cites [1] 1. Denzin, Norman, Lincoln YS. The Sage Handbook of Qualitative Research. 4th ed. Los Angeles, CA: Sage Publications; 2011.
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- cites [16] 16. Creswell J. Qualitative, quantitative, and mixed methods approaches. Res Des. 2013:1-26.
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Premisecitation
O'Brien and others proposed a standardized framework specifically for reporting qualitative studies known as the Standards for Reporting Qualitative Research (SRQR).
“O'Brien and others 4 proposed a standardized framework specifically for reporting qualitative studies known as the Standards for Reporting Qualitative Research (SRQR, Table 2).”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [4] 4. O'Brien BC, Harris IB, Beckman TJ, Reed DA, Cook DA. Standards for reporting qualitative research: a synthesis of recommendations. Acad Med. 2014;89(9):1245-1251. source
- Interpretationreasoning
Researcher reflexivity is critical to rigor in qualitative research.
“researcher reflexivity is critical to rigor.”
- Also stated in: § Step 2: Qualitative Study Design · plain
“researcher reflexivity is essential.”
- Also stated in: § Step 2: Qualitative Study Design · plain
“researcher practice in reflexivity throughout research processes is integral to rigor in study design and implementation.”
Quote in the paperSubstantial claim - Also stated in: § Step 2: Qualitative Study Design · plain
- Interpretationcitation
The strength of conclusions is dependent upon the extent to which standards of rigor and best practices were demonstrated in design, data collection, data analysis, and interpretation.
“The strength of conclusions is dependent upon the extent to which standards of rigor and best practices were demonstrated in design, data collection, data analysis, and interpretation, as described in previous sections of this article.4,12,17,23,24”
Quote in the paperSubstantial claim0 of 3 sources checked- cites [4] 4. O'Brien BC, Harris IB, Beckman TJ, Reed DA, Cook DA. Standards for reporting qualitative research: a synthesis of recommendations. Acad Med. 2014;89(9):1245-1251. source
- cites [12] 12. Wu S, Wyant DC, Fraser MW. Author guidelines for manuscripts reporting on qualitative research. J Soc Social Work Res. 2016;7(Summer 2016):405-425. source
- cites [17] 17. Maxwell JA. Qualitative Research Design: An Interactive Approach. Los Angeles, CA: Sage; 2013.
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Premisecitation
Transferability is communicated, in part, through description of sampling factors such as geographical location of the study, number and characteristics of participants, and the timeframe of data collection and analysis.
“Transferability is communicated, in part, through description of sampling factors such as: geographical location of the study, number and characteristics of participants, and the timeframe of data collection and analysis.40”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [40] 40. Shenton AK. Strategies for ensuring trustworthiness in qualitative research projects. Educ Inf. 2004;22(2):63-75. source
- Classified as probably not a substantial claim. 44
- May combine two claims. 12
Classified as probably not a substantial claim.
PremisecitationSome authors have raised concerns that strict adherence to universal checklists may stifle the diversity and multiplicity of practices in qualitative research.
“Some authors have raised concerns about the use of such checklists and adherence to strict, universal criteria because they do not afford sufficient flexibility to accommodate the diverse approaches and multiple interpretive practices often represented in qualitative studies.[7][8][9][10][11]”
Quote in the paperSubstantial claim1 of 3 sources checked- cites [7] 7. Dixon-Woods M, Shaw RL, Agarwal S, Smith JA. The problem of appraising qualitative research. BMJ Quality & Safety. 2004;13:223-225 source
- cites [8] 8. Stige B, Malterud K, Midtgarden T. Toward an agenda for evaluation of qualitative research. Qual Health Res. 2009;19(10):1504-16. source
- cites [9] 9. Wasserman JA, Clair JM, Wilson KL. Problematics of grounded theory: Innovations for developing an increasingly rigorous qualitative method. Qual Res. 2009;9(3):355-381. source
Probably not a substantial claim: may not pass S3 (load-bearing).
PremisecitationIn recent years, multiple publications have synthesized quality criteria and recommendations for use by researchers and peer reviewers, often in the form of checklists.
“In recent years, multiple publications have synthesized quality criteria and recommendations for use by researchers and peer reviewers alike, often in the form of checklists.[2][3][4][5][6]”
Quote in the paperNot a substantial claim1 of 3 sources checked- cites [2] 2. Anderson C. Presenting and evaluating qualitative research. Am J Pharm Educ. 2010; 74(8):Article 141. source
- cites [3] 3. Santiago-Delefosse M, Gavin A, Bruchez C, Roux P, Stephen SL. Quality of qualitative research in the health sciences: analysis of the common criteria present in 58 assessment guidelines by expert users. Soc Sci Med. 2016;148:142-51. source
- cites [4] 4. O'Brien BC, Harris IB, Beckman TJ, Reed DA, Cook DA. Standards for reporting qualitative research: a synthesis of recommendations. Acad Med. 2014;89(9):1245-1251. source
Classified as probably not a substantial claim.
InterpretationcitationDeveloping a FINER research question is critical to study rigor and quality.
“Developing a FINER research question is critical to study rigor and quality and should not be rushed, as all other aspects of research design depend on the focus and clarity of the research question(s) guiding the study.15”
Quote in the paperSubstantial claim1 of 1 sources checked- cites [15] 15. Agee J. Developing qualitative research questions: A reflective process. Int J Qual Stud Educ. 2009;22(4):431-447. source
The Abstract says poorly constructed questions can affect all subsequent stages of a study, and the Conclusion says good qualitative questions shape study design and analysis. The paper supports careful development of research questions, but these passages do not establish the specific FINER framework named in the claim. (LLM, conf=0.88)
Experimental — accuracy not yet measured
Probably not a substantial claim: may not pass S2 (checkable).
InterpretationcitationDeveloping and refining a primary research question focused on both the phenomena of interest and the context in which it is situated is essential to research rigor and quality.
“Developing and refining a primary research question focused on both the phenomena of interest and the context in which it is situated is essential to research rigor and quality.”
Quote in the paperNot a substantial claim1 of 2 sources checked- cites [15] 15. Agee J. Developing qualitative research questions: A reflective process. Int J Qual Stud Educ. 2009;22(4):431-447. source
- cites [16] 16. Creswell J. Qualitative, quantitative, and mixed methods approaches. Res Des. 2013:1-26.
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
Probably not a substantial claim: may not pass S2 (checkable).
PremisecitationThe goal of rigor in qualitative research can be described as ensuring that the research design, method, and conclusions are explicit, public, replicable, open to critique, and free of bias.
“The goal of rigor in qualitative research can be described as ensuring that the research design, method, and conclusions are explicit, public, replicable, open to critique, and free of bias.41”
Quote in the paperNot a substantial claim1 of 1 sources checked- cites [41] 41. Leung L. Validity, reliability, and generalizability in qualitative research. J Fam Med Prim Care. 2015;4(3):324. source
The 'Overall Criteria for Quality in Qualitative Research' section supports making the design, methods, and conclusions transparent and systematic; the paper also discusses appraisal of their quality. But the 'Reliability' section says exact replicability is counter-intuitive for qualitative research, and 'Nature of Qualitative Research versus Quantitative Research' treats subjectivity as an essential element rather than something to eliminate as bias. Page numbers are unavailable in our copy. (LLM, conf=0.88)
Experimental — accuracy not yet measured
Probably not a substantial claim: may not pass S2 (checkable).
InterpretationreasoningInclusion of best practice methods for assuring the rigor and trustworthiness of results is critical to study design.
“Although researchers can employ great flexibility in the selection of study methods, inclusion of best practice methods for assuring the rigor and trustworthiness of results is critical to study design.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing).
InterpretationreasoningGiven the unique and often highly sensitive nature of data being collected by the researcher, trustworthiness is an essential component of the researcher-participant relationship.
“Given the unique and often highly sensitive nature of data being collected by the researcher, trustworthiness is an essential component of the researcher-participant relationship.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
InterpretationreasoningThe conceptual framework contributes directly to determining sample definitions, size, and recruitment of participants.
“The conceptual framework contributes directly to determining sample definitions, size, and recruitment of participants.”
Quote in the paperNot a substantial claim- Rests on an assumption: Data saturation is probably the most common terminology used to describe the achievement of sufficient sample size.
Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).
Interpretationnone givenOther considerations related to sampling bias may impact the quantity and quality of data generated and therefore the quality of the study result.
“In addition to defining the sample and selecting participants, other considerations related to sampling bias may impact the quantity and quality of data generated and therefore the quality of the study result.”
Quote in the paperNot a substantial claim- Rests on an assumption: Given the unique and often highly sensitive nature of data being collected by the researcher, trustworthiness is an essential component of the researcher-participant relationship.
Probably not a substantial claim: may not pass S3 (load-bearing).
PremisecitationRingsted, Hodges, and Sherpbier describe three essential parts to an effective conceptual framework: theories and/or concepts and principles relevant to the phenomenon of interest; what is known and unknown from prior work, observations, and examples; and the researcher's observations, ideas, and suppositions regarding the research problem statement and question.
“Ringsted, Hodges, and Sherpbier describe three essential parts to an effective conceptual framework: theories and/ or concepts and principles relevant to the phenomenon of interest; what is known and unknown from prior work, observations, and examples; and the researcher's observations, ideas, and suppositions regarding the research problem statement and question.21”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [21] 21. Ringsted C, Hodges B, Scherpbier A. "The research compass": an introduction to research in medical education: AMEE Guide No. 56. Med Teach. 2011;33(9):695-709. source
Probably not a substantial claim: may not pass S3 (load-bearing).
PremisecitationGlassick, Huber, and Maeroff identified six criteria applicable to assessing the quality of scholarship.
“Glassick, Huber, and Maeroff identified six criteria applicable to assessing the quality of scholarship.18,19”
Quote in the paperNot a substantial claim0 of 2 sources checked- cites [18] 18. Glassick CE, Huber MT, Maeroff GI, Boyer EL. Scholarship Assessed: Evaluation of the Professoriate. San Francisco, CA: Jossey-Bass; 1997.
- cites [19] 19. Glassick CE. Boyer's expanded definitions of scholarship, the standards for assessing scholarship, and the elusiveness of the scholarship of teaching. Acad Med. 2000;75(9):877-880. source
Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing).
InterpretationreasoningBy being transparent in the process and reporting of results when saturation may not have been possible, the resulting data may still contribute to the field and to further inquiry.
“By being transparent in the process and reporting of results when saturation may not have been possible, the resulting data may still contribute to the field and to further inquiry.”
Quote in the paperNot a substantial claim- Rests on an assumption: Any of these factors could potentially change the nature of the relationship between the researcher and the study participants and influence the trustworthiness of data collected or the study result.
Probably not a substantial claim: may not pass S3 (load-bearing).
PremisecitationThe 2015 second edition of the Review Criteria for Research Manuscripts and work by Ravitch and colleagues provide specific guidance for applying the conceptual framework to each stage of the research process to enhance rigor and quality.
“The 2015 second edition of the Review Criteria for Research Manuscripts 14 and work by Ravitch and colleagues 23,24 provide specific guidance for applying the conceptual framework to each stage of the research process to enhance rigor and quality.”
Quote in the paperNot a substantial claim0 of 3 sources checked- cites [14] 14. Durning SJ, Carline J, eds. Review criteria for research manuscripts, 2 nd ed. Washington, DC: Association of American Medical Colleges; 2015.
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- cites [23] 23. Ravitch S, Carl N. Qualitative Research: Bridging the Conceptual, Theoretical, and Methodological. Thousand Oaks, CA: Sage; 2016.
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- cites [24] 24. Ravitch SM, Riggan M. Reason & Rigor: How Conceptual Frameworks Guide Research. Los Angeles, CA: Sage; 2012. source
Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing). May combine two claims.
InterpretationreasoningAny of these factors could potentially change the nature of the relationship between the researcher and the study participants and influence the trustworthiness of data collected or the study result.
“Any of these factors could potentially change the nature of the relationship between the researcher and the study participants and influence the trustworthiness of data collected or the study result.”
Quote in the paperNot a substantial claim- Rests on an assumption: Interview protocols and structure are often modified or refined, based on concurrent data collection and analysis processes to support or refute preliminary interpretations and refine focus and continuing inquiry.
Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
Interpretationnone givenInterview methods range from highly structured to increase dependability or completely open-ended to allow for interviewers to clarify a participant's response for increased credibility and confirmability.
“Interview methods range from highly structured to increase dependability or completely open-ended to allow for interviewers to clarify a participant's response for increased credibility and confirmability.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
PremisecitationMember checking, a common standard of rigor, is a practice to increase study credibility and confirmability that involves asking a research subject to verify the transcription of an interview.
“Member checking, a common standard of rigor, is a practice to increase study credibility and confirmability that involves asking a research subject to verify the transcription of an interview.1,16,28”
Quote in the paperNot a substantial claim0 of 3 sources checked- cites [1] 1. Denzin, Norman, Lincoln YS. The Sage Handbook of Qualitative Research. 4th ed. Los Angeles, CA: Sage Publications; 2011.
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- cites [16] 16. Creswell J. Qualitative, quantitative, and mixed methods approaches. Res Des. 2013:1-26.
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- cites [28] 28. Whittemore R, Chase SK, Mandle CL. Validity in qualitative research. Qual Health Res. 2001;11(4):522-537. source
Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
InterpretationreasoningData saturation is probably the most common terminology used to describe the achievement of sufficient sample size, but it does not apply to all study designs.
“Though data saturation is probably the most common terminology used to describe the achievement of sufficient sample size, it does not apply to all study designs.”
Quote in the paperNot a substantial claim- Rests on an assumption: By being transparent in the process and reporting of results when saturation may not have been possible, the resulting data may still contribute to the field and to further inquiry.
Classified as probably not a substantial claim.
InterpretationreasoningSampling design in qualitative research is not random but defined purposively to include the most appropriate participants in the most appropriate context for answering the research question.
“Therefore, sampling design in qualitative research is not random but defined purposively to include the most appropriate participants in the most appropriate context for answering the research question.”
Quote in the paperSubstantial claim- Rests on an assumption: Attrition and factors related to time and resources may contribute to not reaching data saturation within the limits of the study.
Classified as probably not a substantial claim.
PremisecitationLincoln and Guba outline four criteria for establishing the overall trustworthiness of qualitative research results: credibility, transferability, dependability, confirmability.
“Lincoln and Guba outline four criteria for establishing the overall trustworthiness of qualitative research results: credibility, the researcher ensures and imparts to the reader supporting evidence that the results accurately represent what was studied; transferability, the researcher provides detailed contextual information such that readers can determine whether the results are applicable to”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [27] 27. Guba E, Lincoln Y. Sage Handbook of Qualitative Research. Thousand Oaks, CA: Sage; 1994.
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
Probably not a substantial claim: may not pass S3 (load-bearing).
PremisecitationLingard describes four types of unknowns to pursue during literature review: what no one knows; what is not yet well understood; what controversy or conflicting results, understandings, or perspectives exist; and what are unproven assumptions.
“Lingard describes four types of unknowns to pursue during literature review: what no one knows; what is not yet well understood; what controversy or conflicting results, understandings, or perspectives exist; and what are unproven assumptions.22”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [22] 22. Lingard L. Writing an effective literature review. Perspect Med Educ. 2018;7(1):47-49.
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).
Interpretationnone givenInterview protocols and structure are often modified or refined, based on concurrent data collection and analysis processes to support or refute preliminary interpretations and refine focus and continuing inquiry.
“Regardless, interview protocols and structure are often modified or refined, based on concurrent data collection and analysis processes to support or refute preliminary interpretations and refine focus and continuing inquiry.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
InterpretationreasoningAttrition and factors related to time and resources may contribute to not reaching data saturation within the limits of the study.
“In other instances, attrition and factors related to time and resources may contribute to not reaching data saturation within the limits of the study.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing).
InterpretationreasoningDeveloping a well-integrated conceptual framework is essential to establishing a research topic based upon a thorough and integrated review of relevant literature.
“Developing a well-integrated conceptual framework is essential to establishing a research topic based upon a thorough and integrated review of relevant literature (addressing Glassick criteria #1 and #2: clear purpose and adequate preparation).”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
InterpretationreasoningThe number of participants available for inclusion in a sample may be small and some risk of not reaching data saturation may be unavoidable.
“Conversely, the number of participants available for inclusion in a sample may be small and some risk of not reaching data saturation may be unavoidable.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
PremisecitationQuality criteria for assessing a study's problem statement, conceptual framework, and research question include: introduction builds a logical case and provides context for the problem statement; problem statement is clear and well-articulated; conceptual framework is explicit and justified; research purpose and/or question is clearly stated; and constructs being investigated are clearly presented
“Quality criteria for assessing a study's problem statement, conceptual framework, and research question include the following: introduction builds a logical case and provides context for the problem statement; problem statement is clear and well-articulated; conceptual framework is explicit and justified; research purpose and/or question is clearly stated; and constructs being investigated are”
Quote in the paperNot a substantial claim0 of 3 sources checked- cites [14] 14. Durning SJ, Carline J, eds. Review criteria for research manuscripts, 2 nd ed. Washington, DC: Association of American Medical Colleges; 2015.
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- cites [24] 24. Ravitch SM, Riggan M. Reason & Rigor: How Conceptual Frameworks Guide Research. Los Angeles, CA: Sage; 2012. source
- cites [25] 25. Miles MB, Huberman M. Qualitative Data Analysis: An Expanded Sourcebook, 2nd ed. Thousand Oaks, CA: Sage; 1994.
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
Probably not a substantial claim: may not pass S3 (load-bearing).
PremisecitationRecent contributions from Ravitch and colleagues present best practices in developing frameworks for conceptual and methodological coherence within a study design, regardless of the research approach.
“Recent contributions from Ravitch and colleagues present best practices in developing frameworks for conceptual and methodological coherence within a study design, regardless of the research approach.23,24”
Quote in the paperNot a substantial claim0 of 2 sources checked- cites [23] 23. Ravitch S, Carl N. Qualitative Research: Bridging the Conceptual, Theoretical, and Methodological. Thousand Oaks, CA: Sage; 2016.
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- cites [24] 24. Ravitch SM, Riggan M. Reason & Rigor: How Conceptual Frameworks Guide Research. Los Angeles, CA: Sage; 2012. source
Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing). May combine two claims.
InterpretationcitationThe development of a strong conceptual framework facilitates selection of appropriate study methods to minimize the bias inherent in qualitative studies and help readers to trust the research and the researcher.
“The development of a strong conceptual framework facilitates selection of appropriate study methods to minimize the bias inherent in qualitative studies and help readers to trust the research and the researcher (see 23 Glassick criteria #3 in Table 1).”
Quote in the paperNot a substantial claimMay combine two claims.
InterpretationcitationConvenience sampling, using the most accessible research participants, is the least rigorous approach to defining a study sample and may result in low accuracy, poor representativeness, low credibility, and lack of transferability of study results.
“Convenience sampling, using the most accessible research participants, is the least rigorous approach to defining a study sample and may result in low accuracy, poor representativeness, low credibility, and lack of transferability of study results.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [29] 29. Marshall MN. Sampling for qualitative research. Fam Pract. 1996;13(6):522-525. source
Probably not a substantial claim: may not pass S3 (load-bearing).
InterpretationreasoningThe first two Glassick criteria, clear purpose and adequate preparation, are directly related to formulating effective research questions and a strong conceptual framework.
“The first two criteria, clear purpose and adequate preparation, are directly related to formulating effective research questions and a strong conceptual framework.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing), S4 (based).
Interpretationnone givenReflexivity, the idea that a researcher's preconceptions and biases can influence decisions and actions throughout qualitative research activities, is a critical aspect of rigor even at the earliest stages of the study.
“Reflexivity, the idea that a researcher's preconceptions and biases can influence decisions and actions throughout qualitative research activities, is a critical aspect of rigor even at the earliest stages of the study.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing), S4 (based). May combine two claims.
Premisenone givenAs in any research paradigm, the goal of quality and rigor in qualitative research is to minimize the risk of bias and maximize the accuracy and credibility of research results.
“As in any research paradigm, the goal of quality and rigor in qualitative research is to minimize the risk of bias and maximize the accuracy and credibility of research results.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
PremisecitationThe SRQR framework provides detailed explanations of what should be reported in each of 21 sections of a qualitative research manuscript.
“This framework provides detailed explanations of what should be reported in each of 21 sections of a qualitative research manuscript.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [4] 4. O'Brien BC, Harris IB, Beckman TJ, Reed DA, Cook DA. Standards for reporting qualitative research: a synthesis of recommendations. Acad Med. 2014;89(9):1245-1251. source
Probably not a substantial claim: may not pass S2 (checkable).
InterpretationreasoningBeginning the study with a well-developed conceptual framework and active use of both researcher reflexivity and rigorous peer review during study implementation can drive both study rigor and quality.
“Beginning the study with a well-developed conceptual framework and active use of both researcher reflexivity and rigorous peer review during study implementation can drive both study rigor and quality.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S2 (checkable).
PremisecitationIt is vital to the credibility and trustworthiness of the study that the author disclose and explore negative cases (competing or controversial theories) that emerge during data collection or analysis.
“Should any competing or controversial theories emerge during data collection or analysis, it is vital to the credibility and trustworthiness of the study that the author disclose and explore those negative cases.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [16] 16. Creswell J. Qualitative, quantitative, and mixed methods approaches. Res Des. 2013:1-26.
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
Probably not a substantial claim: may not pass S3 (load-bearing).
PremisecitationData triangulation is used to identify convergence of data obtained through multiple data sources and methods to avoid or minimize error or bias and optimize accuracy in data collection and analysis processes.
“Data triangulation is used to identify convergence of data obtained through multiple data sources and methods (eg, observation field notes and interview transcripts) to avoid or minimize error or bias and optimize accuracy in data collection and analysis processes.33,35,36”
Quote in the paperNot a substantial claim0 of 3 sources checked- cites [33] 33. Patton MQ. Enhancing the quality and credibility of qualitative analysis. Health Serv Res. 1999; 34(5 Pt 2):1189-1208.
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- cites [35] 35. Creswell J, Miller D. Determining validity in qualitative inquiry. Theory Pract. 2000;39(3):124-130. source
- cites [36] 36. Johnson RB. Examining the validity structure of qualitative research. Education. 1997;118(2):282.
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
Probably not a substantial claim: may not pass S3 (load-bearing).
PremisereasoningThe peer reviewer offers a critique of the study methods and validation of the conclusions drawn by the author as a thorough check on researcher bias.
“The peer reviewer offers a critique of the study methods and validation of the conclusions drawn by the author as a thorough check on researcher bias.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing). May combine two claims.
PremisecitationA study's conceptual framework is critical to achieving rigor and quality and provides guidance in developing predetermined notions or plans for what to observe, how to record, and how to minimize the influence of potential bias.
“A study's conceptual framework is critical to achieving rigor and quality and provides guidance in developing predetermined notions or plans for what to observe, how to record, and how to minimize the influence of potential bias.34”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [34] 34. Mulhall A. In the field: Notes on observation in qualitative research. J Adv Nurs. 2003;41(3):306-313. source
Classified as probably not a substantial claim.
PremisecitationTo ensure dependability, the research method must be reported in detail such that the reader can determine proper research practices have been followed and that future researchers can repeat the study.
“To ensure dependability, the research method must be reported in detail such that the reader can determine proper research practices have been followed and that future researchers can repeat the study.40”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [40] 40. Shenton AK. Strategies for ensuring trustworthiness in qualitative research projects. Educ Inf. 2004;22(2):63-75. source
Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing), S4 (based). May combine two claims.
Premisenone givenThe use of best practices applying to data collection and data analysis facilitates the full examination of data relative to the study purpose and research question and helps to prevent premature closure of the study.
“The use of best practices applying to data collection and data analysis facilitates the full examination of data relative to the study purpose and research question and helps to prevent premature closure of the study.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S2 (checkable). May combine two claims.
InterpretationreasoningRigor is best achieved through thoughtful and deliberate planning, diligent and ongoing application of researcher reflexivity, and honest communication between the researcher and the audience regarding the study and its results.
“Rigor is best achieved through thoughtful and deliberate planning, diligent and ongoing application of researcher reflexivity, and honest communication between the researcher and the audience regarding the study and its results.”
Quote in the paperNot a substantial claimMay combine two claims.
PremisecitationRegardless of the researcher's degree of visibility to study participants, persistent observation of the targeted sample is critical to the confirmability standard and to achieving data saturation.
“Regardless of the researcher's degree of visibility to the study participants, persistent observation of the targeted sample is critical to the confirmability standard and to achieving data saturation.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [28] 28. Whittemore R, Chase SK, Mandle CL. Validity in qualitative research. Qual Health Res. 2001;11(4):522-537. source
Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing).
PremisecitationStudy conclusions must be clearly grounded in persistent phenomena witnessed during the study, rather than on a fluke event.
“That is, study conclusions must be clearly grounded in persistent phenomena witnessed during the study, rather than on a fluke event.28”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [28] 28. Whittemore R, Chase SK, Mandle CL. Validity in qualitative research. Qual Health Res. 2001;11(4):522-537. source
Probably not a substantial claim: may not pass S2 (checkable).
InterpretationreasoningDue to the creative interpretative and contextually bound nature of qualitative studies, the application of standards of rigor and adherence to systematic processes well-documented in an audit trail are essential.
“Thus, due to the creative interpretative and contextually bound nature of qualitative studies, the application of standards of rigor and adherence to systematic processes welldocumented in an audit trail are essential.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [33] 33. Patton MQ. Enhancing the quality and credibility of qualitative analysis. Health Serv Res. 1999; 34(5 Pt 2):1189-1208.
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Rests on an assumption: Qualitative studies are creative, interpretative, and contextually bound in nature.
Probably not a substantial claim: may not pass S2 (checkable), S4 (based).
Premisenone givenThick and rich descriptions, where robust descriptive language is used to provide sufficient contextual information, enable the reader to determine credibility, transferability, dependability, and confirmability.
“Thick and rich descriptions, where robust descriptive language is used to provide sufficient contextual information, enable the reader to determine credibility, transferability, dependability, and confirmability.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S2 (checkable).
PremisereasoningThe process of demonstrating the credibility of research is rooted in honest and transparent reporting of how biases and other possible confounders were identified and addressed throughout study processes.
“The process of demonstrating the credibility of research is rooted in honest and transparent reporting of how biases and other possible confounders were identified and addressed throughout study processes.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S2 (checkable).
PremisecitationRigor in the research process and results are achieved when each element of study methodology is systematic and transparent through complete, methodical, and accurate reporting.
“Rigor in the research process and results are achieved when each element of study methodology is systematic and transparent through complete, methodical, and accurate reporting.33”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [33] 33. Patton MQ. Enhancing the quality and credibility of qualitative analysis. Health Serv Res. 1999; 34(5 Pt 2):1189-1208.
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
The paper relies on this without support.
Qualitative research in health professions education has increased significantly, both in practice and publication, within the past 20 years.
“Within the past 20 years, qualitative research in health professions education has increased significantly, both in practice and publication.”
The paper relies on this without support.
There have been recurrent calls for enhancing rigor and quality in qualitative research.
“Simultaneously, there have been recurrent calls for enhancing rigor and quality in qualitative research.”
The paper relies on this without support.
Qualitative data collection and analyses are often modified through an iterative approach to answering the research question.
“Qualitative data collection and analyses are often modified through an iterative approach to answering the research question.”
The paper relies on this without support.
Qualitative studies typically reflect designs in which data collection and analysis are done concurrently, with results of ongoing analysis informing continuing data collection.
“Qualitative studies typically reflect designs in which data collection and analysis are done concurrently, with results of ongoing analysis informing continuing data collection.”
The paper relies on this without support.
Common qualitative data collection methods used in health professions education include interview, direct observation methods, and textual/document analysis.
“Common qualitative data collection methods used in health professions education include interview, direct observation methods, and textual/document analysis.”
The paper relies on this without support.
The conceptual framework contributes directly to determining sample definitions, size, and recruitment of participants.
“The conceptual framework contributes directly to determining sample definitions, size, and recruitment of participants.”
The paper relies on this without support.
Sampling design in qualitative research is not random but defined purposively to include the most appropriate participants in the most appropriate context for answering the research question.
“Therefore, sampling design in qualitative research is not random but defined purposively to include the most appropriate participants in the most appropriate context for answering the research question.”
The paper relies on this without support.
Data saturation is probably the most common terminology used to describe the achievement of sufficient sample size.
“Though data saturation is probably the most common terminology used to describe the achievement of sufficient sample size, it does not apply to all study designs.”
The paper relies on this without support.
The idea of fully achieving data saturation may be unrealistic when applied to some populations or research questions.
“Thus, the idea of fully achieving data saturation may be unrealistic when applied to some populations or research questions.”
The paper relies on this without support.
Attrition and factors related to time and resources may contribute to not reaching data saturation within the limits of the study.
“In other instances, attrition and factors related to time and resources may contribute to not reaching data saturation within the limits of the study.”
The paper relies on this without support.
By being transparent in the process and reporting of results when saturation may not have been possible, the resulting data may still contribute to the field and to further inquiry.
“By being transparent in the process and reporting of results when saturation may not have been possible, the resulting data may still contribute to the field and to further inquiry.”
The paper relies on this without support.
Other considerations related to sampling bias may impact the quantity and quality of data generated and therefore the quality of the study result.
“In addition to defining the sample and selecting participants, other considerations related to sampling bias may impact the quantity and quality of data generated and therefore the quality of the study result.”
The paper relies on this without support.
Any of these factors could potentially change the nature of the relationship between the researcher and the study participants and influence the trustworthiness of data collected or the study result.
“Any of these factors could potentially change the nature of the relationship between the researcher and the study participants and influence the trustworthiness of data collected or the study result.”
The paper relies on this without support.
Given the unique and often highly sensitive nature of data being collected by the researcher, trustworthiness is an essential component of the researcher-participant relationship.
“Given the unique and often highly sensitive nature of data being collected by the researcher, trustworthiness is an essential component of the researcher-participant relationship.”
The paper relies on this without support.
Interview methods range from highly structured to increase dependability or completely open-ended to allow for interviewers to clarify a participant's response for increased credibility and confirmability.
“Interview methods range from highly structured to increase dependability or completely open-ended to allow for interviewers to clarify a participant's response for increased credibility and confirmability.”
The paper relies on this without support.
Interview protocols and structure are often modified or refined, based on concurrent data collection and analysis processes to support or refute preliminary interpretations and refine focus and continuing inquiry.
“Regardless, interview protocols and structure are often modified or refined, based on concurrent data collection and analysis processes to support or refute preliminary interpretations and refine focus and continuing inquiry.”
The paper relies on this without support.
Prolonged engagement supports reflexivity by allowing the researcher to determine how they themselves may be a source of bias during data collection by altering how individuals behave or interact in the researcher's presence.
“This strategy supports reflexivity, allowing the researcher to determine how they themselves may be a source of bias during the data collection process by altering the nature of how individuals behave or interact with others in the presence of the researcher.”
The paper relies on this without support.
In observational methods, it is impossible to separate the researcher from the environment.
“In both observation scenarios, it is impossible to separate the researcher from the environment, and researcher reflexivity is essential.”
The paper relies on this without support.
Observational methodologies are limited by the researcher's bias in determining what is observed, what is recorded, how it is recorded, and how it is transcribed for analysis.
“Researchers acknowledge that observational methodologies are limited by the reality that the researcher carries a bias in determining what is observed, what is recorded, how it is recorded, and how it is transcribed for analysis.”
The paper relies on this without support.
In qualitative studies, the researcher is often the primary instrument for data collection.
“In qualitative studies, the researcher is often the primary instrument for data collection.”
The paper relies on this without support.
Qualitative studies are creative, interpretative, and contextually bound in nature.
“Thus, due to the creative interpretative and contextually bound nature of qualitative studies, the application of standards of rigor and adherence to systematic processes welldocumented in an audit trail are essential.”
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The study closely aligned its specific research question with its framework and experimental design.
“closely aligning our specific research question with our framework and experimental design [34]”
From "It let me merge my love of teaching with research": A qualitative investigation of the career pathways of biology education researchers. (2024) · cites this paper as [34]
Data saturation was reached after 20 interviews, enhancing the rigour of the qualitative study.
“This suggests that data saturation was reached after 20 interviews (Online Resource 2), enhancing the rigour of our qualitative study [28].”
From Young People’s Barriers and Facilitators of Engagement with Web-Based Mental Health Interventions for Anxiety and Depression: A Qualitative Study (2024) · cites this paper as [28]
All transcripts were checked for accuracy and de-identified prior to importing into NVivo.
“To increase the study credibility, all the transcripts were checked for accuracy [28] and de-identified by [first author] prior to importing into NVivo version 12 [29].”
From Young People’s Barriers and Facilitators of Engagement with Web-Based Mental Health Interventions for Anxiety and Depression: A Qualitative Study (2024) · cites this paper as [28]
This increases confidence in the credibility of the findings, ensuring that the researchers interpretation of the data is a true reflection of the midwives' experiences and is not inadvertently influenced by the researchers own beliefs and values.
“This increases confidence in the credibility of the findings (Thomas and Magilvy, 2011), ensuring that the researchers interpretation of the data is a true reflection of the midwives’ experiences and is not inadvertently influenced by the researchers own beliefs and values (Johnson et al., 2020).”
From Stranger in a mask” midwives’ experiences of providing perinatal bereavement care to parents during the COVID-19 pandemic in Ireland: a qualitative descriptive study (2022) · cites this paper as Johnson et al., 2020
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
Cited author's surname differs from reference 21
MinorThe text spells the third author's surname "Sherpbier," while reference 21 spells it "Scherpbier."
“Ringsted, Hodges, and Sherpbier describe three essential parts to an effective conceptual framework”
“21. Ringsted C, Hodges B, Scherpbier A. "The research compass": an introduction to research in medical education: AMEE Guide No. 56.”
Cites
Qualitative Data Analysis: An Expanded Sourcebook
(1994) · Journal of Environmental Psychology · doi:10.1016/s0272-4944(05)80231-2 · Cited by 48,420 · see citing works
Standards for Reporting Qualitative Research: A Synthesis of Recommendations
O’Brien, B. C., Harris, I. B., Beckman, T. J., Reed, D. A., & Cook, D. A. (2014) · Academic Medicine · doi:10.1097/acm.0000000000000388 · Cited by 12,211 · cited 2× · see citing works
“Limitations and issues of reflexivity and ethics are clearly and explicitly described, including references to actions taken to address these areas.(3,4,12,14)”
Background(1996) · Cited by 11,584 · see citing works
The SAGE handbook of qualitative research
(2005) · Choice Reviews Online · doi:10.5860/choice.43-1330 · Cited by 10,173 · see citing works
Strategies for ensuring trustworthiness in qualitative research projects
Shenton, A. K. (2004) · Education for Information · doi:10.3233/efi-2004-22201 · Cited by 9,748 · cited 3× · see citing works
“Transferability is communicated, in part, through description of sampling factors such as: geographical location of the study, number and characteristics of participants, and the timeframe of data collection and analysis.(40) Such descriptions also contribute to the credibility of the results and readers’ determinatio…”
BackgroundMethodDetermining Validity in Qualitative Inquiry
Creswell, J. W., & Miller, D. L. (2000) · Theory Into Practice · doi:10.1207/s15430421tip3903_2 · Cited by 9,184 · cited 1× · see citing works
“Data triangulation is used to identify convergence of data obtained through multiple data sources and methods (eg, observation field notes and interview transcripts) to avoid or minimize error or bias and optimize accuracy in data collection and analysis processes.(33,35,36) Again, researcher practice in reflexivity t…”
Method(2011) · Cited by 7,157 · see citing works
The Sage Handbook of Qualitative Research[1]
(2006) · Qualitative Research in Organizations and Management An International Journal · doi:10.1108/17465640610666642 · Cited by 5,854 · see citing works
Sampling for qualitative research
Marshall, M. N. (1996) · Family Practice · doi:10.1093/fampra/13.6.522 · Cited by 4,293 · cited 3× · see citing works
“A typical best practice is purposive sampling methods, and when appropriate, convenience sampling may be justified.(29) Purposive sampling reflects intentional selection of research participants to optimize data sources for answering the research question.”
BackgroundEnhancing the quality and credibility of qualitative analysis.
(1999) · PubMed Central · Cited by 4,133 · see citing works
The problem of rigor in qualitative research
Sandelowski, M. (1986) · Advances in Nursing Science · doi:10.1097/00012272-198604000-00005 · Cited by 2,772 · cited 2× · see citing works
“As an alternative, some of these authors have published best practice guidelines for use by researchers and peer reviewers to achieve and assess methodological rigor and research quality.(12,13) Some journals within the field of health professions education have also established best practice guidance, as opposed to s…”
BackgroundThe Quality of Qualitative Research
Seale, C. F. (1999) · SAGE Publications Ltd eBooks · doi:10.4135/9780857020093 · Cited by 2,174 · see citing works
Validity in qualitative research
Whittemore, R., Chase, S. K., & Mandle, C. L. (2001) · Qualitative Health Research · doi:10.1177/104973201129119299 · Cited by 2,144 · see citing works
O’Reilly, M., & Parker, N. (2013) · Qualitative Research · doi:10.1177/1468794112446106 · Cited by 1,943 · cited 1× · see citing works
“Replication of the study using other samples and conducting additional types of follow-up studies are other options for better understanding the research phenomenon at hand.(31) American Journal of Pharmaceutical Education 2020; 84 (1) Article 7120.”
MethodValidity, reliability, and generalizability in qualitative research
Leung, L. (2015) · Journal of Family Medicine and Primary Care · doi:10.4103/2249-4863.161306 · Cited by 1,404 · cited 1× · see citing works
“The goal of rigor in qualitative research can be described as ensuring that the research design, method, and conclusions are explicit, public, replicable, open to critique, and free of bias.(41) Rigor in the research process and results are achieved when each element of studymethodology is systematic and transparent t…”
Background(1997) · Cited by 1,249 · see citing works
Presenting and evaluating qualitative research
Anderson, C. (2010) · American Journal of Pharmaceutical Education · doi:10.5688/aj7408141 · Cited by 1,188 · cited 1× · see citing works
“Still others have disseminated best practice guidelines through a series of methodological articles within journal publications.(2) In this article, attributes of rigor and quality and suggested best practices are presented as they relate to the steps of designing, conducting, and reporting qualitative research in a s…”
BackgroundValidity, trustworthiness and rigour: quality and the idea of qualitative research
Rolfe, G. (2006) · Journal of Advanced Nursing · doi:10.1111/j.1365-2648.2006.03727.x · Cited by 1,181 · cited 1× · see citing works
“execution and reporting of standards of rigor, and the extent to which meaningful contributions to thinking and practice in the field are presented.(13,39) Authors must avoid language heavy with connotations or adjectives that insert the researcher’s opinion into the database or manuscript.”
Background(1997) · Medical Entomology and Zoology · Cited by 849 · see citing works
In the field: Notes on observation in qualitative research
Mulhall, A. (2003) · Journal of Advanced Nursing · doi:10.1046/j.1365-2648.2003.02514.x · Cited by 838 · cited 3× · see citing works
“The pros and cons of observation approach, relative to the research question and study purpose, should be evaluated by the researcher, and the justification for the observational strategy selected should be made clear.(34) Regardless of the researcher’s degree of visibility to the study participants, persistent observ…”
BackgroundInfluentialCritically appraising qualitative research
Kuper, A., Lingard, L., & Levinson, W. (2008) · BMJ · doi:10.1136/bmj.a1035 · Cited by 784 · cited 1× · see citing works
“The framework defines and justifies the research question, the methodology selected to answer that question, and the perspectives from which interpretation of results and conclusions will be made.(5,6,20) Developing a well-integrated conceptual framework is essential to establishing a research topic based upon a thoro…”
MethodDeveloping qualitative research questions: A reflective process
Agee, J. (2009) · International Journal of Qualitative Studies in Education · doi:10.1080/09518390902736512 · Cited by 704 · cited 2× · see citing works
“Developing a FINER research question is critical to study rigor and quality and should not be rushed, as all other aspects of research design depend on the focus and clarity of the research question(s) guiding the study.(15) Agee provides clear and worthwhile additional guidance for developing qualitative research que…”
BackgroundThe problem of appraising qualitative research
Dixon-Woods, M. (2004) · Quality and Safety in Health Care · doi:10.1136/qshc.2003.008714 · Cited by 653 · see citing works
Scholarship assessed: Evaluation of the professoriate
Young, A. P. (1998) · The Journal of Academic Librarianship · doi:10.1016/s0099-1333(98)90125-2 · Cited by 641 · cited 1× · see citing works
“Glassick, Huber, and Maeroff identified six criteria applicable to assessing the quality of scholarship.(18,19) Now commonly referred to as the Glassick Criteria (Table 1), these critical attributes outline the essential elements of any scholarly approach and serve as a general research framework for developing resear…”
BackgroundUnderstanding medical education evidence, theory and practice
Swanwick, T., & Association for the Study of Medical Education (2010) · Cited by 561 · see citing works
Conceptual frameworks to illuminate and magnify
Bordage, G. (2009) · Medical Education · doi:10.1111/j.1365-2923.2009.03295.x · Cited by 479 · cited 1× · see citing works
“The framework defines and justifies the research question, the methodology selected to answer that question, and the perspectives from which interpretation of results and conclusions will be made.(5,6,20) Developing a well-integrated conceptual framework is essential to establishing a research topic based upon a thoro…”
MethodGlassick, C. E. (2000) · Academic Medicine · doi:10.1097/00001888-200009000-00007 · Cited by 430 · cited 1× · see citing works
“Glassick, Huber, and Maeroff identified six criteria applicable to assessing the quality of scholarship.(18,19) Now commonly referred to as the Glassick Criteria (Table 1), these critical attributes outline the essential elements of any scholarly approach and serve as a general research framework for developing resear…”
BackgroundData collection and sampling in qualitative research: does size matter?
Cleary, M., Horsfall, J., & Hayter, M. (2014) · Journal of Advanced Nursing · doi:10.1111/jan.12163 · Cited by 377 · cited 4× · see citing works
“Thus, accurately predicting a sample size during the planning phases of qualitative research can be challenging.(30) Care should be taken that sufficient quantity (think thick description) and quality (think rich description) of data have been collected prior to concluding that data saturation has been achieved.”
BackgroundMethodInfluentialQualitative research interviews
Knox, S., & Burkard, A. W. (2009) · Psychotherapy Research · doi:10.1080/10503300802702105 · Cited by 371 · cited 1× · see citing works
“Researcher reflexivity, or acknowledgement of researcher bias, is absolutely critical to the credibility and trustworthiness of data collection and analysis in such study designs.(32) Interviews should be recorded and transcribed verbatim prior to coding and analysis.”
Toward an agenda for evaluation of qualitative research
Stige, B., Malterud, K., & Midtgarden, T. (2009) · Qualitative Health Research · doi:10.1177/1049732309348501 · Cited by 327 · cited 1× · see citing works
“Researchers must be respectful of the participants’ contributions and quotes, and results must be reported truthfully and honestly.(8) Interview methods range from highly structured to increase dependability or completely open-ended to allow for interviewers to clarify a participant’s response for increased credibilit…”
BackgroundUnderstanding Medical Education
(2013) · Wiley eBooks · doi:10.1002/9781118472361 · Cited by 270 · see citing works
“The research compass”: an introduction to research in medical education: AMEE Guide No. 56
Ringsted, C., Hodges, B., & Scherpbier, A. (2011) · Medical Teacher · doi:10.3109/0142159x.2011.595436 · Cited by 231 · cited 1× · see citing works
“Ringsted, Hodges, and Sherpbier describe three essential parts to an effective conceptual framework: theories and/ or concepts and principles relevant to the phenomenon of interest; what is known and unknown from prior work, observations, and examples; and the researcher’s observations, ideas, and suppositions regardi…”
BackgroundSantiago-Delefosse, M., Gavin, A., Bruchez, C., Roux, P., & Stephen, S. L. (2016) · Social Science & Medicine · doi:10.1016/j.socscimed.2015.11.007 · Cited by 146 · cited 1× · see citing works
“Limitations and issues of reflexivity and ethics are clearly and explicitly described, including references to actions taken to address these areas.(3,4,12,14)”
BackgroundReason & Rigor: How Conceptual Frameworks Guide Research
Ravitch, S., & Riggan, M. (2011) · doi:10.12698/cpre.reasonandrigor · Cited by 143 · cited 3× · see citing works
“Recent contributions from Ravitch and colleagues present best practices in developing frameworks for conceptual and methodological coherence within a study design, regardless of the research approach.(23,24) Their recommendations and arguments are highly relevant to qualitative research.”
BackgroundWasserman, J. A., Clair, J. M., & Wilson, K. L. (2009) · Qualitative Research · doi:10.1177/1468794109106605 · Cited by 122 · see citing works
Exploring qualitatively-derived concepts: inductive—deductive pitfalls
Morse, J. M., & Mitcham, C. (2002) · International Journal of Qualitative Methods · doi:10.1177/160940690200100404 · Cited by 118 · cited 1× · see citing works
“Essentially, the qualitative researcher must carefully generate a conceptual framework that guides the research question and study design without allowing the conceptual framework to become so rigid as to dictate a testable hypothesis, which is the founding principle of deductive reasoning.(26)”
BackgroundThe newfound credibility of qualitative research? tales of technical essentialism and co-option
Barbour, R. S. (2003) · Qualitative Health Research · doi:10.1177/1049732303253331 · Cited by 108 · see citing works
The Quality of Qualitative Research
Turnbull, J. (2000) · Learning Disability Practice · doi:10.7748/ldp.2.4.28.s23 · Cited by 92 · see citing works
Understanding medical education
Swanwick, T. (2013) · Understanding Medical Education · doi:10.1002/9781118472361.ch1 · Cited by 91 · see citing works
Review criteria for research manuscripts.
Bordage, G., Caelleigh, A. S., Steinecke, A., Cj, B., Sj, C., McGaghie, W. C., Ln, P., Penn, G., Regehr, G., & Js, S. (2001) · PubMed · Cited by 79 · see citing works
Author guidelines for manuscripts reporting on qualitative research
Wu, S., Wyant, D. C., & Fraser, M. W. (2016) · Journal of the Society for Social Work and Research · doi:10.1086/685816 · Cited by 59 · cited 3× · see citing works
“As an alternative, some of these authors have published best practice guidelines for use by researchers and peer reviewers to achieve and assess methodological rigor and research quality.(12,13) Some journals within the field of health professions education have also established best practice guidance, as opposed to s…”
BackgroundQualitative Health Research: Challenges for the 21st Century
Morse, J. M. (2002) · Qualitative Health Research · doi:10.1177/1049732302012001009 · Cited by 44 · cited 1× · see citing works
“The framework defines and justifies the research question, the methodology selected to answer that question, and the perspectives from which interpretation of results and conclusions will be made.(5,6,20) Developing a well-integrated conceptual framework is essential to establishing a research topic based upon a thoro…”
MethodWriting an effective literature review: Part I: Mapping the gap
Lingard, L. (2017) · Perspectives on Medical Education · doi:10.1007/s40037-017-0401-x · Cited by 27 · see citing works
How to assess rigour... or not in qualitative papers
Sale, J. E. M. (2008) · Journal of Evaluation in Clinical Practice · doi:10.1111/j.1365-2753.2008.01093.x · Cited by 18 · see citing works
Critically appraising qualitative research
Kuper, A., Lingard, L., & Levinson, W. (n.d.) · Adult lives · doi:10.2307/j.ctt1t895q0.51
Flagged first, then by citations
1 of the 46 references couldn’t be matched to a known paper.
Research works printed but not linked: 1
- Creswell, 2013, Qualitative, quantitative, and mixed methods approaches, Res Des, 1
Cited by
Sorted by citations
The pillars of trustworthiness in qualitative research
Ahmed, S. K. (2024) · Journal of Medicine Surgery and Public Health · doi:10.1016/j.glmedi.2024.100051 · Cited by 1,283 · see citing works
Sporting Mind: The Interplay of Physical Activity and Psychological Health
Martín-Rodríguez, A., Gostian, L. A., Beltrán-Velasco, A. I., Belando‐Pedreño, N., Simón, J. A., López-Mora, C., Navarro-Jiménez, E., Tornero-Aguilera, J. F., & Clemente‐Suárez, V. J. (2024) · Sports · doi:10.3390/sports12010037 · Cited by 450 · see citing works
“…outcomes, it became apparent that there exists substantiation supporting the notion that sharing physical activities (unstructured free play) can facilitate the development of cooperation, task coherence, and leadership skills and foster an inclination towards friendship approach goals [154].”
BackgroundEstablishing trustworthiness and authenticity in qualitative pharmacy research
Amin, M. E. K., Nørgaard, L. S., Cavaco, A. M., Witry, M. J., Hillman, L., Cernasev, A., & Desselle, S. P. (2020) · Research in Social and Administrative Pharmacy · doi:10.1016/j.sapharm.2020.02.005 · Cited by 329 · see citing works
Criteria for Good Qualitative Research: A Comprehensive Review
Yadav, D. (2022) · The Asia-Pacific Education Researcher · doi:10.1007/s40299-021-00619-0 · Cited by 217 · see citing works
Rony, M. K. K., Kayesh, I., Bala, S. D., Akter, F., & Parvin, M. R. (2024) · Heliyon · doi:10.1016/j.heliyon.2024.e25718 · Cited by 190 · see citing works
“Secondly, prior to the commencement of data collection activities, participants were provided with comprehensive and transparent information detailing the research ’ s objectives, methodologies, potential implications, and ethical considerations [31].”
BackgroundInter-Coder Agreement in Qualitative Coding: Considerations for its Use
Halpin, S. N. (2024) · American Journal of Qualitative Research · doi:10.29333/ajqr/14887 · Cited by 149 · see citing works
Villamin, P., López, V., Thapa, D. K., & Cleary, M. L. (2024) · Journal of Advanced Nursing · doi:10.1111/jan.16481 · Cited by 292 · see citing works
“Ultimately, researchers should conduct the study with integrity, approach every step of the research process thoughtfully, and document all efforts to achieve rigour (Baillie 2015; Johnson, Adkins, and Chauvin 2020).”
Using ChatGPT for human–computer interaction research: a primer
Tabone, W., & de Winter, J. (2023) · Royal Society Open Science · doi:10.1098/rsos.231053 · Cited by 136 · see citing works
Maintaining reflexivity in qualitative nursing research
Peddle, M. (2021) · Nursing Open · doi:10.1002/nop2.999 · Cited by 84 · see citing works
Accessible Metaverse: A Theoretical Framework for Accessibility and Inclusion in the Metaverse
Othman, A., Chemnad, K., Hassanien, A. E., Tlili, A., Zhang, C. Y., Al‐Thani, D., Altınay, F., Chalghoumi, H., Al-Khalifa, H. S., Obeid, M., et al. (2024) · Multimodal Technologies and Interaction · doi:10.3390/mti8030021 · Cited by 79 · see citing works
Using the TACT Framework to Learn the Principles of Rigour in Qualitative Research
Daniel, B. K. (2019) · The Electronic Journal of Business Research Methods · doi:10.34190/jbrm.17.3.002 · Cited by 77 · see citing works
Roca, J., Vélez, O. C., Cemeli, T., Lavedán, A., Masot, O., & Botigué, T. (2021) · International Journal of Mental Health Nursing · doi:10.1111/inm.12858 · Cited by 73 · see citing works
Dziurka, M., Machul, M., Ozdoba, P., Obuchowska, A., Kotowski, M., Grzegorczyk, A., Pydyś, A., & Dobrowolska, B. B. (2022) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph19106352 · Cited by 69 · see citing works
Quality indicators for Delphi studies
Rodríguez, J. L., & Lertxundi, A. L. (2023) · Futures & Foresight Science · doi:10.1002/ffo2.172 · Cited by 72 · see citing works
Translation of research interviews: Do we have a problem with qualitative rigor?
McKenna, L. (2022) · Nurse author & editor · doi:10.1111/nae2.31 · Cited by 60 · see citing works
Rethinking Transparency and Rigor from a Qualitative Open Science Perspective
Steltenpohl, C. N., Lustick, H. A., Meyer, M. S., Lee, L. E., Stegenga, S. M., Reyes, L. S., & Renbarger, R. (2023) · Journal of Trial and Error · doi:10.36850/mr7 · Cited by 71 · see citing works
Using Triangulation and Crystallization to Make Qualitative Studies Trustworthy and Rigorous
Morgan, H. (2024) · The Qualitative Report · doi:10.46743/2160-3715/2024.6071 · Cited by 57 · see citing works
Cena, E., Brooks, J., Day, W., Goodman, S., Rousaki, A., Ruby-Granger, V., & Seymour-Smith, S. (2024) · International Journal of Qualitative Methods · doi:10.1177/16094069241282843 · Cited by 49 · see citing works
“…and increasing the homogenization of qualitative reporting (Shaw, 2019, p. 741) and that such criteria are inappropriate for judging studies across the diverse approaches and the multiple interpretative practices represented in qualitative research (Johnson et al., 2020; Kitto et al., 2008).”
Transforming the remittance industry: harnessing the power of blockchain technology
Christodoulou, I., Rizomyliotis, I., Κonstantoulaki, K., Nazarian, A., & Do, B. (2024) · Journal of Enterprise Information Management · doi:10.1108/jeim-03-2023-0112 · Cited by 45 · see citing works
Phenomenology: Researching the Lived Experience
Dodgson, J. E. (2023) · Journal of Human Lactation · doi:10.1177/08903344231176453 · Cited by 49 · see citing works
“The researchers must convince the reader that their findings are trustworthy, a critical concept extensively defined within qualitative research (Johnson et al., 2020; Shufutinsky, 2020; Stahl & King, 2020).”
BackgroundEnsuring validity and reliability in qualitative research
Noble, H. R., & Smith, J. (2025) · Evidence-Based Nursing · doi:10.1136/ebnurs-2024-104232 · Cited by 44 · see citing works
Lim, A. S., Lee, S. W. H., Karunaratne, N. S., & Caliph, S. M. (2020) · American Journal of Pharmaceutical Education · doi:10.5688/ajpe7920 · Cited by 41 · see citing works
“Finally, a peer review process was conducted by an independent reviewer to add rigor to the data analysis process.(25) This project was approved by the Monash University Human Research and Ethics Committee.”
MethodGuo, P., Pinto, C., Edwards, B., Pask, S., Firth, A., O’Brien, S., & Murtagh, F. E. (2022) · Palliative Medicine · doi:10.1177/02692163211043371 · Cited by 37 · see citing works
RETRACTED: ChatGPT in the classroom: navigating the generative AI wave in management education
Leelavathi, R., & Surendhranatha, R. C. (2024) · Journal of Research in Innovative Teaching & Learning · doi:10.1108/jrit-01-2024-0017 · Cited by 50 · see citing works
RetractedPre-testing Semi-structured Interview Questions Using Expert Review and Cognitive Interview Methods
Bhalla, S., Bahar, N., & Kanapathy, K. (2023) · International Journal of Business and Management · doi:10.26666/rmp.ijbm.2023.5.2 · Cited by 42 · see citing works
Tecnologias para a educação em saúde com adolescentes: revisão integrativa
Dourado, J. V. L., Arruda, L. P., Ponte, K. M. D. A., da Silva, M. A. M., Júnior, A. R. F., & Aguiar, F. A. R. (2021) · Avances en Enfermería · doi:10.15446/av.enferm.v39n2.85639 · Cited by 34 · see citing works
Tort‐Nasarre, G., Pollina-Pocallet, M., Suquet, Y. F., Ortega, M., Vilafranca-Cartagena, M., & Artigues-Barberà, E. (2023) · International Journal of Qualitative Studies on Health and Well-Being · doi:10.1080/17482631.2023.2170007 · Cited by 34 · see citing works
Ajayi, K. V., Page, R. L., Montour, T., Garney, W. R., Wachira, E., & Adeyemi, L. (2023) · Ethnicity and Health · doi:10.1080/13557858.2023.2259642 · Cited by 33 · see citing works
“…about the research process is provided to enable replicability); and con fi rmability (i.e. the researchers communicated and discussed the fi ndings objectively without bias or subjectivity, to ensure the fi ndings re fl ect the participant ’ s viewpoints) (Johnson, Adkins, and Chauvin 2020).”
BackgroundEnhancing Pedagogic Practice: A Review of Educational Processes
Montano, M. D. L. N. V. (2023) · Seminars in Medical Writing and Education · doi:10.56294/mw202329 · Cited by 33 · see citing works
Nguyen, T. Q., Nguyen, T., Le, V., et al. (2023) · Foods · doi:10.3390/foods12091848 · Cited by 32 · see citing works
Nevedal, A., Kowalski, C. P., Finley, E. P., Fix, G. M., Hamilton, A. B., & Koenig, C. J. (2025) · Implementation Science · doi:10.1186/s13012-025-01474-z · Cited by 39 · see citing works
Power, A., Atkinson, S., & Noonan, M. (2022) · Midwifery · doi:10.1016/j.midw.2022.103356 · Cited by 30 · see citing works
Survivors’ Dilemma: Young Adult Cancer Survivors’ Perspectives of Work-Related Goals
Ghazal, L. V., Merriman, J. D., Santacroce, S. J., & Dickson, V. V. (2021) · Workplace Health & Safety · doi:10.1177/21650799211012675 · Cited by 29 · see citing works
Research Methodologies in Health Professions Education Publications: Breadth and Rigor
Han, H., Youm, J. H., Tucker, C. R., Teal, C. R., Rougas, S. C., Park, Y. S., Mooney, C. J., Hanson, J. L., & Berry, A. (2022) · Academic Medicine · doi:10.1097/acm.0000000000004911 · Cited by 30 · see citing works
UK medical students’ mental health during the COVID-19 pandemic: a qualitative interview study
Rich, A., Viney, R., Silkens, M., Griffin, A., & Medišauskaitė, A. (2023) · BMJ Open · doi:10.1136/bmjopen-2022-070528 · Cited by 27 · see citing works
Sinha, P., Paudel, B., Ahmed, H., Mosimann, T., Phuti, A., Kovane, G. P., & Moagi, M. (2024) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph21081005 · Cited by 30 · see citing works
“A well-written publication should reflect the critical methodological approaches employed, providing readers with a thorough understanding as well as the ability to compare and contrast results [14].”
BackgroundDevelopment of a Metaverse Online Learning System for Undergraduate Nursing Students
Ryu, H., Lee, H., & Yoo, H. J. (2023) · Nurse Educator · doi:10.1097/nne.0000000000001509 · Cited by 26 · see citing works
A-Methodological Saturation: A Grounded Theory Analysis
Peters, H. C. (2023) · The Counseling Psychologist · doi:10.1177/00110000231179706 · Cited by 30 · see citing works
Aloudah, N. M. (2022) · Exploratory Research in Clinical and Social Pharmacy · doi:10.1016/j.rcsop.2022.100153 · Cited by 32 · see citing works
Inayat, S., Younas, A., Fàbregues, S., & Ali, P. A. (2024) · International Journal of Qualitative Methods · doi:10.1177/16094069241234187 · Cited by 31 · see citing works
“Poor data analysis in qualitative research also affects the overall rigor of the research, hence rendering the conclusions drawn as fl awed or underdeveloped (Johnson et al., 2020).”
Vaccines and autism: a preliminary qualitative study on the beliefs of concerned mothers in Italy
Pivetti, M., Melotti, G., & Mancini, C. (2020) · International Journal of Qualitative Studies on Health and Well-Being · doi:10.1080/17482631.2020.1754086 · Cited by 26 · see citing works
Almulhem, J. A. (2023) · Healthcare · doi:10.3390/healthcare11233024 · Cited by 30 · see citing works
“Peer review was conducted by an expert in qualitative research to ensure the study’s rigor [25].”
MethodAn exploration and comparison of #BodyPositivity and #BodyNeutrality content on TikTok
Hallward, L., Feng, O., & Duncan, L. R. (2023) · Eating Behaviors · doi:10.1016/j.eatbeh.2023.101760 · Cited by 27 · see citing works
Ruíz-Montero, P. J., Corral-Robles, S., Carmona, M. G., & Olivencia, J. J. L. (2021) · Physical Education and Sport Pedagogy · doi:10.1080/17408989.2021.1976740 · Cited by 24 · see citing works
Lei, P., Duo, E. N., Gao, Y., & Zhu, X. (2025) · BMC Nursing · doi:10.1186/s12912-025-03704-7 · Cited by 29 · see citing works
“After obtaining informed consent, the researchers provided detailed explanations regarding the study’s objectives, content, confidentiality agreements, and ethical guidelines [19].”
What are the needs and experiences of caregivers of people with heart failure? A qualitative study
Schutz, S. E., & Walthall, H. E. (2022) · Heart & Lung · doi:10.1016/j.hrtlng.2022.03.011 · Cited by 23 · see citing works
Demir, M., Håkansson, E., & Drott, J. (2023) · Journal of Advanced Nursing · doi:10.1111/jan.15966 · Cited by 23 · see citing works
Gray, L. J., & Durand, H. (2023) · BMC Women s Health · doi:10.1186/s12905-023-02370-8 · Cited by 23 · see citing works
The added value of the nurse practitioner: An evolutionary concept analysis
Savard, I., Hakim, G. A., & Kilpatrick, K. (2022) · Nursing Open · doi:10.1002/nop2.1512 · Cited by 23 · see citing works
Hafez, G., Aarnio, E., Mucherino, S., Kamusheva, M., Qvarnström, M., Potočnjak, I., Trečiokienė, I., Mihajlović, J., Ekenberg, M., van Boven, J. F. M., et al. (2024) · Journal of General Internal Medicine · doi:10.1007/s11606-024-08851-2 · Cited by 26 · see citing works
Challenges of home care: a qualitative study
Shahriari, M., Nia, D. H., kalij, F., et al. (2024) · BMC Nursing · doi:10.1186/s12912-024-01878-0 · Cited by 22 · see citing works
“Besides, he provided some parts of the interviews and their transcripts, along with the assigned codes, to three colleagues who were experts in qualitative research to confirm coding accuracy [23].”
BackgroundBond, C., Hui, A., Timmons, S., Wildbore, E. L., & Sinclair, S. (2022) · Journal of Mental Health · doi:10.1080/09638237.2022.2118692 · Cited by 22 · see citing works
“Our team comprised individuals from diverse clinical and educational backgrounds (mental health nurses; educators; lived-experience advisor) which is considered to help reduce confirmation bias (Johnson et al., 2020).”
BackgroundPeacock, A. S., Slade, C., & Wilson, C. B. (2021) · Journal of Advanced Nursing · doi:10.1111/jan.15091 · Cited by 22 · see citing works
Baragar, B. H., Schick‐Makaroff, K., Manns, B., Love, S., Donald, M., Santana, M., Corradetti, B., Finlay, J. L., Johnson, J. A., Walsh, M. W., et al. (2023) · Journal of Patient-Reported Outcomes · doi:10.1186/s41687-022-00538-8 · Cited by 22 · see citing works
Self-citationAdekunle, P., Aigbavboa, C., Akinradewo, O., Ikuabe, M., & Otasowie, K. (2024) · Buildings · doi:10.3390/buildings14030827 · Cited by 10 · see citing works
Drivers for women entrepreneurship in Central Asia: A case analysis of Kazakhstani enterprises
Smagulova, G., & Goncalves, M. V. (2023) · Journal of Transnational Management · doi:10.1080/15475778.2023.2285621 · Cited by 16 · see citing works
Benefits of Hearing Voices Groups & Other Self-Help Groups for Voice Hearers: A Systematic Review
Corentin, C., Fitzgerald, C., & Goodwin, J. (2023) · Issues in Mental Health Nursing · doi:10.1080/01612840.2023.2189953 · Cited by 21 · see citing works
AI as a Co-researcher in the Qualitative Research Workflow: Transforming Human-AI Collaboration
Costa, A. P., Bryda, G., Christou, P., & Kasperiūnienė, J. (2025) · International Journal of Qualitative Methods · doi:10.1177/16094069251383739 · Cited by 22 · see citing works
“Some scholars suggest more advanced roles for AI, such as a re fl exive collaborator or ‘ devil ’ s advocate, ’ challenging assumptions and encouraging critical re fl ection (Johnson et al., 2020; Johnson & Paulus, 2024; Saro fi m, 2024; Thominet, Acosta, et al., 2024; Thominet, Amorim, et al., 2024).”
Lo, S. H. S., Chau, J. P. C., Lam, S. K., & Saran, R. (2022) · Neuropsychological Rehabilitation · doi:10.1080/09602011.2022.2049827 · Cited by 18 · see citing works
Hirsch, K., Niemann, W., & Swart, B. (2024) · Journal of Transport and Supply Chain Management · doi:10.4102/jtscm.v18i0.1025 · Cited by 19 · see citing works
Luis Mundaca, T., Rotmann, S., Ashby, K., Karlin, B., Butler, D., Sequeira, M. M., Gouveia, J. P., Palma, P., Realini, A., Maggiore, S., et al. (2023) · Energy Research & Social Science · doi:10.1016/j.erss.2023.103205 · Cited by 19 · see citing works
“‘Prolonged engagement ’ should be adopted as standard practice, as this would allow researchers to reflect upon any potential bias during data collection and analysis [126].”
BackgroundA conflicted tribe under pressure: A qualitative study of negative workplace behaviour in nursing
Hawkins, N., Jeong, S., Smith, T., & Sim, J. (2022) · Journal of Advanced Nursing · doi:10.1111/jan.15491 · Cited by 18 · see citing works
“This descrip - tion allows readers to evaluate the applicability of the results to other contexts (Forero et al., 2018; Johnson et al., 2020 ).”
Incorporating community perspectives in health impact assessment: A toolbox
Leuenberger, A., Winkler, M. S., Lyatuu, I., Cossa, H., Zabré, H. R., Dietler, D., & Farnham, A. (2022) · Environmental Impact Assessment Review · doi:10.1016/j.eiar.2022.106788 · Cited by 19 · see citing works
Experiences, Supports, and Strategies of First-Generation College Students
Watts, G. W., Garfield, T. A., & Davis, M. T. (2022) · College Teaching · doi:10.1080/87567555.2022.2050669 · Cited by 18 · see citing works
Performance management practices in remote and hybrid work environments: An exploratory study
Mabaso, C., & Manuel, N. (2024) · SA Journal of Industrial Psychology · doi:10.4102/sajip.v50i0.2202 · Cited by 20 · see citing works
Salajegheh, M., Sandars, J. E., Mirzazadeh, A., et al. (2024) · BMC Medical Education · doi:10.1186/s12909-024-05715-5 · Cited by 17 · see citing works
“To confirm dependability, and the process and product of the several randomly selected analyzed transcripts was presented to a qualitative researcher outside of the team and the plausibility of the findings confirmed that the analyses and interpretations were justifiable [22].”
MethodCamouflaging Autism in Pursuit of Friendship and Intimate Relationships: A Systematic Review
Ridgway, K., Cooke, K., Demmer, D. H., Hooley, M., Westrupp, E. M., & Stokes, M. A. (2024) · Autism in Adulthood · doi:10.1089/aut.2023.0160 · Cited by 18 · see citing works
Burney, V., McCann, C., & Arnold-Saritepe, A. M. (2024) · Child & Youth Care Forum · doi:10.1007/s10566-024-09797-6 · Cited by 19 · see citing works
“Other techniques such as reflective journaling, peer discussion, and debriefing were used to support the rigour of the process and analytic outcomes of the study (Braun & Clarke, 2021, 2023; Johnson et al., 2020).”
Stroboscopic visual training: The potential for clinical application in neurological populations
Das, J., Walker, R., Barry, G., et al. (2023) · PLOS Digital Health · doi:10.1371/journal.pdig.0000335 · Cited by 17 · see citing works
Law, R., & Jevons, E. F. P. (2023) · Journal of Human Nutrition and Dietetics · doi:10.1111/jhn.13212 · Cited by 17 · see citing works
Job Satisfaction and Favorable Outcome on Teachers’ Work Performance: The Noblest Profession
Mallillin, L. L. D. (2021) · Asian Journal of Education and Social Studies · doi:10.9734/ajess/2021/v21i130498 · Cited by 17 · see citing works
Ndawo, G. (2021) · International Journal of Africa Nursing Sciences · doi:10.1016/j.ijans.2021.100375 · Cited by 27 · see citing works
Yang, Z. Y., Jia, H.-H., Zhang, F., Huang, H., Hao, X., & Wang, A. (2023) · Journal of Clinical Nursing · doi:10.1111/jocn.16901 · Cited by 18 · see citing works
Ethical Challenges and Opportunities of AI in End-of-Life Palliative Care: Integrative Review
Abejas, A. G., Santos, D. G., Costa, F. L., Cordero, A. M., Mota‐Filipe, H., & Vergès, À. S. (2025) · Interactive Journal of Medical Research · doi:10.2196/73517 · Cited by 18 · see citing works
Dewage, K. A. K. W., Hasan, R., Rehman, B., & Mahmood, S. (2024) · Information · doi:10.3390/info15100653 · Cited by 16 · see citing works
Patterson, E. W., Ball, K., Corkish, J., & Whittick, I. M. (2022) · Qualitative Research Journal · doi:10.1108/qrj-06-2022-0086 · Cited by 18 · see citing works
Foster, M. M., Legg, M., Hummell, E., Burridge, L. H., & Laurie, K. (2020) · Brain Impairment · doi:10.1017/brimp.2020.12 · Cited by 16 · see citing works
Corser, J., Caes, L., Bateman, S., Noel, M. E., & Jordan, A. L. (2023) · European Journal of Pain · doi:10.1002/ejp.2140 · Cited by 15 · see citing works
“Frequent supervision meetings with the lead supervisor, and feedback from colleagues and co- authors on each iteration of analysis and write- up allowed for credibility and validity checks through peer review (Johnson et al., 2020).”
Ho, T. Q. A., Engel, L., Melvin, G., Le, L. K.-D., Le, H. N. D., & Mihalopoulos, C. (2024) · The Patient - Patient-Centered Outcomes Research · doi:10.1007/s40271-024-00707-5 · Cited by 15 · see citing works
“To increase the study credibility, all the transcripts were checked for accuracy [28] and de-identified by [first author] prior to importing into NVivo version 12 [29].”
BackgroundMethodGavrilas, L., & Kotsis, K. Τ. (2024) · International Journal of Research & Method in Education · doi:10.1080/1743727x.2024.2358780 · Cited by 16 · see citing works
“To achieve substantiation, researchers will need to employ more rigorous analysis methods using reliable research tools (Johnson et al ., 2020, Taherdoost 2021).”
Use of AI to improve the teaching-learning process in children with special abilities
Torres, E. R., Rodríguez, R. C., & Briñez, E. T. (2023) · LatIA · doi:10.62486/latia202321 · Cited by 32 · see citing works
Qian, M., Zhu, P., Wu, Q., Wang, W., Shi, G., Ding, Y., Zhang, H., Gu, X., Xu, T., & Zhang, Q. (2023) · BMC Medical Education · doi:10.1186/s12909-023-04741-z · Cited by 15 · see citing works
“The rigor of results was assessed in terms of credibility, transferability, dependability, and confirmability to develop the trustworthiness of research [42].”
BackgroundTerry, J. (2023) · Health Expectations · doi:10.1111/hex.13864 · Cited by 15 · see citing works
“perspectives on what supports hearing parents with deaf children to improve structures that exist in health, social care, education and community settings.(16) Bronfenbrenner's ecological systems theory(12)”
BackgroundFalk, A. S., Stenman, M., Kåhlin, J., Hultgren, R., & Nymark, C. (2023) · Intensive and Critical Care Nursing · doi:10.1016/j.iccn.2023.103493 · Cited by 17 · see citing works
Guidance for Qualitative Research Manuscripts in Pharmacy Education
Kawaguchi‐Suzuki, M., Blakely, M. L., Childs‐Kean, L. M., Devraj, R., Frenzel, J. E., Medina, M. S., Pate, A. N., Thurston, M. M., & Franks, A. M. (2023) · American Journal of Pharmaceutical Education · doi:10.1016/j.ajpe.2023.100089 · Cited by 16 · see citing works
“15,42,43 These instruments direct researchers to include details about the qualitative approach (eg, grounded theory, content analysis, etc.), methods (eg, sampling strategy, coding practices, etc.), and reporting of codes and themes.”
BackgroundTan, M. M., Oke, S., Ellison, D., Huard, C., & Veluz‐Wilkins, A. K. (2023) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph20085574 · Cited by 15 · see citing works
Goode, R. W., Godoy, S. M., Wolfe, H., Olson, K., Agbozo, B., Mueller, A., Noem, T., Malian, H. M., Peat, C. M., Watson, H. J., et al. (2022) · International Journal of Eating Disorders · doi:10.1002/eat.23888 · Cited by 15 · see citing works
Soft skills elements in structured clinical skill assessment: a qualitative study
Jamaludin, T. S. S., Nurumal, M. S., Ahmad, N. B., et al. (2022) · Bali Medical Journal · doi:10.15562/bmj.v11i3.3721 · Cited by 15 · see citing works
Experiences of health management among people at high risk of stroke in China: A qualitative study
Guo, L.-N., Guo, Y.-L., Booth, J., Wei, M., Wang, L., Zhu, Y., He, Y., & Liu, Y.-J. (2022) · Nursing Open · doi:10.1002/nop2.1327 · Cited by 14 · see citing works
Singh, H., Tang, T., Thombs, R., Armas, A., Nie, J. X., Nelson, M. L. A., & Gray, C. S. (2022) · International Journal of Qualitative Methods · doi:10.1177/16094069221107144 · Cited by 15 · see citing works
Natuhwera, G., Ellis, P., Acuda, S. W., & Namukwaya, E. (2022) · SAGE Open Medicine · doi:10.1177/20503121221095942 · Cited by 15 · see citing works
Quality in qualitative research: a relational process
Timonen, V., Foley, G., & Conlon, C. (2024) · Qualitative Research Journal · doi:10.1108/qrj-07-2024-0153 · Cited by 16 · see citing works
Nyando, M., Makombe, D., Mboma, A. T., Mwakilama, E. P., & Nyirenda, L. J. (2023) · BMC Women s Health · doi:10.1186/s12905-023-02800-7 · Cited by 23 · see citing works
“The researchers developed an audit trail which was a recording of activities so that others can follow [21].”
BackgroundJohnson, G. U., Towell‐Barnard, A., McLean, C., & Ewens, B. A. (2024) · Australian Critical Care · doi:10.1016/j.aucc.2024.07.076 · Cited by 15 · see citing works
Bannon, S. M., Fishbein, N. S., Lovette, B. C., Wang, K., Waterhouse, C., Rajala, C., Costantini, H., Lichstein, K., Giacino, J. T., Vranceanu, A., et al. (2022) · Rehabilitation Psychology · doi:10.1037/rep0000462 · Cited by 15 · see citing works
Tourism graduate students’ employability skills: Results and implications of a Zimbabwean study
Moyo, B., & Özgit, H. (2022) · Journal of Psychology in Africa · doi:10.1080/14330237.2022.2031616 · Cited by 14 · see citing works
Shimoinaba, K., McKenna, L., & Copnell, B. (2021) · International Emergency Nursing · doi:10.1016/j.ienj.2021.101102 · Cited by 15 · see citing works
Mohan, M., & Deb, R. (2023) · Journal of Caring Sciences · doi:10.34172/jcs.2024.31955 · Cited by 14 · see citing works
“12,13 However, in the present study, both authors (MM and RD) independently conducted data coding after a thorough review/familiarization of transcripts from all interviews, focusing on segments relevant to the current research.”
BackgroundEvidence-informed development of women-focused cardiac rehabilitation education
Ghisi, G. L. D. M., Hébert, A.-A., OH, P. I., Colella, T. J. F., Aultman, C., Gonzaga, C. C., Nijhawan, R., Ross, M., & Grace, S. L. (2023) · Heart & Lung · doi:10.1016/j.hrtlng.2023.11.004 · Cited by 14 · see citing works
- Authors
- Johnson, J. L., Adkins, D., & Chauvin, S.
- Affiliations
- William Carey University (US)
- Louisiana State University (US)
- ORCID
- Johnson, Jessica L.
- Venue
- American Journal of Pharmaceutical Education
- Publisher
- Elsevier BV
- Published
- 2020-01
- Volume
- 84
- Issue
- 1
- Pages
- 7120
- ISSN
- 0002-9459 (ISSN-L)
- PMC
- PMC7055404
- OpenAlex
- W2936015247
- Cited by
- 1,238
- References
- 46
- Citations by year
- 2026: 228 · 2025: 348 · 2024: 316 · 2023: 178 · 2022: 94 · 2021: 40 · 2020: 7 · 2019: 2
- FWCI
- 86.37
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Locations
- American Journal of Pharmaceutical Education (publishedVersion)
- PubMed (publishedVersion)
- PubMed Central (submittedVersion)
- Topics
- Health Sciences › Health Professions › General Health Professions › Health Policy Implementation Science
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Innovations in Medical Education
- Social Sciences › Education › Qualitative Research Methods and Applications
- Keywords
- qualitative research rigor, research quality indicators, health professions education, research design, trustworthiness, researcher bias, reflexivity, conceptual framework
- MeSH terms
- Data Collection, Education, Pharmacy, Fellowships and Scholarships, Humans, Research Design, Research Personnel, Quality Indicators, Health Care
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Claims read by deepseek-v4.1-flash under definition version 3 (extract-v3) on 2026-10-11.
Classified by jev-1.13-20260917 (gold-guideline-v0.2) on 2026-10-11.
Cited sources are checked by gpt-6-sol.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review