Should we exclude inadequately reported studies from qualitative systematic reviews? An evaluation of sensitivity analyses in two case study reviews
Abstract
The role of critical appraisal of qualitative studies in systematic reviews remains an ongoing cause for debate. Key to such a debate is whether quality assessment can or should be used to exclude studies. In our study, we extended the use of existing criteria to assess the quality of reporting of studies included in two qualitative systematic reviews. We then excluded studies deemed to be inadequately reported from the subsequent analysis. We tested the impact of these exclusions on the overall findings of the synthesis and its depth or thickness. Exclusion of so-called inadequately reported studies had no meaningful effect on the synthesis. There was a correlation between quality of reporting of a study and its values as a source for the final synthesis. We propose that there is a possible case for excluding inadequately reported studies from qualitative evidence synthesis.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Methodological quality criteria are more difficult to interpret because the reviewers need to judge whether the results of a study that are reported can be trustworthy.
“Methodological quality criteria are more difficult to interpret because the reviewers need to judge whether the results of a study that are reported can be trustworthy (3, 22).”
From The Mixed Methods Appraisal Tool (MMAT) version 2018 for information professionals and researchers (2018) · cites this paper as [22]
The Quality of Reporting Tool was used to critically appraise the included sources of evidence.
“We used the Quality of Reporting Tool [36] to critically appraise the included sources of evidence.”
From Experiences of Using Digital Mindfulness-Based Interventions: Rapid Scoping Review and Thematic Synthesis (2023) · cites this paper as [36]
The quality of reporting tool by Carroll et al was used to assess quality.
“To account for the methodological variety of studies, the quality of reporting tool by Carroll et al [22] was used to assess quality.”
From Barriers to and facilitators of user engagement with digital mental health interventions: Systematic review (2021) · cites this paper as [22]
Cites
Qualitative evaluation and research methods
Ellis, D. J. (1990) · International Journal of Information Management · doi:10.1016/0268-4012(90)90041-p · Cited by 17,942 · see citing works
Qualitative Data Analysis: A Sourcebook of New Methods
Lotto, L. S., Miles, M. B., & Huberman, A. M. (1986) · Educational Evaluation and Policy Analysis · doi:10.3102/01623737008003329 · Cited by 10,338 · see citing works
CONSORT 2010 Statement: updated guidelines for reporting parallel group randomised trials
Schulz, K. F., Altman, D. G., Moher, D., & for the CONSORT Group (2010) · BMJ · doi:10.1136/bmj.c332 · Cited by 9,329 · see citing works
Methods for the thematic synthesis of qualitative research in systematic reviews
Thomas, J., & Harden, A. (2008) · BMC Medical Research Methodology · doi:10.1186/1471-2288-8-45 · Cited by 9,312 · see citing works
(1990) · Cited by 8,425 · see citing works
Qualitative Research: Rigour and qualitative research
Mays, N., & Pope, C. (1995) · BMJ · doi:10.1136/bmj.311.6997.109 · Cited by 2,715 · see citing works
Checklists for improving rigour in qualitative research: a case of the tail wagging the dog?
Barbour, R. S. (2001) · BMJ · doi:10.1136/bmj.322.7294.1115 · Cited by 2,613 · see citing works
Validity in qualitative research
Whittemore, R., Chase, S. K., & Mandle, C. L. (2001) · Qualitative Health Research · doi:10.1177/104973201129119299 · Cited by 2,144 · see citing works
Synthesising qualitative and quantitative evidence: A review of possible methods
Dixon-Woods, M., Agarwal, S., Jones, D., Young, B., & Sutton, A. (2005) · Journal of Health Services Research & Policy · doi:10.1177/135581960501000110 · Cited by 2,132 · see citing works
Methods for the synthesis of qualitative research: a critical review
Barnett-Page, E., & Thomas, J. (2009) · BMC Medical Research Methodology · doi:10.1186/1471-2288-9-59 · Cited by 2,087 · see citing works
Pawson, R. (2006) · doi:10.4135/9781849209120 · Cited by 1,791 · see citing works
Emerging Criteria for Quality in Qualitative and Interpretive Research
Lincoln, Y. S. (1995) · Qualitative Inquiry · doi:10.1177/107780049500100301 · Cited by 1,568 · see citing works
Handbook for Synthesizing Qualitative Research
Sandelowski, M., & Barroso, J. V. (2006) · Medical Entomology and Zoology · Cited by 1,096 · see citing works
Popay, J., Rogers, A., & Williams, G. (1998) · Qualitative Health Research · doi:10.1177/104973239800800305 · Cited by 987 · see citing works
Haussler, S. C., & Cloutterbuck, J. (2008) · The Journal of Continuing Education in Nursing · doi:10.3928/00220124-20080101-07 · Cited by 941 · see citing works
Campbell, R., Pound, P., Pope, C., Britten, N., Pill, R., Morgan, M., & Donovan, J. (2003) · Social Science & Medicine · doi:10.1016/s0277-9536(02)00064-3 · Cited by 921 · see citing works
Grol, R., Dalhuijsen, J., Thomas, S., Veld, C. I. ‘., Rutten, G., & Mokkink, H. (1998) · BMJ · doi:10.1136/bmj.317.7162.858 · Cited by 877 · see citing works
How can systematic reviews incorporate qualitative research? A critical perspective
Dixon-Woods, M., Bonas, S., Booth, A., Jones, D. R., Miller, T., Sutton, A. J., Shaw, R. L., Smith, J. A., & Young, B. (2006) · Qualitative Research · doi:10.1177/1468794106058867 · Cited by 860 · see citing works
Self-citationMeta-Study of Qualitative Health Research
Paterson, B., Thorne, S., Canam, C., & Jillings, C. (2001) · doi:10.4135/9781412985017 · Cited by 664 · see citing works
The problem of appraising qualitative research
Dixon-Woods, M. (2004) · Quality and Safety in Health Care · doi:10.1136/qshc.2003.008714 · Cited by 653 · see citing works
Dixon-Woods, M., Sutton, A., Shaw, R., Miller, T., Smith, J., Young, B., Bonas, S., Booth, A., & Jones, D. (2007) · Journal of Health Services Research & Policy · doi:10.1258/135581907779497486 · Cited by 546 · see citing works
Self-citationUsing qualitative metasummary to synthesize qualitative and quantitative descriptive findings
Sandelowski, M., Barroso, J. V., & Voils, C. I. (2007) · Research in Nursing & Health · doi:10.1002/nur.20176 · Cited by 541 · see citing works
Carroll, C., Booth, A., & Cooper, K. (2011) · BMC Medical Research Methodology · doi:10.1186/1471-2288-11-29 · Cited by 461 · see citing works
Self-citationHannes, K., Lockwood, C. S., & Pearson, A. (2010) · Qualitative Health Research · doi:10.1177/1049732310378656 · Cited by 417 · see citing works
A multidimensional conceptual framework for analysing public involvement in health services research
Oliver, S. R., Rees, R. W., Clarke‐Jones, L., Milne, R., Oakley, A., Gabbay, J., Stein, K., Buchanan, P., & Gyte, G. M. (2008) · Health Expectations · doi:10.1111/j.1369-7625.2007.00476.x · Cited by 344 · see citing works
Harden, A., Garcia, J., Oliver, S., Rees, R., Shepherd, J., Brunton, G., & Oakley, A. (2004) · Journal of Epidemiology and Community Health · doi:10.1136/jech.2003.014829 · Cited by 328 · see citing works
Eakin, J. M., & Mykhalovskiy, E. (2003) · Journal of Evaluation in Clinical Practice · doi:10.1046/j.1365-2753.2003.00392.x · Cited by 296 · see citing works
Noyes, J., & Popay, J. (2007) · Journal of Advanced Nursing · doi:10.1111/j.1365-2648.2006.04092.x · Cited by 269 · see citing works
Qualitative research in systematic reviews
Dixon‐Woods, M., & Fitzpatrick, R. M. (2001) · BMJ · doi:10.1136/bmj.323.7316.765 · Cited by 232 · see citing works
Toward Methodological Emancipation in Applied Health Research
Thorne, S. E. (2010) · Qualitative Health Research · doi:10.1177/1049732310392595 · Cited by 147 · see citing works
Carroll, C., Booth, A., Papaioannou, D. E., Sutton, A., & Wong, R. (2009) · Journal of Continuing Education in the Health Professions · doi:10.1002/chp.20041 · Cited by 107 · see citing works
Self-citationReasons for delay in contraceptive clinic utilization
Zabin, L. S., Stark, H. A., & Emerson, M. R. (1991) · Journal of Adolescent Health · doi:10.1016/0197-0070(91)90015-e · Cited by 93 · see citing works
Wilkinson, A., Forbes, A., Bloomfield, J. G., & Gee, C. F. (2004) · International Journal of Nursing Studies · doi:10.1016/j.ijnurstu.2003.11.001 · Cited by 89 · see citing works
How to Appraise the Studies: An Introduction to Assessing Study Quality
Petticrew, M. P., & Roberts, H. M. (2006) · Wiley eBooks · doi:10.1002/9780470754887.ch5 · Cited by 65 · see citing works
Metasynthesis: a guide to knitting smoke
Downe, S. M. (2008) · Cited by 56 · see citing works
Carroll, C., Lloyd-Jones, M., Cooke, J., & Owen, J. (2011) · Journal of Public Health · doi:10.1093/pubmed/fdr103 · Cited by 44 · see citing works
Self-citationAddressing the issue of e‐learning and online genetics for health professionals
Gresty, K. A., Skirton, H., & Evenden, A. J. (2007) · Nursing and Health Sciences · doi:10.1111/j.1442-2018.2007.00296.x · Cited by 33 · see citing works
Students' Acquisition and Use of School Condoms in a High School Condom Availability Program
Schuster, M. A., Bell, R. M., Berry, S. H., & Kanouse, D. E. (1997) · PEDIATRICS · doi:10.1542/peds.100.4.689 · Cited by 32 · see citing works
Can the Internet widen participation in reproductive medicine education for professionals?
Whittington, K. (2004) · Human Reproduction · doi:10.1093/humrep/deh333 · Cited by 21 · see citing works
Guttmacher, S. J., Lieberman, L., Hc, W., Ward, D. M., Radosh, A., Rafferty, Y., & Freudenberg, N. (1995) · PubMed · Cited by 19 · see citing works
Delivering multiprofessional web-based psychosocial education: the lessons learnt
Kinghorn, S. (2005) · International Journal of Palliative Nursing · doi:10.12968/ijpn.2005.11.8.19613 · Cited by 14 · see citing works
CPD for GPs using the THOR-GP website
Thorley, K., Turner, S., Hussey, L. J., Zarin, N., & Agius, R. M. (2007) · Occupational Medicine · doi:10.1093/occmed/kqm116 · Cited by 13 · see citing works
Sex, Kids and Politics: Health Services in Schools
Emihovich, C. A., & Herrington, C. D. (1997) · Medical Entomology and Zoology · Cited by 11 · see citing works
Safer medicine administration through the use of e-learning.
Hare, C., Davies, C., & Shepherd, M. (2006) · PubMed · Cited by 11 · see citing works
Community Reactions to Reproductive Health Care at Three School‐Based Clinics in Louisiana
Zeanah, P. D., Morse, E. V., Simon, P. M., Stock, M. R., Pratt, J. L., & Sterne, S. (1996) · Journal of School Health · doi:10.1111/j.1746-1561.1996.tb06277.x · Cited by 9 · see citing works
An evaluation of Brook sexual health outreach in schools
Salmon, D., & Ingram, J. C. (2008) · Bristol Research (University of Bristol) · Cited by 8 · see citing works
Information Technology in Nursing
(2018) · Springer Publishing Company eBooks · doi:10.1891/9780826121820.0009 · Cited by 7 · see citing works
Hurst, J. (2005) · EDTNA-ERCA Journal · doi:10.1111/j.1755-6686.2005.tb00419.x · Cited by 4 · see citing works
Flagged first, then by citations
1 of the 49 references couldn’t be matched to a known paper.
Cited by
Sorted by citations
The Mixed Methods Appraisal Tool (MMAT) version 2018 for information professionals and researchers
Hong, Q. N., Fàbregues, S., Bartlett, G., Boardman, F., Cargo, M., Dagenais, P., Gagnon, M.-P., Griffiths, F., Nicolau, B., O’Cathain, A., et al. (2018) · Education for Information · doi:10.3233/efi-180221 · Cited by 4,737 · see citing works
“Methodological quality criteria are more difficult to interpret because the reviewers need to judge whether the reported results of a study are trustworthy (Carroll et al., 2012; Hong & Pluye, 2018a).”
Borghouts, J., Eikey, E., Mark, G., De Leon, C., Schueller, S. M., Schneider, M., Stadnick, N., Zheng, K., Mukamel, D., & Sorkin, D. H. (2021) · Journal of Medical Internet Research · doi:10.2196/24387 · Cited by 1,069 · see citing works
“To account for the methodological variety of studies, the quality of reporting tool by Carroll et al [22] was used to assess quality.”
MethodLong, H. A., French, D. P., & Brooks, J. M. (2020) · Research Methods in Medicine & Health Sciences · doi:10.1177/2632084320947559 · Cited by 1,112 · see citing works
Hong, Q. N., Gonzalez‐Reyes, A., & Pluye, P. (2018) · Journal of Evaluation in Clinical Practice · doi:10.1111/jep.12884 · Cited by 1,107 · see citing works
Improving the content validity of the mixed methods appraisal tool: a modified e-Delphi study
Hong, Q. N., Pluye, P., Fàbregues, S., Bartlett, G., Boardman, F., Cargo, M., Dagenais, P., Gagnon, M.-P., Griffiths, F., Nicolau, B., et al. (2019) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2019.03.008 · Cited by 1,082 · see citing works
“Compared to reporting quality criteria, methodological quality criteria are more difficult to interpret because the reviewers need to judge whether the results that are reported can be trustworthy [43].”
Background“Best fit” framework synthesis: refining the method
Carroll, C., Booth, A., Leaviss, J., & Rick, J. (2013) · BMC Medical Research Methodology · doi:10.1186/1471-2288-13-37 · Cited by 649 · see citing works
Self-citationBenoot, C., Hannes, K., & Bilsen, J. J. R. (2016) · BMC Medical Research Methodology · doi:10.1186/s12874-016-0114-6 · Cited by 399 · see citing works
Toyé, F., Seers, K., Allcock, N., Briggs, M., Carr, E., & Barker, K. L. (2014) · BMC Medical Research Methodology · doi:10.1186/1471-2288-14-80 · Cited by 326 · see citing works
Appraising Qualitative Research for Evidence Syntheses: A Compendium of Quality Appraisal Tools
Majid, U., & Vanstone, M. (2018) · Qualitative Health Research · doi:10.1177/1049732318785358 · Cited by 301 · see citing works
Stroke Survivors' Experiences of Physical Rehabilitation: A Systematic Review of Qualitative Studies
Luker, J. A., Lynch, E. A., Bernhardsson, S., Bennett, L., & Bernhardt, J. A. (2015) · Archives of Physical Medicine and Rehabilitation · doi:10.1016/j.apmr.2015.03.017 · Cited by 288 · see citing works
Booth, A., Harris, J., Croot, E. J., Springett, J., Campbell, F., & Wilkins, E. (2013) · BMC Medical Research Methodology · doi:10.1186/1471-2288-13-118 · Cited by 278 · see citing works
Self-citationFegran, L., Hall, E. O. C., Uhrenfeldt, L., Aagaard, H., & Ludvigsen, M. S. (2013) · International Journal of Nursing Studies · doi:10.1016/j.ijnurstu.2013.02.001 · Cited by 271 · see citing works
Booth, A., & Carroll, C. (2015) · BMJ Quality & Safety · doi:10.1136/bmjqs-2014-003642 · Cited by 262 · see citing works
Self-citationCarroll, C., & Booth, A. (2015) · Research Synthesis Methods · doi:10.1002/jrsm.1128 · Cited by 235 · see citing works
Self-citationHeath, G., Farré, A., & Shaw, K. L. (2016) · Patient Education and Counseling · doi:10.1016/j.pec.2016.08.011 · Cited by 227 · see citing works
Online Peer-to-Peer Communities in the Daily Lives of People With Chronic Illness
Kingod, N., Cleal, B. R., Wahlberg, A., & Husted, G. R. (2016) · Qualitative Health Research · doi:10.1177/1049732316680203 · Cited by 223 · see citing works
Attitudes Toward the Ethics of Research Using Social Media: A Systematic Review
Golder, S., Ahmed, S., Norman, G., & Booth, A. (2017) · Journal of Medical Internet Research · doi:10.2196/jmir.7082 · Cited by 214 · see citing works
Self-citationGreaves, C. J., Poltawski, L., Garside, R., & Briscoe, S. (2017) · Health Psychology Review · doi:10.1080/17437199.2017.1299583 · Cited by 182 · see citing works
Odendaal, W., Goudge, J., Griffiths, F. E., Tomlinson, M., Leon, N., & Daniels, K. (2015) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd011942 · Cited by 175 · see citing works
Using Sandelowski and Barroso’s Meta-Synthesis Method in Advancing Qualitative Evidence
Ludvigsen, M. S., Hall, E. O. C., Meyer, G., Fegran, L., Aagaard, H., & Uhrenfeldt, L. (2015) · Qualitative Health Research · doi:10.1177/1049732315576493 · Cited by 167 · see citing works
Damarell, R., Morgan, D. D., & Tieman, J. (2020) · BMC Family Practice · doi:10.1186/s12875-020-01197-8 · Cited by 151 · see citing works
The relationship between wasting and stunting in young children: A systematic review
Thurstans, S., Sessions, N., Dolan, C., Sadler, K., Cichon, B., Isanaka, S., Roberfroid, D., Stobaugh, H., Webb, P., & Khara, T. (2022) · Maternal & Child Nutrition · doi:10.1111/mcn.13246 · Cited by 156 · see citing works
Toyé, F., Seers, K., Allcock, N., Briggs, M., Carr, E., Andrews, J., & Barker, K. L. (2013) · BMC Medical Research Methodology · doi:10.1186/1471-2288-13-46 · Cited by 151 · see citing works
Is planned adaptation to heat reducing heat-related mortality and illness? A systematic review
Boeckmann, M., & Rohn, I. (2014) · BMC Public Health · doi:10.1186/1471-2458-14-1112 · Cited by 146 · see citing works
Shiraishi, N., & Reilly, J. (2019) · Social Psychiatry and Psychiatric Epidemiology · doi:10.1007/s00127-018-1617-8 · Cited by 142 · see citing works
A Conceptual Framework for Critical Appraisal in Systematic Mixed Studies Reviews
Hong, Q. N., & Pluye, P. (2019) · Journal of Mixed Methods Research · doi:10.1177/1558689818770058 · Cited by 139 · see citing works
Patient experiences of outcomes of bariatric surgery: a systematic review and qualitative synthesis
Coulman, K. D., MacKichan, F., Blazeby, J. M., & Owen‐Smith, A. (2017) · Obesity Reviews · doi:10.1111/obr.12518 · Cited by 133 · see citing works
Chen, L., Xiao, L. D., Chamberlain, D. J., & Newman, P. (2021) · Journal of Clinical Nursing · doi:10.1111/jocn.15807 · Cited by 130 · see citing works
McCaffrey, N., Bradley, S. L., Ratcliffe, J., & Currow, D. C. (2016) · Journal of Pain and Symptom Management · doi:10.1016/j.jpainsymman.2016.02.012 · Cited by 131 · see citing works
Dufour, I., Chouinard, M.-C., Dubuc, N., Beaudin, J., Lafontaine, S., & Hudon, C. (2019) · BMC Geriatrics · doi:10.1186/s12877-019-1197-9 · Cited by 128 · see citing works
Pluye, P., Bengoechea, E. G., Granikov, V., Kaur, N., & Tang, D. L. (2018) · International Journal of Multiple Research Approaches · doi:10.29034/ijmra.v10n1a3 · Cited by 128 · see citing works
Hall, B. J., Sou, K.-L., Beanland, R. L., Lackey, M. J., Tso, L. S., Ma, Q., Doherty, M. C., & Tucker, J. D. (2016) · AIDS and Behavior · doi:10.1007/s10461-016-1537-0 · Cited by 121 · see citing works
Factors influencing health behaviour change during pregnancy: a systematic review and meta-synthesis
Rockliffe, L., Peters, S., Heazell, A. E. P., & Smith, D. M. (2021) · Health Psychology Review · doi:10.1080/17437199.2021.1938632 · Cited by 119 · see citing works
Weir, N., Newham, R., Dunlop, E., & Bennie, M. (2019) · Implementation Science · doi:10.1186/s13012-019-0867-5 · Cited by 119 · see citing works
Tod, D., Booth, A., & Smith, B. M. (2021) · International Review of Sport and Exercise Psychology · doi:10.1080/1750984x.2021.1952471 · Cited by 117 · see citing works
Self-citationWhy, when and how to update a meta-ethnography qualitative synthesis
France, E. F., Wells, M., Lang, H., & Williams, B. (2016) · Systematic Reviews · doi:10.1186/s13643-016-0218-4 · Cited by 116 · see citing works
Nicholson, E., McDonnell, T., Brún, A. D., Barrett, M. J., Bury, G., Collins, C., Hensey, C. C., & McAuliffe, É. (2020) · BMC Health Services Research · doi:10.1186/s12913-020-05527-5 · Cited by 108 · see citing works
Caskurlu, S., Richardson, J. C., Maeda, Y., & Kozan, K. (2020) · Computers & Education · doi:10.1016/j.compedu.2020.104111 · Cited by 109 · see citing works
Wakida, E. K., Akena, D. H., Okello, E. S., Kinengyere, A. A., Kamoga, R., Mindra, A., Obua, C., & Talib, Z. M. (2017) · Systematic Reviews · doi:10.1186/s13643-017-0561-0 · Cited by 105 · see citing works
De Buck, E., Van Remoortel, H., Hannes, K., Govender, T., Naidoo, S., Avau, B., Veegaete, A. V., Musekiwa, A., Lutje, V., Cargo, M., et al. (2017) · Campbell Systematic Reviews: Better Evidence for a Better World · doi:10.4073/csr.2017.7 · Cited by 99 · see citing works
A meta-ethnography of patients’ experience of chronic non-malignant musculoskeletal pain
Toye, F., Seers, K., Allcock, N., Briggs, M., Carr, E., Andrews, J., & Barker, K. (2013) · Health Services and Delivery Research · doi:10.3310/hsdr01120 · Cited by 98 · see citing works
Luker, J. A., Murray, C. M., Lynch, E. A., Bernhardsson, S., Shannon, M. M., & Bernhardt, J. (2017) · Archives of Physical Medicine and Rehabilitation · doi:10.1016/j.apmr.2017.02.024 · Cited by 94 · see citing works
Koshoedo, S. A., Paul-Ebhohimhen, V., Jepson, R. G., & Watson, M. C. (2015) · BMC Public Health · doi:10.1186/s12889-015-1893-0 · Cited by 96 · see citing works
Jørgensen, C. H. R., Thomsen, T. G., Ross, L., Dietz, S. M., Therkildsen, S., Grøenvold, M., Rasmussen, C. L., & Johnsen, A. T. (2017) · Qualitative Health Research · doi:10.1177/1049732317721477 · Cited by 94 · see citing works
Alford, V., Ewen, S. C., Webb, G., McGinley, J. L., Brookes, A., & Remedios, L. J. (2014) · Disability and Rehabilitation · doi:10.3109/09638288.2014.935875 · Cited by 83 · see citing works
Lloyd, A., Bannigan, K., Sugavanam, T., & Freeman, J. A. (2018) · The JBI Database of Systematic Reviews and Implementation Reports · doi:10.11124/jbisrir-2017-003499 · Cited by 81 · see citing works
Understanding Help-Seeking Behavior in Depression: A Qualitative Synthesis of Patients’ Experiences
Doblyte, S., & Jiménez-Mejías, E. (2017) · Qualitative Health Research · doi:10.1177/1049732316681282 · Cited by 86 · see citing works
Withdrawal of anticancer therapy in advanced disease: a systematic literature review
Clarke, G., Johnston, S. J., Corrie, P. G., Kuhn, I. L., & Barclay, S. I. G. (2015) · BMC Cancer · doi:10.1186/s12885-015-1862-0 · Cited by 79 · see citing works
Brown, M., Boateng, E. A., & Evans, C. (2016) · Nurse Education Today · doi:10.1016/j.nedt.2015.12.024 · Cited by 78 · see citing works
Health Care Workers’ Experiences of Mindfulness Training: a Qualitative Review
Morgan, P., Simpson, J., & Smith, A. (2015) · Mindfulness · doi:10.1007/s12671-014-0313-3 · Cited by 75 · see citing works
Information Quality Frameworks for Digital Health Technologies: Systematic Review
Fadahunsi, K. P., O’Connor, S., Akinlua, J. T., Wark, P. A., Gallagher, J., Carroll, C., Car, J., Majeed, A., & O’Donoghue, J. (2021) · Journal of Medical Internet Research · doi:10.2196/23479 · Cited by 79 · see citing works
Self-citationMakanjuola, T., Taddese, H. B., & Booth, A. (2014) · PLoS ONE · doi:10.1371/journal.pone.0087166 · Cited by 71 · see citing works
Self-citationLauzon-Schnittka, J., Audette-Chapdelaine, S., Boutin, D., Wilhelmy, C., Auger, A.-M., & Brodeur, M. (2022) · Research Involvement and Engagement · doi:10.1186/s40900-022-00388-0 · Cited by 75 · see citing works
Chung, V. C., Ma, H., Hong, L. C., & Griffiths, S. M. (2012) · PLoS ONE · doi:10.1371/journal.pone.0050022 · Cited by 71 · see citing works
Patient motivations and expectations prior to bariatric surgery: A qualitative systematic review
Cohn, I., Raman, J., & Sui, Z. (2019) · Obesity Reviews · doi:10.1111/obr.12919 · Cited by 69 · see citing works
Palliative care in patients with haematological neoplasms: An integrative systematic review
Moreno‐Alonso, D., Porta-Sales, J., Monforte‐Royo, C., Trelis-Navarro, J., Sureda, A. M., & Sevilla-Ribosa, A. F. D. (2017) · Palliative Medicine · doi:10.1177/0269216317735246 · Cited by 68 · see citing works
Suglo, J. N., & Evans, C. (2020) · PLoS ONE · doi:10.1371/journal.pone.0240938 · Cited by 65 · see citing works
Kinnear, F. J., Wainwright, E. M., Perry, R. E., Lithander, F. E., Bayly, G. R., Huntley, A. L., Cox, J. S., Hamilton-Shield, J. P., & Searle, A. (2019) · BMJ Open · doi:10.1136/bmjopen-2019-030290 · Cited by 65 · see citing works
Shaw, R. L., Holland, C., Pattison, H. M., & Cooke, R. W. I. (2016) · Social Science & Medicine · doi:10.1016/j.socscimed.2016.03.015 · Cited by 61 · see citing works
Graham, H. M., de Bell, S., Flemming, K., Sowden, A. J., White, P. C. L., & Wright, K. E. (2018) · Journal of Transport & Health · doi:10.1016/j.jth.2018.10.007 · Cited by 60 · see citing works
Hannes, K., Booth, A., Harris, J., & Noyes, J. (2013) · Systematic Reviews · doi:10.1186/2046-4053-2-84 · Cited by 61 · see citing works
Self-citationEdwards, J., Coward, M., & Carey, N. (2022) · BMJ Open · doi:10.1136/bmjopen-2021-052227 · Cited by 61 · see citing works
Pradeilles, R., Holdsworth, M., Olaitan, O., Irache, A., Osei-Kwasi, H. A., Ngandu, C. B., & Cohen, E. (2021) · Public Health Nutrition · doi:10.1017/s1368980021000768 · Cited by 59 · see citing works
Lynch, L., Moorhead, A., Long, M., & Hawthorne-Steele, I. (2023) · Journal of Child and Family Studies · doi:10.1007/s10826-022-02498-5 · Cited by 58 · see citing works
Jurek, L., Leadbitter, K., Falissard, B., Colin, C., Touzet, S., & Geoffray, M. (2022) · Autism · doi:10.1177/13623613221112204 · Cited by 57 · see citing works
Mentrup, S., Harris, E., Gomersall, T., Köpke, S., & Astin, F. (2019) · Qualitative Health Research · doi:10.1177/1049732319887949 · Cited by 55 · see citing works
Tierney, S., Mahtani, K. R., Wong, G., Todd, J., Roberts, N. W., Akinyemi, O., Howes, S., & Turk, A. (2021) · Health & Social Care in the Community · doi:10.1111/hsc.13516 · Cited by 57 · see citing works
Johnston, K., Preston, R., Strivens, E., Qaloewai, S., & Larkins, S. (2019) · Aging & Mental Health · doi:10.1080/13607863.2019.1606891 · Cited by 53 · see citing works
Trübswasser, U., Verstraeten, R., Salm, L., Holdsworth, M., Baye, K., Booth, A., Feskens, E. J. M., Gillespie, S., & Talsma, E. F. (2020) · Obesity Reviews · doi:10.1111/obr.13163 · Cited by 51 · see citing works
Self-citationMoving qualitative synthesis research forward in education: A methodological systematic review
Maeda, Y., Caskurlu, S., Kenney, R. H., Kozan, K., & Richardson, J. C. (2021) · Educational Research Review · doi:10.1016/j.edurev.2021.100424 · Cited by 66 · see citing works
Coales, K., Jennings, H. M., Afaq, S., Arsh, A., Bhatti, M. M., Siddiqui, F., & Siddiqi, N. (2023) · Global Health Action · doi:10.1080/16549716.2023.2228112 · Cited by 50 · see citing works
Smith, R., Martin, A., Wright, T., Hulbert, S., & Hatzidimitriadou, E. (2021) · Archives of Gerontology and Geriatrics · doi:10.1016/j.archger.2021.104471 · Cited by 49 · see citing works
Graham, H. M., de Bell, S., Flemming, K., Sowden, A. J., White, P. C. L., & Wright, K. E. (2018) · Ageing and Society · doi:10.1017/s0144686x18001381 · Cited by 49 · see citing works
Franklin, P., Arber, A., Reed, L., & Ream, E. (2018) · Palliative Medicine · doi:10.1177/0269216318803494 · Cited by 48 · see citing works
Experiences of peer work in drug use service settings: A systematic review of qualitative evidence
Chen, Y., Yuan, Y., & Reed, B. G. (2023) · International Journal of Drug Policy · doi:10.1016/j.drugpo.2023.104182 · Cited by 46 · see citing works
Gorst, S. L., Young, B., Williamson, P. R., Wilding, J. P. H., & Harman, N. (2018) · BMJ Open Diabetes Research & Care · doi:10.1136/bmjdrc-2018-000615 · Cited by 45 · see citing works
Charitou, M., Quayle, E., & Sutherland, A. (2020) · Sexuality and Disability · doi:10.1007/s11195-020-09646-z · Cited by 47 · see citing works
Social climate in forensic mental health settings: A systematic review of qualitative studies
Doyle, P., Quayle, E., & Newman, E. (2017) · Aggression and Violent Behavior · doi:10.1016/j.avb.2017.06.008 · Cited by 44 · see citing works
Toor, N., Hanley, T., & Hebron, J. (2016) · Journal of Psychologists and Counsellors in Schools · doi:10.1017/jgc.2016.21 · Cited by 42 · see citing works
Implementing Juvenile Drug Treatment Courts: A Meta-aggregation of Process Evaluations
Wilson, D. B., Olaghere, A., & Kimbrell, C. S. (2019) · Journal of Research in Crime and Delinquency · doi:10.1177/0022427819826630 · Cited by 40 · see citing works
Ho, J., See, M. T. A., Tan, A. J. Q., Levett-Jones, T. L., Lau, T. C., Zhou, W., & Liaw, S. Y. (2023) · Patient Education and Counseling · doi:10.1016/j.pec.2023.107965 · Cited by 40 · see citing works
Parenting Among Mothers Who Experienced Child Sexual Abuse: A Qualitative Systematic Review
Lange, B. C. L., Condon, E. M., & Gardner, F. E. M. (2019) · Qualitative Health Research · doi:10.1177/1049732319882914 · Cited by 39 · see citing works
Factors preceding occupational distress in emergency nurses: An integrative review
Caulfield, R., Wiseman, T., Gullick, J. G., & Ogilvie, R. (2022) · Journal of Clinical Nursing · doi:10.1111/jocn.16461 · Cited by 38 · see citing works
Evans, C., Tweheyo, R., McGarry, J., Eldridge, J., Albert, J., Nkoyo, V., & Higginbottom, G. A. (2019) · Health Services and Delivery Research · doi:10.3310/hsdr07310 · Cited by 38 · see citing works
Schofield, R., Dibb, B., Coles-Gale, R., & Jones, C. J. (2021) · International Journal of Nursing Studies · doi:10.1016/j.ijnurstu.2021.103927 · Cited by 37 · see citing works
Campbell, F., Booth, A., Hackett, S., & Sutton, A. (2018) · Trauma Violence & Abuse · doi:10.1177/1524838018770414 · Cited by 36 · see citing works
Self-citationQian, J., Pan, P., Wu, M., Zheng, Q., Sun, S., Liu, L., Sun, Y., & Yu, X. (2021) · Journal of Advanced Nursing · doi:10.1111/jan.14853 · Cited by 37 · see citing works
Osborne, E. L., Ainsworth, B., Hooper, N., & Atkinson, M. J. (2023) · Journal of Medical Internet Research · doi:10.2196/44220 · Cited by 37 · see citing works
“We used the Quality of Reporting Tool [36] to critically appraise the included sources of evidence.”
Kılıç, D., Armstrong, H. L., & Graham, C. A. (2020) · Journal of Sex & Marital Therapy · doi:10.1080/0092623x.2020.1781722 · Cited by 36 · see citing works
Sánchez, T. E., Linehan, L. A., O’Donoghue, K., Byrne, M., & Meaney, S. (2022) · Health & Social Care in the Community · doi:10.1111/hsc.14072 · Cited by 39 · see citing works
What factors affect sustained adoption of safe water, hygiene and sanitation technologies?
Hulland, K. R. S., Martin, N., Dreibelbis, R., Valliant, J. D., & WINCH, P. J. (2015) · doi:10.23846/srs002 · Cited by 34 · see citing works
Awan, H., Mughal, F., Kingstone, T., Chew-Graham, C., & N. Corp (2021) · The British journal of general practice : the journal of the Royal College of General Practitioners · doi:10.3399/bjgp.2021.0345 · Cited by 32 · see citing works
Patients' perception of hope in palliative care: A systematic review and narrative synthesis
Velić, S., Qama, E., Diviani, N., & Rubinelli, S. (2023) · Patient Education and Counseling · doi:10.1016/j.pec.2023.107879 · Cited by 33 · see citing works
Ziemann, A., Brown, L., Sadler, E., Ocloo, J. E., Boaz, A., & Sandall, J. (2019) · Systematic Reviews · doi:10.1186/s13643-019-1180-8 · Cited by 34 · see citing works
Body image concerns in patients with an implantable cardioverter defibrillator: a scoping review
Frydensberg, V. S., Skovbakke, S. J., Pedersen, S. S., & Kok, R. N. (2018) · Pacing and Clinical Electrophysiology · doi:10.1111/pace.13421 · Cited by 32 · see citing works
Informal carer experiences of UK dementia services—A systematic review
Francis, N. A., & Hanna, P. (2020) · Journal of Psychiatric and Mental Health Nursing · doi:10.1111/jpm.12698 · Cited by 31 · see citing works
Brown, M. C., Podmore, M., Araújo‐Soares, V., Skinner, R., & Sharp, L. (2022) · Health Psychology Review · doi:10.1080/17437199.2022.2032795 · Cited by 32 · see citing works
Smoking cessation in the workplace
Fishwick, D., Carroll, C., McGregor, M., Drury, M. I., Webster, J., Bradshaw, L., Rick, J., & Leaviss, J. (2013) · Occupational Medicine · doi:10.1093/occmed/kqt107 · Cited by 31 · see citing works
Self-citationKerins, C., McHugh, S., McSharry, J., Reardon, C. M., Hayes, C., Perry, I. J., Geaney, F., Seery, S., & Kelly, C. (2020) · International Journal of Behavioral Nutrition and Physical Activity · doi:10.1186/s12966-020-00948-1 · Cited by 30 · see citing works
Hannes, K., Petry, K., & Heyvaert, M. (2017) · International Journal of Research & Method in Education · doi:10.1080/1743727x.2017.1299124 · Cited by 29 · see citing works
- Authors
- Carroll, C., Booth, A., & Lloyd-Jones, M.
- Affiliations
- University of Sheffield (GB)
- Venue
- Qualitative Health Research
- Publisher
- SAGE Publications
- Published
- 2012-08-03
- Volume
- 22
- Issue
- 10
- Pages
- 1425-1434
- ISSN
- 1049-7323 (ISSN-L)
- 1552-7557
- OpenAlex
- W2161865743
- Cited by
- 248
- References
- 49
- Citations by year
- 2026: 16 · 2025: 22 · 2024: 26 · 2023: 14 · 2022: 21 · 2021: 22 · 2020: 31 · 2019: 17 · 2018: 20 · 2017: 13 · 2016: 18 · 2015: 10 · 2014: 7 · 2013: 10 · 2012: 1
- FWCI
- 2.45
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Qualitative Health Research (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Social Sciences › Education › Qualitative Research Methods and Applications
- Social Sciences › Sociology and Political Science › Delphi Technique in Research
- Keywords
- study exclusion, critical appraisal, quality assessment, reporting quality, qualitative evidence synthesis, sensitivity analysis
- MeSH terms
- Review Literature as Topic, Sensitivity and Specificity, Reproducibility of Results, Qualitative Research
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
