Integrating qualitative research with trials in systematic reviews
Open accessAbstract
Research questionWhat is known about the barriers to, and facilitators of, fruit and vegetable intake among children aged 4-10 years?Synthesis of quantitative and qualitative studies Controlled trials 1. Application of inclusion criteria 2. Quality assessment (n=33) 3. Data extraction 4. Quantitative synthesis (n=21) Qualitative trials 1. Application of inclusion criteria 2. Quality assessment (n=8) 3. Data extraction 4. Quantitative synthesis (n=8) Fig 1 Stages of the review Evidence for Policy
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The use to date of interpretive approaches to synthesis has been confined to the synthesis of qualitative research only.
“In general, the use to date of interpretive approaches to synthesis has been confined to the synthesis of qualitative research only [6-8].”
From Conducting a critical interpretive synthesis of the literature on access to healthcare by vulnerable groups (2006) · cites this paper as [8]
The paper’s “Synthesis 3: bringing the two sets of studies together” describes using findings from an interpretive qualitative synthesis to combine evidence from qualitative studies and controlled trials. The Discussion calls this integration a new review method, contrary to the unqualified claim that such approaches had been confined to synthesising qualitative research only. No page numbers are available in our copy. (LLM, conf=0.80)
Checked by a reasoning model — may be wrong.
Experimental — accuracy not yet measuredMethods for including qualitative and quantitative evidence in systematic reviews developed by the EPPI Centre have involved refinements and extensions of conventional systematic review methodology and have limited their application of interpretive techniques to synthesis of qualitative evidence.
“Methods for including qualitative and quantitative evidence in systematic reviews developed by the EPPI Centre at the Institute of Education, London, have involved refinements and extensions of conventional systematic review methodology [6-8], and have limited their application of interpretive techniques to synthesis of qualitative evidence.”
From Conducting a critical interpretive synthesis of the literature on access to healthcare by vulnerable groups (2006) · cites this paper as [8]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
(2000) · Cited by 9,198 · see citing works
Qualitative Research: Rigour and qualitative research
Mays, N., & Pope, C. (1995) · BMJ · doi:10.1136/bmj.311.6997.109 · Cited by 2,715 · see citing works
Methodological Issues in Combining Diverse Study Types in Systematic Reviews
Harden, A., & Thomas, J. (2005) · International Journal of Social Research Methodology · doi:10.1080/13645570500155078 · Cited by 371 · see citing works
Self-citationHarden, A., Garcia, J., Oliver, S., Rees, R., Shepherd, J., Brunton, G., & Oakley, A. (2004) · Journal of Epidemiology and Community Health · doi:10.1136/jech.2003.014829 · Cited by 328 · see citing works
Self-citationSexual health education interventions for young people: a methodological review
Oakley, A., Fullerton, D. A., Holland, J., Arnold, S., France-Dawson, M., Kelley, P., & McGrellis, S. (1995) · BMJ · doi:10.1136/bmj.310.6973.158 · Cited by 250 · see citing works
Self-citationQualitative research in systematic reviews
Dixon‐Woods, M., & Fitzpatrick, R. M. (2001) · BMJ · doi:10.1136/bmj.323.7316.765 · Cited by 232 · see citing works
(2003) · UCL Discovery (University College London) · Cited by 162 · see citing works
Self-citationRoberts, K. A., Dixon‐Woods, M., Fitzpatrick, R. M., Abrams, K. R., & Jones, D. R. (2002) · The Lancet · doi:10.1016/s0140-6736(02)11560-1 · Cited by 159 · see citing works
Peer-delivered health promotion for young people: A systematic review of different study designs
Harden, A., Oakley, A., & Oliver, S. R. (2001) · Health Education Journal · doi:10.1177/001789690106000406 · Cited by 155 · see citing works
Self-citationLOEVINSOHN, B. P. (1990) · International Journal of Epidemiology · doi:10.1093/ije/19.4.788 · Cited by 131 · see citing works
Qualitative research in health care: II. A structured review and evaluation of studies
Boulton, M., Fitzpatrick, R., & Swinburn, C. (1996) · Journal of Evaluation in Clinical Practice · doi:10.1111/j.1365-2753.1996.tb00041.x · Cited by 109 · see citing works
Contemporary Studies of the Effectiveness of Social Work
Macdonald, G. M., Sheldon, B., & Gillespie, J. (1992) · The British Journal of Social Work · doi:10.1093/oxfordjournals.bjsw.a055920 · Cited by 101 · see citing works
Ten Criteria for Evaluating Qualitative Research Proposals
Cobb, A. K., & Hagemaster, J. N. (1987) · Journal of Nursing Education · doi:10.3928/0148-4834-19870401-04 · Cited by 94 · see citing works
Flagged first, then by citations
Research works printed but not linked: 2
- Peersman G, Oliver S, Oakley A. EPPI-Centre review guidelines: data collec- tions for the EPIC database. London: EPPI-Centre, Social Science Research Unit, Institute of Education, University of London, 1997.
- Medical Sociology Group. Criteria for the evaluation of qualitative research papers. Med Sociol News 1996;22:69-71.
Cited by
Sorted by citations
Methods for the thematic synthesis of qualitative research in systematic reviews
Thomas, J., & Harden, A. (2008) · BMC Medical Research Methodology · doi:10.1186/1471-2288-8-45 · Cited by 9,312 · see citing works
Self-citationSystematic reviews in the social sciences: a practical guide
(2006) · Choice Reviews Online · doi:10.5860/choice.43-5664 · Cited by 4,074 · see citing works
Systematic reviews: CRD's guidance for undertaking reviews in health care
Tacconelli, E. (2010) · The Lancet Infectious Diseases · doi:10.1016/s1473-3099(10)70065-7 · Cited by 3,237 · see citing works
Dixon-Woods, M., Cavers, D., Agarwal, S., Annandale, E., Arthur, A., Harvey, J., Hsu, R., Katbamna, S., Olsen, R., Smith, L., et al. (2006) · BMC Medical Research Methodology · doi:10.1186/1471-2288-6-35 · Cited by 2,053 · see citing works
Pluye, P., & Hong, Q. N. (2014) · Annual Review of Public Health · doi:10.1146/annurev-publhealth-032013-182440 · Cited by 1,363 · see citing works
Rasmussen, M., Krølner, R. F., Klepp, K., Lytle, L. M., Brug, J., Bere, E. T., & Due, P. (2006) · International Journal of Behavioral Nutrition and Physical Activity · doi:10.1186/1479-5868-3-22 · Cited by 1,096 · see citing works
Clarifying differences between review designs and methods
Gough, D., Thomas, J., & Oliver, S. (2012) · Systematic Reviews · doi:10.1186/2046-4053-1-28 · Cited by 1,063 · see citing works
Self-citationSimkhada, B., Teijlingen, E. R. V., Porter, M., & Simkhada, P. (2008) · Journal of Advanced Nursing · doi:10.1111/j.1365-2648.2007.04532.x · Cited by 977 · see citing works
“Indeed, integrating different types of data within one review is one of the key challenges facing systematic reviewers (Thomas et al. 2004).”
BackgroundConducting a meta-ethnography of qualitative literature: Lessons learnt
Atkins, S., Lewin, S., Smith, H., Engel, M., Fretheim, A., & Volmink, J. (2008) · BMC Medical Research Methodology · doi:10.1186/1471-2288-8-21 · Cited by 981 · see citing works
Storylines of research in diffusion of innovation: a meta-narrative approach to systematic review
Greenhalgh, T., Robert, G., Macfarlane, F., Bate, P., Kyriakidou, O., & Peacock, R. (2005) · Social Science & Medicine · doi:10.1016/j.socscimed.2004.12.001 · Cited by 913 · see citing works
Reviewing studies with diverse designs: the development and evaluation of a new tool
Sirriyeh, R., Lawton, R., Gardner, P., & Armitage, G. (2012) · Journal of Evaluation in Clinical Practice · doi:10.1111/j.1365-2753.2011.01662.x · Cited by 715 · see citing works
“[5] provide an example of this in their systematic review of peer-delivered health promotion interventions for young people, one of a number of successful attempts at synthesizing and reviewing diverse studies [6,7].”
BackgroundMethodological guidance for the conduct of mixed methods systematic reviews
Stern, C., Lizarondo, L. M., Carrier, J., Godfrey, C. M., Rieger, K. L., Salmond, S. W., Apóstolo, J., Kirkpatrick, P., & Loveday, H. P. (2020) · JBI Evidence Synthesis · doi:10.11124/jbisrir-d-19-00169 · Cited by 747 · see citing works
Guidance on the conduct of narrative synthesis in sytematic reviews
Popay, J., Roberts, H. M., Sowden, A. J., Petticrew, M. P., Arai, L., Rodgers, M., & Britten, N. (2006) · Cited by 690 · see citing works
“Best fit” framework synthesis: refining the method
Carroll, C., Booth, A., Leaviss, J., & Rick, J. (2013) · BMC Medical Research Methodology · doi:10.1186/1471-2288-13-37 · Cited by 649 · see citing works
“However, this could be developed further were the technique to be used as a first stage in matrix-based synthesis methods to integrate qualitative and quantitative evidence to develop effective interventions [11,69,70].”
MethodEvaluating meta-ethnography: systematic analysis and synthesis of qualitative research
Campbell, R., Pound, P., Morgan, M., Daker-White, G., Britten, N., Pill, R., Yardley, L., Pope, C., & Donovan, J. (2011) · Health Technology Assessment · doi:10.3310/hta15430 · Cited by 619 · see citing works
Keating, A., Lee, A., & Holland, A. E. (2011) · Chronic Respiratory Disease · doi:10.1177/1479972310393756 · Cited by 583 · see citing works
“A previously described framework for synthesizing qualitative and quantitative data in systematic reviews was used.(13) For qualitative data, two reviewers (AK and AH) examined the descriptive themes and their associated data to determine overall themes emerging across studies; consensus was reached via discussion.”
MethodBooth, A. (2016) · Systematic Reviews · doi:10.1186/s13643-016-0249-x · Cited by 587 · see citing works
Criteria for the systematic review of health promotion and public health interventions
Jackson, N., & Waters, E. (2005) · Health Promotion International · doi:10.1093/heapro/dai022 · Cited by 572 · see citing works
“The Evidence for Policy and Practice Information and Co-ordinating (EPPI) Centre has developed methods for synthesizing the findings from diverse types of studies within one review (Thomas et al., 2004b).”
BackgroundMethodThe Benefits and Challenges of Using Systematic Reviews in International Development Research
Mallett, R., Hagen-Zanker, J., Slater, R., & Duvendack, M. (2012) · Journal of Development Effectiveness · doi:10.1080/19439342.2012.711342 · Cited by 565 · see citing works
Noyes, J., Booth, A., Flemming, K., Garside, R., Harden, A., Lewin, S., Pantoja, T., Hannes, K., Cargo, M., & Thomas, J. (2018) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2017.06.020 · Cited by 480 · see citing works
“What is the likelihood of excluding valuable insights on the basis of quality? Consider if excluding a study will affect assessments of adequacy or coherence of qualitative synthesized findings [16]? Do multiple qualitative studies with methodological concerns report similar consistent findings? Need to report deviant…”
BackgroundMethodInfluentialSelf-citationNoyes, J., Booth, A., Moore, G., Flemming, K., Tunçalp, Ö., & Shakibazadeh, E. (2019) · BMJ Global Health · doi:10.1136/bmjgh-2018-000893 · Cited by 497 · see citing works
Young people and healthy eating: a systematic review of research on barriers and facilitators
Shepherd, J. (2005) · Health Education Research · doi:10.1093/her/cyh060 · Cited by 484 · see citing works
“This methodology is described further elsewhere [20, 22, 30].”
Carroll, C., Booth, A., & Cooper, K. (2011) · BMC Medical Research Methodology · doi:10.1186/1471-2288-11-29 · Cited by 461 · see citing works
“including qualitative data describing people’s attitudes and beliefs from satisfaction surveys as well as more traditional qualitative study designs [6,15].”
BackgroundInternet-based medical education: a realist review of what works, for whom and in what circumstances
Wong, G., Greenhalgh, T., & Pawson, R. (2010) · BMC Medical Education · doi:10.1186/1472-6920-10-12 · Cited by 443 · see citing works
“It contributes to an emerging field in systematic review, in which qualitative reviews are undertaken to supplement and extend the findings of meta-analyses and other quantitative reviews [85,86].”
Waller, R., & Gilbody, S. (2009) · Psychological Medicine · doi:10.1017/s0033291708004224 · Cited by 393 · see citing works
“In particular, we looked at missing data or areas of concern from the harder facts of the quantitative data and then looked to see if the richer but potentially less reliable qualitative data were able to give insight into these (Thomas et al .”
MethodSocially Assistive Robots in Elderly Care: A Mixed-Method Systematic Literature Review
Kachouie, R., Sedighadeli, S., Khosla, R., & Chu, M.-T. (2014) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2013.873278 · Cited by 412 · see citing works
“The quality of qualitative and quantitative studies was appraised by using frameworks developed by Spencer, Ritchie, Lewis, and Dillon (2003) and Thomas et al. (2004) respectively.”
BackgroundMethodCan We Systematically Review Studies That Evaluate Complex Interventions?
Shepperd, S., Lewin, S., Straus, S., Clarke, M., Eccles, M. P., Fitzpatrick, R., Wong, G., & Sheikh, A. (2009) · PLoS Medicine · doi:10.1371/journal.pmed.1000086 · Cited by 408 · see citing works
“A systematic review of barriers and facilitators to healthy eating among children used qualitative evidence, unrelated to the trial data, to gain a better understanding of children’s perspectives [21].”
BackgroundSystematic review of the qualitative literature on return to work after injury
MacEachen, E., Clarke, J., Franche, R., Irvin, E., & Workplace-based Return to Work Literature Review Group (2006) · Scandinavian Journal of Work Environment & Health · doi:10.5271/sjweh.1009 · Cited by 372 · see citing works
Methodological Issues in Combining Diverse Study Types in Systematic Reviews
Harden, A., & Thomas, J. (2005) · International Journal of Social Research Methodology · doi:10.1080/13645570500155078 · Cited by 371 · see citing works
“We describe the overall approach and methods used in these reviews briefly before we reflect on the issues raised for mixing methods (for fuller descriptions see Harden et al., 2004; Oliver et al., in press; Thomas et al., 2004).”
MethodSelf-citationKrølner, R. F., Rasmussen, M., Brug, J., Klepp, K., Wind, M., & Due, P. (2011) · International Journal of Behavioral Nutrition and Physical Activity · doi:10.1186/1479-5868-8-112 · Cited by 372 · see citing works
“providing the children with fruit [64].”
BackgroundHewitt, C., Gilbody, S., Brealey, S., Paulden, M., Palmer, S., Mann, R., Green, J., Morrell, J., Barkham, M., Light, K., et al. (2009) · Health Technology Assessment · doi:10.3310/hta13360 · Cited by 330 · see citing works
Morton, K. L., Atkin, A. J., Corder, K., Suhrcke, M., & van Sluijs, E. M. F. (2016) · Obesity Reviews · doi:10.1111/obr.12352 · Cited by 325 · see citing works
“Qualitative data were synthesized and analysed thematically using NVivo in three stages, such as (1) line-by-line coding of primary studies; (2) organising codes into themes and (3) development of analytical themes (23).”
MethodThe Association Between Chronic Low Back Pain and Sleep: A Systematic Review
Kelly, G., Blake, C., Power, C., O'Keeffe, D., & Fullen, B. (2011) · The Clinical Journal of Pain · doi:10.1097/ajp.0b013e3181f3bdd5 · Cited by 330 · see citing works
“Furthermore, the inclusion of qualitative research within systematic reviews may more adequately reflect the experience of the population in question, and therefore, lend to more appropriate and effective management.(34) Finally, although sleep disturbance and sleep quality encompass many factors, some studies reviewe…”
BackgroundFarrance, C., Tsofliou, F., & Clark, C. (2016) · Preventive Medicine · doi:10.1016/j.ypmed.2016.02.037 · Cited by 324 · see citing works
“The framework for this review followed the Evidence for Policy and Practice Information and Co-ordinating Centre (EPPI-Centre)method of integrating qualitative research with trials in systematic reviews (Thomas et al., 2004).”
MethodInfluentialHurley, M., Dickson, K., Hallett, R., Grant, R., Hauari, H., Walsh, N. E., Stansfield, C., & Oliver, S. R. (2018) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd010842.pub2 · Cited by 322 · see citing works
Self-citationMills, S., White, M. J., Brown, H., Wrieden, W. L., Kwaśnicka, D., Halligan, J., Robalino, S., & Adams, J. M. (2016) · Appetite · doi:10.1016/j.appet.2016.12.022 · Cited by 307 · see citing works
“Guidance is available on combining quantitative and qualitative research in systematic reviews, which has become accepted practice (Heyvaert, Hannes, & Onghena, 2016; J. Thomas et al., 2004).”
BackgroundMethodBooth, A., Harris, J., Croot, E. J., Springett, J., Campbell, F., & Wilkins, E. (2013) · BMC Medical Research Methodology · doi:10.1186/1471-2288-13-118 · Cited by 278 · see citing works
Do patients want doctors to talk about spirituality? A systematic literature review
Best, M., Butow, P., & Olver, I. (2015) · Patient Education and Counseling · doi:10.1016/j.pec.2015.04.017 · Cited by 279 · see citing works
“By applying the three-stage method of Thomas and Harding [21] we were able to allow the qualitative synthesis to guide the analysis of the data and this enabled a richer picture of patient views to be developed than we would have achieved by simply determining factual answers to our research questions.”
BackgroundMethodInfluentialInnovation and entrepreneurship in the academic setting: a systematic literature review
Schmitz, A., Urbano, D., Dandolini, G. A., de Souza, J. A., & Guerrero, M. (2016) · International Entrepreneurship and Management Journal · doi:10.1007/s11365-016-0401-z · Cited by 282 · see citing works
Harden, A., Brunton, G., Fletcher, A., & Oakley, A. (2009) · BMJ · doi:10.1136/bmj.b4254 · Cited by 268 · see citing works
Self-citationA mixed-methods approach to systematic reviews
Pearson, A., White, H., Bath-Hextall, F. J., Salmond, S. W., Apóstolo, J., & Kirkpatrick, P. (2015) · International Journal of Evidence-Based Healthcare · doi:10.1097/xeb.0000000000000052 · Cited by 261 · see citing works
Mixed methods research synthesis: definition, framework, and potential
Heyvaert, M., Maes, B., & Onghena, P. (2011) · Quality & Quantity · doi:10.1007/s11135-011-9538-6 · Cited by 262 · see citing works
“For example, in the MMRS of Thomas et al. (2004) the combining of 'quantitative' controlled-trial articles describing the effects of interventions that promoted healthy eating with 'qualitative' studies that examined the perspectives and understandings of children concerning barriers to and…”
BackgroundThe impact of chronic venous leg ulcers: a systematic review
Green, J., Jester, R., McKinley, R. K., & Pooler, A. (2014) · Journal of Wound Care · doi:10.12968/jowc.2014.23.12.601 · Cited by 259 · see citing works
A systematic review of decision support needs of parents making child health decisions
Jackson, C., Cheater, F., & Reid, I. (2008) · Health Expectations · doi:10.1111/j.1369-7625.2008.00496.x · Cited by 242 · see citing works
Economic Self-Help group Programs for Improving Women's Empowerment: A Systematic Review
Brody, C., de Hoop, T., Vojtkova, M., Warnock, R., Dunbar, M. S., Murthy, P., & Dworkin, S. L. (2015) · Campbell Systematic Reviews · doi:10.4073/csr.2015.19 · Cited by 228 · see citing works
“An integrated review has three stages: 1) a synthesis of quantitative effects, 2) a synthesis of relevant qualitative evidence, and 3) a synthesis of both summaries that “goes beyond” the primary studies and generates new interpretations or hypotheses (Harden, 2010; Thomas et al., 2004).”
MethodOliver, S., Harden, A., Rees, R., Shepherd, J., Brunton, G., Garcia, J., & Oakley, A. (2005) · Evaluation · doi:10.1177/1356389005059383 · Cited by 221 · see citing works
“Elsewhere we describe how we have built on this framework with a meta-analysis (Thomas et al., 2004).”
MethodSelf-citationBalancing rights and risks: Conflicting perspectives in the management of wandering in dementia
Robinson, L. A., Hutchings, D., Corner, L., Finch, T. L., Hughes, J. C., Brittain, K., & Bond, J. (2007) · Health Risk & Society · doi:10.1080/13698570701612774 · Cited by 220 · see citing works
“Our approach to analysing and integrating quantitative and qualitative data within a systematic review, similar to that of others (Thomas et al. 2004), has thus demonstrated benefits in both addressing gaps in the literature and in facilitating the interpretation of quantitative findings.”
MethodBridging the Evidence Gap in Obesity Prevention: A Framework to Inform Decision Making
(2010) · PsycEXTRA Dataset · doi:10.1037/e549902010-001 · Cited by 216 · see citing works
Methodological guidance for the conduct of mixed methods systematic reviews
Stern, C., Lizarondo, L. M., Carrier, J., Godfrey, C. M., Rieger, K. L., Salmond, S. W., Apóstolo, J., Kirkpatrick, P., & Loveday, H. P. (2021) · International Journal of Evidence-Based Healthcare · doi:10.1097/xeb.0000000000000282 · Cited by 214 · see citing works
Qualitative Research and Cochrane Reviews
Noyes, J., Popay, J., Pearson, A., Hannes, K., & Booth, A. (2008) · Wiley eBooks · doi:10.1002/9780470712184.ch20 · Cited by 291 · see citing works
Hanghøj, S., & Boisen, K. A. (2013) · Journal of Adolescent Health · doi:10.1016/j.jadohealth.2013.08.009 · Cited by 211 · see citing works
Complex interventions and their implications for systematic reviews: a pragmatic approach
Petticrew, M. P., Anderson, L. M., Elder, R. W., Grimshaw, J., Hopkins, D. P., Hahn, R. A., Krause, L. K., Kristjansson, E., Mercer, S. L., Sipe, T., et al. (2013) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2013.06.004 · Cited by 204 · see citing works
“The Evidence for Policy and Practice Information and Co-ordinating Centre has also described an approach to integrating qualitative and quantitative data, which may be of value [25].”
BackgroundBagnall, A., South, J., Hulme, C. T., Woodall, J., Vinall‐Collier, K. A., Raine, G., Kinsella, K., Dixey, R., Harris, L. M., & Wright, N. M. J. (2015) · BMC Public Health · doi:10.1186/s12889-015-1584-x · Cited by 205 · see citing works
The effects and experiences of goal setting in stroke rehabilitation – a systematic review
Sugavanam, T., Mead, G., Bulley, C., Donaghy, M., & van Wijck, F. (2013) · Disability and Rehabilitation · doi:10.3109/09638288.2012.690501 · Cited by 226 · see citing works
“(2004) [27], whereby data from quantitative and qualitative studies are extracted and analyzed separately and the findings are then synthesized accordingly to answer the research questions.”
BackgroundMethodFrom screening to synthesis: using nvivo to enhance transparency in qualitative evidence synthesis
Houghton, C., Murphy, K., Meehan, B., Thomas, J., Brooker, D., & Casey, D. (2016) · Journal of Clinical Nursing · doi:10.1111/jocn.13443 · Cited by 196 · see citing works
Self-citationA mixed‐methods systematic review of the effects of mindfulness on nurses
Guillaumie, L., Boiral, O., & Champagne, J. (2017) · Journal of Advanced Nursing · doi:10.1111/jan.13176 · Cited by 186 · see citing works
“Data analysis was conducted based on the framework of Thomas and Harden (2004).”
MethodLasserson, T. J., Thomas, J., & Higgins, J. P. T. (2019) · doi:10.1002/9781119536604.ch1 · Cited by 182 · see citing works
Self-citationExperience of Advanced Chronic Obstructive Pulmonary Disease: Metasynthesis of Qualitative Research
Disler, R. T., Green, A., Luckett, T., Newton, P. J., Inglis, S. C., Currow, D. C., & Davidson, P. M. (2014) · Journal of Pain and Symptom Management · doi:10.1016/j.jpainsymman.2014.03.009 · Cited by 177 · see citing works
Rees, R. W., Kavanagh, J., Harden, A., Shepherd, J. G., Brunton, G., Oliver, S. R., & Oakley, A. (2006) · Health Education Research · doi:10.1093/her/cyl120 · Cited by 223 · see citing works
“For the last synthesis, a matrix was constructed which laid out the barriers and facilitators identified by young people alongside descriptions of the interventions included in the indepth systematic review of trials [19].”
MethodSelf-citationRing, N., Ritchie, K., Mandava, L., & Jepson, R. G. (2011) · Stirling Online Research Repository (University of Stirling) · Cited by 168 · see citing works
Physical activity among South Asian women: a systematic, mixed-methods review
Babakus, W. Ş., & Thompson, J. L. (2012) · International Journal of Behavioral Nutrition and Physical Activity · doi:10.1186/1479-5868-9-150 · Cited by 167 · see citing works
“Qualitative data was synthesized and analysed thematically using NVIVO in three stages: 1) lineby-line coding of primary studies; 2) organising codes into themes; and 3) development of analytical themes [18].”
BackgroundMethodChallenges in Systematic Reviews of Educational Intervention Studies
Reed, D. A., Price‐Haywood, E. G., Windish, D. M., Wright, S. M., Gozu, A., Hsu, E. B., Beach, M. C., Kern, D. E., & Bass, E. B. (2005) · Annals of Internal Medicine · doi:10.7326/0003-4819-142-12_part_2-200506211-00008 · Cited by 163 · see citing works
Bee, P., Bower, P., Byford, S., Churchill, R. C., Calam, R. M., Stallard, P. N., Pryjmachuk, S., Berzins, K. M., Cary, M., Wan, M. W., et al. (2014) · Health Technology Assessment · doi:10.3310/hta18080 · Cited by 165 · see citing works
Consumer understanding of nutrition and health claims: sources of evidence
Leathwood, P. D., Richardson, D. P., Sträter, P., Todd, P. M., & van Trijp, J. C. M. (2007) · British Journal Of Nutrition · doi:10.1017/s000711450778697x · Cited by 167 · see citing works
Campbell, F., Johnson, M., Messina, J., Preston, L. R., & Goyder, E. (2011) · BMC Public Health · doi:10.1186/1471-2458-11-491 · Cited by 161 · see citing works
“This review adopts an approach incorporating both quantitative and qualitative data previously pioneered by the EPPI centre [16,17].”
MethodTime to rethink the systematic review catechism? Moving from ‘what works’ to ‘what happens’
Petticrew, M. P. (2015) · Systematic Reviews · doi:10.1186/s13643-015-0027-1 · Cited by 160 · see citing works
“and to illuminate intervention mechanisms [6].”
Noyes, J., Booth, A., Cargo, M., Flemming, K., Harden, A., Harris, J., Garside, R., Hannes, K., Tomás Pantoja, C., & Thomas, J. (2019) · Wiley eBooks · doi:10.1002/9781119536604.ch21 · Cited by 161 · see citing works
Self-citationvan Staa, T. P., Dyson, L., McCann, G., Padmanabhan, S., Belatri, R., Goldacre, B. M., Cassell, J., Pirmohamed, M., Torgerson, D. J., Ronaldson, S. J., et al. (2014) · Health Technology Assessment · doi:10.3310/hta18430 · Cited by 154 · see citing works
“In particular, it is more common to use qualitative methods to develop the design, conduct, outcomes and efficiency of clinical trials(86) or to enable health professionals, service users and other stakeholders to contribute their views and experiences to evaluation of treatments, interventions, policies or methodolog…”
MethodBalaam, M., Akerjordet, K., Lyberg, A., Kaiser, B., Schoening, E., Fredriksen, A., Ensel, A., Gouni, O., & Severinsson, E. (2013) · Journal of Advanced Nursing · doi:10.1111/jan.12139 · Cited by 144 · see citing works
Who decides what evidence is? Developing a multiple perspectives paradigm in mental health
Rose, D. S., Thornicroft, G., & Slade, M. (2006) · Acta Psychiatrica Scandinavica · doi:10.1111/j.1600-0447.2005.00727.x · Cited by 154 · see citing works
Booth, A. (2016) · White Rose Research Online (University of Leeds, The University of Sheffield, University of York) · doi:10.13140/rg.2.1.2318.0562 · Cited by 151 · see citing works
Damned if you do, damned if you don't: subgroup analysis and equity
Petticrew, M. P., Tugwell, P., Kristjansson, E., Oliver, S. R., Ueffing, E., & Welch, V. A. (2011) · Journal of Epidemiology & Community Health · doi:10.1136/jech.2010.121095 · Cited by 150 · see citing works
Self-citationSystematic synthesis of barriers and facilitators to service user-led care planning
Bee, P., Price, O., Baker, J. A., & Lovell, K. (2015) · The British Journal of Psychiatry · doi:10.1192/bjp.bp.114.152447 · Cited by 149 · see citing works
Kiefer, L., Frank, J. W., Di, R. E., Dobbins, M., Manuel, D. G., Gully, P. R., & Mowat, D. L. (2005) · PubMed · Cited by 144 · see citing works
Synthesising quantitative and qualitative research in evidence-based patient information
Goldsmith, M. R., Bankhead, C. R., & Austoker, J. (2007) · Journal of Epidemiology and Community Health · doi:10.1136/jech.2006.046110 · Cited by 142 · see citing works
Harden, A., Thomas, J., Cargo, M., Harris, J., Tomás Pantoja, C., Flemming, K., Booth, A., Garside, R., Hannes, K., & Noyes, J. (2017) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2017.11.029 · Cited by 146 · see citing works
Self-citationMaking evidence synthesis more useful for management and policy-making
Sheldon, T. A. (2005) · Journal of Health Services Research & Policy · doi:10.1258/1355819054308521 · Cited by 143 · see citing works
A Conceptual Framework for Critical Appraisal in Systematic Mixed Studies Reviews
Hong, Q. N., & Pluye, P. (2019) · Journal of Mixed Methods Research · doi:10.1177/1558689818770058 · Cited by 139 · see citing works
Flemming, K., Graham, H. M., Heirs, M. K., Fox, D., & Sowden, A. J. (2012) · Journal of Advanced Nursing · doi:10.1111/jan.12066 · Cited by 138 · see citing works
“In other areas of public health, systematic reviews of qualitative evidence are beginning to fill this gap (Graham & McDermott 2006, Noyes & Popay 2007, Thomas et al. 2004).”
BackgroundLorenc, T., Petticrew, M. P., Whitehead, M. M., Neary, D., Clayton, S., Wright, K. E., Thomson, H., Cummins, S., Sowden, A. J., & Renton, A. M. (2014) · Public Health Research · doi:10.3310/phr02020 · Cited by 132 · see citing works
Sutcliffe, K., Thomas, J., Stokes, G., Hinds, K., & Bangpan, M. (2015) · Systematic Reviews · doi:10.1186/s13643-015-0126-z · Cited by 133 · see citing works
“the views and experiences of intervention recipients or providers [23, 24].”
BackgroundSelf-citation‘Into the Wild’: A meta-synthesis of talking therapy in natural outdoor spaces
Cooley, S. J., Jones, C. R., Kurtz, A., & Robertson, N. (2020) · Clinical Psychology Review · doi:10.1016/j.cpr.2020.101841 · Cited by 141 · see citing works
Robinson, L. A., Hutchings, D., Dickinson, H. O., Corner, L., Beyer, F. R., Finch, T. L., Hughes, J. C., Vanoli, A., Ballard, C. G., & Bond, J. B. (2006) · International Journal of Geriatric Psychiatry · doi:10.1002/gps.1643 · Cited by 133 · see citing works
“However there is no consensus regarding the formal synthesis of such data within a systematic review (Dixon-Woods et al., 2004; Thomas et al., 2004).”
Synthesis of quantitative and qualitative research: an example using Critical Interpretive Synthesis
Flemming, K. (2009) · Journal of Advanced Nursing · doi:10.1111/j.1365-2648.2009.05173.x · Cited by 129 · see citing works
Brown, B. B., Patel, C., McInnes, E., Mays, N., Young, J. M., & Haines, M. (2016) · BMC Health Services Research · doi:10.1186/s12913-016-1615-z · Cited by 126 · see citing works
“Review methods were adapted for a mixed methods systematic review using the framework outlined by Thomas and colleagues [25, 26] which allows independent syntheses of quantitative and qualitative studies followed by integration of findings.”
MethodCultural factors influencing self-care by persons with cardiovascular disease: An integrative review
Osokpo, O. H., & Riegel, B. J. (2019) · International Journal of Nursing Studies · doi:10.1016/j.ijnurstu.2019.06.014 · Cited by 126 · see citing works
Robinson, L. A., Hutchings, D., Corner, L., Beyer, F. R., Dickinson, H. O., Vanoli, A., Finch, T. L., Hughes, J., Ballard, C. G., May, C. R., et al. (2006) · Health Technology Assessment · doi:10.3310/hta10260 · Cited by 125 · see citing works
Qualitative Research Methods in Psychology
Biggerstaff, D. L. (2012) · InTech eBooks · doi:10.5772/38931 · Cited by 118 · see citing works
“Alternatively, researchers might synthesize the evidence from the research data across several qualitative and / or quantitative studies in order to elaborate further on the research context concerned (Pope et al., 2007; Thomas et al., 2004).”
BackgroundAdvance Care Planning for Adults With CKD: A Systematic Integrative Review
Luckett, T., Sellars, M., Tieman, J., Pollock, C. A., Silvester, W., Butow, P. N., Detering, K. M., Brennan, F. P., & Clayton, J. M. (2014) · American Journal of Kidney Diseases · doi:10.1053/j.ajkd.2013.12.007 · Cited by 117 · see citing works
Baxter, S. K., Killoran, A., Kelly, M. P., & Goyder, E. (2010) · Public Health · doi:10.1016/j.puhe.2010.01.002 · Cited by 116 · see citing works
Integrating HIV and substance use services: a systematic review
Haldane, V. E., Cervero‐Liceras, F., Chuah, F. L. H., Ong, S. E., Murphy, G. A. V., Sigfrid, L., Watt, N. F., Balabanova, D., Hogarth, S., Maimaris, W., et al. (2017) · Journal of the International AIDS Society · doi:10.7448/ias.20.1.21585 · Cited by 118 · see citing works
Older people’s adherence to community-based group exercise programmes: a multiple-case study
Killingback, C., Tsofliou, F., & Clark, C. (2017) · BMC Public Health · doi:10.1186/s12889-017-4049-6 · Cited by 120 · see citing works
“This was used to assess the extent to which the quantitative interventions incorporated the analytic themes identified in the qualitative synthesis (Thomas et al. 2004).”
MethodO’Donovan, C., & O’Donovan, J. (2017) · Birth · doi:10.1111/birt.12319 · Cited by 116 · see citing works
Carr, S. M., Lhussier, M., Forster, N., Geddes, L., Deane, K. H., Pennington, M., Visram, S., White, M. J., Michie, S., Donaldson, C., et al. (2011) · Health Technology Assessment · doi:10.3310/hta15090 · Cited by 114 · see citing works
Davies, F., Shepherd, H. L., Beatty, L., Clark, B., Butow, P., & Shaw, J. (2020) · Journal of Medical Internet Research · doi:10.2196/17362 · Cited by 110 · see citing works
“We analyzed the articles using a 3-stage synthesis process that combined qualitative, quantitative, and mixed-methods studies comprehensively and rigorously to answer the review question, following the methods of Thomas et al [20].”
MethodAitchison, B., Rushton, A. B., Martin, P., Barr, M., Soundy, A., & Heneghan, N. R. (2021) · Disability and health journal · doi:10.1016/j.dhjo.2021.101164 · Cited by 110 · see citing works
Rees, R., Oliver, K., Woodman, J., & Thomas, J. (2011) · BMC Public Health · doi:10.1186/1471-2458-11-188 · Cited by 109 · see citing works
Self-citationYoung people's views of UK mental health services
Plaistow, J., Masson, K., Koch, D. G., Wilson, J., Stark, R. M., Jones, P. B., & Lennox, B. (2013) · Early Intervention in Psychiatry · doi:10.1111/eip.12060 · Cited by 106 · see citing works
“Previous reviews have highlighted a lack of highquality evidence available in this field with many studies failing to meet basic standards of methodological reporting.(38) In this review, a high proportion of studies were reliant on highly selected samples (over two thirds), often using non-independent researchers and…”
BackgroundIMPRoving Outcomes for children exposed to domestic ViolencE (IMPROVE): an evidence synthesis
Howarth, E., Moore, T. H., Welton, N. J., Lewis, N. V., Stanley, N., MacMillan, H. L., Shaw, A. R. G., Hester, M., Bryden, P. A., & Feder, G. S. (2016) · Public Health Research · doi:10.3310/phr04100 · Cited by 104 · see citing works
“Syntheses of qualitative evidence may illuminate why an intervention is effective (or not), how it brings benefits (or otherwise) and how it could be optimised.(145,146) Qualitative syntheses may also highlight a broader range of benefits, or indeed harms, that are not captured in the relatively small number of primar…”
BackgroundLawrence, M., & Kinn, S. (2011) · Health Expectations · doi:10.1111/j.1369-7625.2011.00683.x · Cited by 105 · see citing works
- Authors
- Thomas, J., Harden, A., Oakley, A., Oliver, S., Sutcliffe, K., Rees, R., Brunton, G., & Kavanagh, J.
- Affiliations
- University of London (GB)
- Corresponding author
- Thomas, James
- Venue
- BMJ
- Publisher
- BMJ
- Published
- 2004-04-22
- Volume
- 328
- Issue
- 7446
- Pages
- 1010-1012
- ISSN
- 0007-1447 (ISSN-L)
- 0959-8138
- 1468-5833
- PMC
- PMC404509
- OpenAlex
- W2015804289
- Cited by
- 515
- References
- 13
- Citations by year
- 2026: 9 · 2025: 6 · 2024: 13 · 2023: 20 · 2022: 27 · 2021: 21 · 2020: 26 · 2019: 33 · 2018: 22 · 2017: 12 · 2016: 30 · 2015: 30 · 2014: 29 · 2013: 35 · 2012: 41
- FWCI
- 6.68
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Licence
- www.bmj.com/company/legal-information/terms-conditions/legal-information/tdm-licencepolicy (tdm)
- Locations
- BMJ (publishedVersion)
- PubMed Central (publishedVersion)
- PubMed (publishedVersion)
- UEL Research Repository (University of East London) (acceptedVersion)
- UEL Research Repository (University of East London) (submittedVersion, cc-by-nd)
- UCL Discovery (University College London) (submittedVersion)
- HighWire Press Open Archive (submittedVersion)
- DigitalGeorgetown (Georgetown University Library) (submittedVersion)
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Health Sciences › Health Professions › General Health Professions › Health Policy Implementation Science
- Social Sciences › Education › Qualitative Research Methods and Applications
- Keywords
- fruit and vegetable intake, children, barriers and facilitators, dietary behavior, mixed methods synthesis, systematic review methodology
- MeSH terms
- Clinical Trials as Topic, Humans, Quality Assurance, Health Care, Review Literature as Topic, Meta-Analysis as Topic, Biomedical Research
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
