Barriers and facilitators to implementing evidence-based interventions among third sector organisations: A systematic review
Open accessAbstract
BACKGROUND: The third sector is becoming a growing provider of public, social, and health services. However, there is little evidence on the effectiveness of third sector organisations (TSOs), and their capacity to implement evidence-based interventions (EBIs). Understanding implementation aspects of service delivery remains an important issue in clinical practice, but is poorly understood in the context of TSOs. This is problematic, since implementation issues are known to be critical for effective intervention outcomes. OBJECTIVES: To identify and synthesise existing research on what barriers and facilitators influence the implementation process of TSOs delivering EBIs. METHODS: This review is reported according to PRISMA guidelines and was pre-registered in PROSPERO. Key databases were searched using relevant terms, experts in the field were contacted, and websites were reviewed. All identified studies were double-screened, and data were extracted independently by two authors. Included studies were synthesised using thematic analysis and were quality appraised. RESULTS: Thirty-one studies were included, most of which were conducted in North America. The thematic synthesis identified resource limitations, in particular staff and finance, to be the most reported barrier to TSOs implementing EBIs. Organisational culture, including factors such as alignment between the mission of the TSO and EBI, and support/prioritisation of the implementation process were the most reported facilitators. These findings generalise across the included studies and are robust to study quality assessment. CONCLUSIONS: While it is often assumed that good outcomes follow when implementing interventions that have been developed and tested according to best practice, little attention has been paid to how EBIs are best transported, contextualised, and implemented by third sector providers. This systematic review found that TSOs faced considerable challenges in implementing EBIs, which were primarily a lack of support and expertise, and unclear/insufficient guidelines on how to adapt EBIs to different populations. To address these challenges, it is important to engage with central stakeholders, such as funders, researchers, policymakers, and practitioners, to discuss how these needs can be met. TRIAL REGISTRATION: PROSPERO: CRD42017073090 .
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
A major determinant of program effectiveness throughout the youth service field is the degree of professional learning and support provided to staff.
“A major determinant of program effectiveness throughout the youth service field is the degree of professional learning and support provided to staff (Bach-Mortensen et al., 2018;National Research Council (NRC), 2015).”
From Improving relationship quality in group care settings: The impact of implementing the CARE model (2020) · cites this paper as Bach-Mortensen et al., 2018
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Rayyan-a web and mobile app for systematic reviews.
Ouzzani, M., Hammady, H., Fedorowicz, Z., & Elmagarmid, A. (2016) · Systematic Reviews · doi:10.1186/s13643-016-0384-4 · Cited by 26,092 · see citing works
Evidence based medicine: what it is and what it isn't
Sackett, D. L., Rosenberg, W. M. C., Gray, J. A. M., Haynes, R. B., & Richardson, W. S. (1996) · BMJ · doi:10.1136/bmj.312.7023.71 · Cited by 15,769 · see citing works
Michie, S., van Stralen, M. M., & West, R. (2011) · Implementation Science · doi:10.1186/1748-5908-6-42 · Cited by 13,697 · cited 1× · see citing works
“needed to conceptualise how intervention functions or mechanisms can be tailored to different implementation settings [98].”
BackgroundPreferred reporting items for systematic reviews and meta-analyses: The PRISMA statement
Moher, D., Liberati, A., Tetzlaff, J., & Altman, D. G. (2010) · International Journal of Surgery · doi:10.1016/j.ijsu.2010.02.007 · Cited by 12,156 · see citing works
Hoffmann, T. C., Glasziou, P. P., Boutron, I., Milne, R., Perera, R., Moher, D., Altman, D. G., Barbour, V., Macdonald, H., Johnston, M., et al. (2014) · BMJ · doi:10.1136/bmj.g1687 · Cited by 10,548 · see citing works
Methods for the thematic synthesis of qualitative research in systematic reviews
Thomas, J., & Harden, A. (2008) · BMC Medical Research Methodology · doi:10.1186/1471-2288-8-45 · Cited by 9,312 · see citing works
Proctor, E., Silmere, H., Raghavan, R., Hovmand, P., Aarons, G., Bunger, A., Griffey, R., & Hensley, M. (2011) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-010-0319-7 · Cited by 8,721 · see citing works
Durlak, J. A., & DuPre, E. P. (2008) · American Journal of Community Psychology · doi:10.1007/s10464-008-9165-0 · Cited by 5,304 · see citing works
The Delphi Technique: Making Sense of Consensus
Hsu, C.-C., & Sandford, B. A. (2007) · University of Massachusetts Amherst · doi:10.7275/pdz9-th90 · Cited by 4,500 · cited 1× · see citing works
“To do so, one may draw on stakeholder inclusive methods such as consensus meetings and Delphi panels [105, 106] to determine what types of support TSOs require to appropriately deliver EBIs.”
BackgroundProctor, E. K., Landsverk, J., Aarons, G., Chambers, D., Glisson, C., & Mittman, B. (2009) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-008-0197-4 · Cited by 1,894 · see citing works
Légaré, F., Ratté, S., Gravel, K., & Graham, I. D. (2008) · Patient Education and Counseling · doi:10.1016/j.pec.2008.07.018 · Cited by 1,321 · see citing works
Specifying and reporting complex behaviour change interventions: the need for a scientific method
Michie, S., Fixsen, D., Grimshaw, J. M., & Eccles, M. P. (2009) · Implementation Science · doi:10.1186/1748-5908-4-40 · Cited by 976 · see citing works
Primary prevention mental health programs for children and adolescents: A meta-analytic review
Durlak, J. A., & Wells, A. M. (1997) · American Journal of Community Psychology · doi:10.1023/a:1024654026646 · Cited by 963 · see citing works
Rees, R., Oliver, K., Woodman, J., & Thomas, J. (2011) · BMC Public Health · doi:10.1186/1471-2458-11-188 · Cited by 109 · see citing works
Hunter, S. B., Han, B., Slaughter, M. E., Godley, S. H., & Garner, B. R. (2017) · Implementation Science · doi:10.1186/s13012-017-0606-8 · Cited by 56 · see citing works
A Community-Based Partnership to Promote Exercise Among Cancer Survivors: Lessons Learned
Pinto, B. M., Waldemore, M., & Rosen, R. (2015) · International Journal of Behavioral Medicine · doi:10.1007/s12529-014-9395-5 · Cited by 13 · see citing works
Flagged first, then by citations
Research works printed but not linked: 86
- [1]Despard MR Challenges in implementing evidence-based practices and programs in fit human service organizations J Evidence-Informed Soc Work 2016 13 505 522 10.1080/23761407.2015.1086719 27045938 · DOI
- [3]Macmillan R The third sector delivering public services: an evidence review. TSRC Working Paper 20 2010 Birmingham University of Birmingham
- [4]Wilson M Lavis J Guta A Community-based organizations in the health sector: a scoping review Heal Res Policy Syst 2012 10 36 10.1186/1478-4505-10-36 PMC3511187 23171160 · DOI
- [5]Hardwick R Anderson R Cooper C How do third sector organisations use research and other knowledge? A systematic scoping review Implement Sci 2015 10 84 10.1186/s13012-015-0265-6 26048555 PMC4530490 · DOI
- [6]Chapman T Brown J Crow R Entering a brave new world? An assessment of third sector readiness to tender for the delivery of public services in the United Kingdom Policy Stud 2008 29 1 17 10.1080/01442870701847998 · DOI
- [7]Alcock P A strategic unity: defining the third sector in the UK Volunt Sect Rev 2010 1 5 24 10.1332/204080510X496984 · DOI
- [8]Defourny J Kirsten Grønbjerg B Lucas Meijs B Marthe Nyssens B Naoto Yamauchi B Grønbjerg K Voluntas symposium: comments on Salamon and Sokolowski’s re-conceptualization of the third sector Voluntas 2016 27 1546 1561 10.1007/s11266-016-9743-y · DOI
- [9]Salamon LM Anheier HK In search of the non-profit sector. I: The question of definitions Voluntas 1992 3 125 51 10.1007/BF01397770 · DOI
- [10]Anheier HK. Nonprofit organizations: theory, management, policy: Routledge; 2005. http://books.google.com/books?id=s_uzg-KoVyIC&pgis=1
- [12]Rees J, Mullins D, editors. The third sector delivering public services: developments, innovations and challenges. Bristol: Policy press; 2016.
- [13]Barron DN West E The quasi-market for adult residential care in the UK: do for-profit, not-for-profit or public sector residential care and nursing homes provide better quality care? Soc Sci Med 2017 179 137 146 10.1016/j.socscimed.2017.02.037 28273611 · DOI
- [14]Moore MH Managing for value: organizational strategy in for-profit, nonprofit, and governmental organizations Nonprofit Volunt Sect Q 2000 29 183 204 10.1177/0899764000291S009 · DOI
- [15]Dart R Being “business-like” in a nonprofit organization: a grounded and inductive typology Nonprofit Volunt Sect Q 2004 33 290 310 10.1177/0899764004263522 · DOI
- [16]Hogg E Baines S Changing responsibilities and roles of the voluntary and community sector in the welfare mix: a review Soc Policy Soc 2011 10 341 352 10.1017/S1474746411000078 · DOI
- [17]Kelly J Reforming public services in the UK: bringing in the third sector Public Adm 2007 85 1003 1022 10.1111/j.1467-9299.2007.00680.x · DOI
- [20]Kegeles SM Rebchook G Tebbetts S Arnold E Facilitators and barriers to effective scale-up of an evidence-based multilevel HIV prevention intervention Implement Sci 2015 10 50 10.1186/s13012-015-0216-2 25889582 PMC4405833 · DOI
- [22]Gibbs L Gambrill E Evidence-based practice: counterarguments to objections Res Soc Work Pract 2002 12 452 476 10.1177/1049731502012003007 · DOI
- [24]Fraser MW Galinsky MJ Steps in intervention research: designing and developing social programs Res Soc Work Pract 2010 20 459 466 10.1177/1049731509358424 · DOI
- [25]Magill M The future of evidence in evidence-based practice: who will answer the call for clinical relevance? J Soc Work 2006 6 101 115 10.1177/1468017306066737 · DOI
- [30]Margaret Dolcini M Gandelman AA Vogan SA Kong C Leak TN King AJ Translating HIV interventions into practice: community-based organizations’ experiences with the diffusion of effective behavioral interventions (DEBIs) Soc Sci Med 2010 71 1839 1846 10.1016/j.socscimed.2010.08.011 20926169 PMC2994322 · DOI
- [31]Amodeo M Lundgren L Cohen A Rose D Chassler D Beltrame C Barriers to implementing evidence-based practices in addiction treatment programs: comparing staff reports on motivational interviewing, adolescent community reinforcement approach, assertive community treatment, and cognitive-behavioral therapy Eval Program Plann. 2011 34 382 389 10.1016/j.evalprogplan.2011.02.005 21420171 · DOI
- [32]Ubbink DT Guyatt GH Vermeulen H Framework of policy recommendations for implementation of evidence-based practice: a systematic scoping review BMJ Open 2013 3 e001881 10.1136/bmjopen-2012-001881 23355664 PMC3563143 · DOI
- [33]Gray M Joy E Plath D Webb SA What supports and impedes evidence-based practice implementation? A survey of Australian social workers Br J Soc Work 2013 45 667 684 10.1093/bjsw/bct123 · DOI
- [34]Montgomery P Underhill K Gardner F Operario D Mayo-Wilson E The Oxford implementation index: a new tool for incorporating implementation data into systematic reviews and meta-analyses J Clin Epidemiol 2013 66 874 882 10.1016/j.jclinepi.2013.03.006 23810026 PMC3746185 · DOI · Paper page
- [36]Hasson H Systematic evaluation of implementation fidelity of complex interventions in health and social care Implement Sci 2010 5 67 10.1186/1748-5908-5-67 20815872 PMC2942793 · DOI
- [38]Glasziou P Meats E Heneghan C Shepperd S What is missing from descriptions of treatment in trials and reviews? BMJ Br Med J 2008 336 1472 1474 10.1136/bmj.39590.732037.47 18583680 PMC2440840 · DOI · Paper page
- [40]Basch CE Sliepcevich EM Gold RS Duncan DF Kolbe LJ Avoiding type III errors in health education program evaluations: a case study Health Educ Q 1985 12 315 331 10.1177/109019818501200311 4077544 · DOI
- [41]Dobson D Cook TJ Avoiding type III error in program evaluation Eval Program Plann 1980 3 269 276 10.1016/0149-7189(80)90042-7 · DOI · Paper page
- [42]Hasson H Systematic evaluation of implementation fidelity of complex interventions in health and social care 2010 PMC2942793 20815872
- [43]McCord J Cures that harm: unanticipated outcomes of crime prevention programs Ann Am Acad Pol Soc Sci. 2003 587 16 30 10.1177/0002716202250781 · DOI · Paper page
- [44]Dishion TJ Mccord J Poulin F When interventions harm: peer groups and problem behavior Am Psychol 1999 54 755 764 10.1037/0003-066X.54.9.755 10510665 · DOI
- [45]Petrosino A, Turpin-Petrosino C, Hollis-PeelME, Lavenberg JG. ’Scared Straight’ and other juvenile awareness programs for preventing juvenile delinquency. Cochrane Database Syst Rev. 2013;(4):CD002796. 10.1002/14651858.CD002796.pub2. PMC11973542 23862186 · DOI
- [47]Lundgren L Krull I Zerden L de S Mccarty D Community-based addiction treatment staff attitudes about the usefulness of evidence-based addiction treatment and CBO organizational linkages to research institutions Eval Program Plann. 2011 34 356 365 10.1016/j.evalprogplan.2011.02.002 21396714 PMC3784015 · DOI
- [48]Ramanadhan S Crisostomo J Alexander-Molloy J Gandelman E Grullon M Lora V Perceptions of evidence-based programs among community-based organizations tackling health disparities: a qualitative study Health Educ Res 2012 27 717 728 10.1093/her/cyr088 22012968 PMC3396880 · DOI
- [49]Owczarzak J Dickson-Gomez J Provider perspectives on evidence-based HIV prevention interventions: barriers and facilitators to implementation AIDS Patient Care STDs 2011 25 171 179 10.1089/apc.2010.0322 21323564 PMC4702433 · DOI
- [50]Martínez G, Sardiñas LM, Acosta-Perez E, Medina L, Rivera M, Pattatucci A. Capacity needs in community-based organizations for enhancing translational research in Puerto Rico. Prog Community Health Partnersh. 2014;8:53–60. https://search.proquest.com/docview/1529846240?accountid=13042. PMC4113094 24859102
- [51]Lundgren L Amodeo M Cohen A Chassler D Horowitz A Schoenwald S Modifications of evidence-based practices in community-based addiction treatment organizations: a qualitative research study Addict Behav 2011 36 630 635 10.1016/j.addbeh.2011.01.003 21310541 · DOI
- [52]Kimber M Barwick M Fearing G Becoming an evidence-based service provider: staff perceptions and experiences of organizational change J Behav Health Serv Res 2012 39 314 332 10.1007/s11414-012-9276-0 22396047 · DOI
- [53]Mullen E Shlonsky A From concept to implementation: challenges facing evidence-based social work Evid Policy 2005 1 61 84 10.1332/1744264052703159 · DOI
- [55]Shamseer L, Moher D, Clarke M, Ghersi D, Liberati A, Petticrew M, et al. Preferred reporting items for systematic review and meta-analysis protocols (PRISMA-P) 2015: elaboration and explanation. BMJ. 2015;349 http://www.bmj.com/content/349/bmj.g7647. Accessed 16 Aug 2017 25555855
- [58]Tricco AC Cardoso R Thomas SM Motiwala S Sullivan S Kealey MR Barriers and facilitators to uptake of systematic reviews by policy makers and health care managers: a scoping review Implement Sci 2016 11 4 10.1186/s13012-016-0370-1 26753923 PMC4709874 · DOI
- [59]Gravel K Légaré F Graham ID Barriers and facilitators to implementing shared decision-making in clinical practice: a systematic review of health professionals’ perceptions Implement Sci 2006 1 16 10.1186/1748-5908-1-16 16899124 PMC1586024 · DOI · Paper page
- [60]Oliver K Innvar S Lorenc T Woodman J Thomas J A systematic review of barriers to and facilitators of the use of evidence by policymakers.(Research article) BMC Health Serv Res 2014 14 2 10.1186/1472-6963-14-2 24383766 PMC3909454 · DOI
- [61]Demby H Gregory A Broussard M Dickherber J Atkins S Jenner LW Implementation lessons: the importance of assessing organizational “fit” and external factors when implementing evidence-based teen pregnancy prevention programs J Adolesc Health 2014 54 3 SUPPL S37 S44 10.1016/j.jadohealth.2013.12.022 24560075 · DOI
- [62]Rees R, Oliver K, Woodman J, Thomas J. Children’s views about obesity, body size, shape and weight: a systematic review. 2009. http://eppi.ioe.ac.uk/cms/Portals/0/Obesity%20Views%20Children%20R2009Rees.pdf?ver=2010-12-22-121209-040. Accessed 3 Apr 2017. PMC3072952 21439062
- [63]Verboom B, Montgomery P, Bennett S. What factors affect evidence-informed policymaking in public health? Protocol for a systematic review of qualitative evidence using thematic synthesis. Syst Rev. 2016;5 10.1186/s13643-016-0240-6. PMC4831125 27080993 · DOI
- [66]Belza B Petrescu-Prahova M Kohn M Miyawaki CE Farren L Kline G Adoption of evidence-based health promotion programs: perspectives of early adopters of Enhance®Fitness in YMCA-affiliated sites Front Public Heal 2015 2 1 12 PMC4410415 25964904
- [67]Dippolito M Lundgren L Amodeo M Beltrame C Lim L Chassler D Addiction treatment staff perceptions of training as a facilitator or barrier to implementing evidence-based practices: a national qualitative research study Subst Abus 2015 36 42 50 10.1080/08897077.2013.849646 24965059 · DOI
- [68]Flores R Naranjo C Hein A Use of evidence in the implementation of social programs: a qualitative study from Chile J Evidence-Informed Soc Work. 2016 13 562 575 10.1080/23761407.2015.1086716 27266890 · DOI
- [69]Gandelman A Dolcini MM The influence of social determinants on evidence-based behavioral interventions-considerations for implementation in community settings Transl Behav Med 2012 2 137 148 10.1007/s13142-011-0102-7 23181146 PMC3502007 · DOI
- [70]Lattimore D Griffin SF Wilcox S Rheaume C Dowdy DM Leviton LC Understanding the challenges encountered and adaptations made by community organizations in translation of evidence-based behavior change physical activity interventions: a qualitative study Am J Health Promot 2010 24 427 434 10.4278/ajhp.081024-QUAL-252 20594099 · DOI
- [71]Owczarzak J Evidence-based HIV prevention in community settings: provider perspectives on evidence and effectiveness Crit Public Health 2012 22 73 84 10.1080/09581596.2011.566918 · DOI
- [72]Payan DD Sloane DC Illum J Vargas RB Lee D Galloway-Gilliam L Catalyzing implementation of evidence-based interventions in safety net settings: a clinical-community partnership in South Los Angeles Health Promot Pract 2017 18 586 597 10.1177/1524839917705418 28443342 PMC5593854 · DOI
- [73]Petrescu-Prahova M Belza B Kohn M Miyawaki C Implementation and maintenance of a community-based older adult physical activity program Gerontologist 2016 56 677 686 10.1093/geront/gnv024 26035891 PMC6282690 · DOI
- [75]Veniegas RC Kao UH Rosales R Adapting HIV prevention evidence-based interventions in practice settings: an interview study Implement Sci 2009 4 76 10.1186/1748-5908-4-76 19930653 PMC2788516 · DOI
- [76]Collins CB Hearn KD Whittier DN Freeman A Stallworth JD Phields M Implementing packaged HIV-prevention interventions for HIV-positive individuals: considerations for clinic-based and community-based interventions Public Health Rep 2010 125 Suppl 55 63 10.1177/00333549101250S108 20408388 PMC2788409 · DOI
- [77]Murray M, Culver T, Farmer B, Jackson LA, Rixon B. From theory to practice: one agency’s experience with implementing an Evidence-Based Model Maureen. J Child Fam Stud. 2014;5:844–53. PMC4167773 25242876
- [78]Feutz K Andresen P Cuidate: implementation of a culturally based sexual risk reduction program for Hispanic adolescents Hisp Heal Care Int 2013 11 187 193 10.1891/1540-4153.11.4.187 24831073 · DOI
- [79]Honeycutt S Carvalho M Glanz K Daniel SD Kegler MC Research to reality J Public Heal Manag Pract 2012 18 431 439 10.1097/PHH.0b013e31822d4c69 22836534 · DOI
- [80]House LD Tevendale HD Martinez-Garcia G Implementing evidence-based teen pregnancy-prevention interventions in a community-wide initiative: building capacity and reaching youth J Adolesc Health 2017 60 S18 S23 10.1016/j.jadohealth.2016.08.013 28235430 PMC6594180 · DOI
- [81]Lundgren L Chassler D Amodeo M D’Ippolito M Sullivan L Barriers to implementation of evidence-based addiction treatment: a national study J Subst Abus Treat 2012 42 231 238 10.1016/j.jsat.2011.08.003 22000323 · DOI
- [82]Thomas R Zimmer-Gembeck MJ Chaffin M Practitioners’ views and use of evidence-based treatment: positive attitudes but missed opportunities in children’s services Adm Policy Ment Heal Ment Heal Serv Res. 2014 41 368 378 10.1007/s10488-013-0471-y 23371263 · DOI
- [84]Allicock M Johnson L-S Leone L Carr C Walsh J Ni A Promoting fruit and vegetable consumption among members of black churches, Michigan and North Carolina, 2008–2010 Prev Chronic Dis 2013 10 120161 10.5888/pcd10.120161 PMC3600872 23489638 · DOI
- [85]Vanderpool R Gainor S Conn M Spencer C Allen A Kennedy S Rural remote health Rural Remote Health 2011 193 118 125 PMC4089209 21988459
- [86]Kegeles SM Rebchook G Pollack L Huebner D Tebbetts S Hamiga J An intervention to help community-based organizations implement an evidence-based HIV prevention intervention: the Mpowerment project technology exchange system Am J Community Psychol 2012 49 182 198 10.1007/s10464-011-9451-0 21691911 · DOI
- [89]Collins C Harshbarger C Sawyer R Hamdallah M The diffusion of effective behavioral interventions project: development, implementation, and lessons learned AIDS Educ Prev 2006 18 4 Suppl A 5 20 10.1521/aeap.2006.18.supp.5 16987085 · DOI
- [90]Collins CB Sapiano TN Lessons learned from dissemination of evidence-based interventions for HIV prevention Am J Prev Med 2016 51 S140 S147 10.1016/j.amepre.2016.05.017 27402185 · DOI
- [91]Peterson AS Randall LM Utilizing multilevel partnerships to build the capacity of community-based organizations to implement effective HIV prevention interventions in Michigan AIDS Educ Prev 2006 18 SUPPL. A 83 95 10.1521/aeap.2006.18.supp.83 16987091 · DOI
- [93]Gearing RE El-Bassel N Ghesquiere A Baldwin S Gillies J Ngeow E Major ingredients of fidelity: a review and scientific guide to improving quality of intervention research implementation Clin Psychol Rev 2011 31 79 88 10.1016/j.cpr.2010.09.007 21130938 · DOI · Paper page
- [94]Weersing VR Rozenman M Gonzalez A Core components of therapy in youth Behav Modif 2009 33 24 47 10.1177/0145445508322629 18955540 · DOI
- [95]Maggin DM Johnson AH The reporting of core program components: an overlooked barrier for moving research into practice Prev Sch Fail Altern Educ Child Youth 2015 59 73 82 10.1080/1045988X.2013.837812 · DOI
- [97]Hawe AT P Shiell R Complex interventions: how “out of control” can a randomised controlled trial be? BMJ 2004 328 1561 1563 10.1136/bmj.328.7455.1561 15217878 PMC437159 · DOI · Paper page
- [100]Mitchell GE Berlan D Evaluation and evaluative rigor in the nonprofit sector Nonprofit Manag Leadersh 2016 27 237 250 10.1002/nml.21236 · DOI
- [101]Harlock J Impact measurement practice in the UK third sector: a review of emerging evidence. TSRC Working Paper 106 2013 Birmingham University of Birmingham
- [103]Carmel E Harlock JE Instituting the “third sector” as a governable terrain: partnership, procurement and performance in the UK Policy Polit 2008 36 155 171 10.1332/030557308783995017 · DOI
- [104]Maier F Meyer M Steinbereithner M Nonprofit organizations becoming business-like: a systematic review Nonprofit Volunt Sect Q 2016 45 64 86 10.1177/0899764014561796 · DOI
- [105]Moher D Schulz KF Simera I Altman DG Guidance for developers of health research reporting guidelines PLoS Med 2010 7 e1000217 10.1371/journal.pmed.1000217 20169112 PMC2821895 · DOI · Paper page
- [108]Bach-Mortensen AM Montgomery P What are the barriers and facilitators for third sector organisations (non-profits) to evaluate their services? A systematic review Syst Rev. 2018 7 13 10.1186/s13643-018-0681-1 29357930 PMC5778760 · DOI
- [109]Sackett D. Evidence-based medicine: how to practice and teach EBM. Churchill Livingstone. 2000; 10.1016/S1031-170X(97)80036-0. · DOI
- [110]Chalmers I If evidence-informed policy works in practice, does it matter if it doesn’t work in theory? Evid Policy. 2005 1 227 242 10.1332/1744264053730806 · DOI
- [111]Chalmers I Trying to do more good than harm in policy and practice: the role of rigorous, transparent, up-to-date evaluations Ann Am Acad Pol Soc Sci 2003 589 22 40 10.1177/0002716203254762 · DOI
- [113]Miguel E Kremer M Worms: identifying impacts on education and health in the presence of treatment externalities Econometrica 2004 72 159 217 10.1111/j.1468-0262.2004.00481.x · DOI · Paper page
- [114]Welch VA Ghogomu E Hossain A Awasthi S Qar Z Bhutta A Mass deworming to improve developmental health and wellbeing of children in low-income and middle-income countries: a systematic review and network meta-analysis 2017 27955788
- [115]Taylor-Robinson DC Maayan N Soares-Weiser K Donegan S Garner P Taylor-Robinson DC Deworming drugs for soil-transmitted intestinal worms in children: effects on nutritional indicators, haemoglobin, and school performance Cochrane Database of Systematic Reviews 2015 Chichester, UK John Wiley & Sons, Ltd
- [116]McHugh RK, Barlow DH. The dissemination and implementation of evidence-based psychological treatments. A review of current efforts. Am Psychol. 2010;65:73–84. 20141263
- [118]Groene O Botje D Suñol R Lopez MA Wagner C A systematic review of instruments that assess the implementation of hospital quality management systems Int J Qual Heal Care 2013 25 525 541 10.1093/intqhc/mzt058 23970437 · DOI
Cited by
Sorted by citations
Pollock, A., Campbell, P., Cheyne, J., Cowie, J., Davis, B., McCallum, J., McGill, K., Elders, A., Hagen, S., McClurg, D., et al. (2020) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd013779 · Cited by 631 · see citing works
Balis, L. E., Houghtaling, B., & Harden, S. M. (2022) · Translational Behavioral Medicine · doi:10.1093/tbm/ibac061 · Cited by 63 · see citing works
Bach‐Mortensen, A. M., & Verboom, B. (2020) · Research Synthesis Methods · doi:10.1002/jrsm.1447 · Cited by 69 · see citing works
Self-citationImproving relationship quality in group care settings: The impact of implementing the CARE model
Izzo, C. V., Smith, E. G., Sellers, D. E., Holden, M. J., & Nunno, M. A. (2020) · Children and Youth Services Review · doi:10.1016/j.childyouth.2019.104623 · Cited by 33 · see citing works
Brantnell, A., Temiz, S., Baraldi, E., Woodford, J., & von Essen, L. (2023) · JMIR Human Factors · doi:10.2196/44688 · Cited by 25 · see citing works
Amador, S., Rapaport, P., Lang, I., Sommerlad, A., Mukadam, N., Stringer, A., Hart, N., Nurock, S., & Livingston, G. (2021) · PLOS ONE · doi:10.1371/journal.pone.0250410 · Cited by 13 · see citing works
- Authors
- Bach-Mortensen, A. M., Lange, B. C. L., & Montgomery, P.
- Affiliations
- University of Oxford (GB)
- University of Birmingham (GB)
- Venue
- Implementation Science
- Published
- 2018-07-30
- Volume
- 13
- Issue
- 1
- Pages
- 103-103
- ISSN
- 1748-5908 (ISSN-L)
- PMC
- PMC6065156
- OpenAlex
- W2887990108
- Cited by
- 253
- References
- 16
- Citations by year
- 2026: 20 · 2025: 25 · 2024: 31 · 2023: 62 · 2022: 31 · 2021: 45 · 2020: 28 · 2019: 10 · 2018: 1
- FWCI
- 3.77
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- Implementation Science (publishedVersion, cc-by)
- Europe PMC (PubMed Central) (publishedVersion, other-oa)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- University of Birmingham Research Portal (University of Birmingham) (submittedVersion, cc-by)
- Funders
- TrygFonden
- Economic and Social Research Council (ES/N012267/2)
- Clarendon Fund
- Topics
- Health Sciences › Health Professions › General Health Professions › Health Policy Implementation Science
- Health Sciences › Health Professions › General Health Professions › Health Sciences Research and Education
- Social Sciences › Decision Sciences › Management Science and Operations Research › Evaluation and Performance Assessment
- Keywords
- third sector organizations, evidence-based interventions, implementation barriers, implementation facilitators, organizational culture, resource constraints, mission alignment, stakeholder engagement, service delivery, nonprofit organizations
- MeSH terms
- Health Services, Health Services Research, Humans, Organizations, Nonprofit, Organizational Culture, Evidence-Based Practice
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review