Assessing the comparative effectiveness of implementation strategies for professional services to community pharmacy: A systematic review
Abstract
Background Despite the growth of research in how professional services are implemented in the community pharmacy setting, there is limited evidence for which implementation strategy is more effective.Objective The aim of this review was to assess the evidence for the comparative effectiveness of implementation strategies for pharmacist delivered professional services in the community pharmacy.Methods Studies comparing implementation strategies published in the last 13 years in English were extracted via four databases, combining the topics of 'pharmacy', 'pharmacy services' and 'implementation'. Experimental studies with quantitative evaluation of two or more implementation strategies were included. Selected studies were screened through three internationally recognised tools, two focusing on implementation: quality of evidence (Cochrane Qualitative & Implementation Methods Group), reporting standards (Standards for Reporting Implementation Studies - StaRI), and one assessing the risk of bias (The Risk of Bias in Non-randomised Studies of Interventions).Results Six studies were identified, assessing the implementation of services improving use of medicines (n = 2), primary care and public health services (n = 3), and one study evaluating the implementation of services in both categories. Some form of staff training was demonstrated to be more effective (n = 4). The risk of bias ranged from moderate to critical. With respect to reporting on StaRI tool items, the mention of these was, in the majority, indirect. Items such as harms and published protocols and economic evaluation were not reported in any of the studies included in the final review, highlighting opportunities for improvement.Conclusions Training may be superior for implementation of professional services to community pharmacies, although this finding is limited by a moderate to critical risk of bias. A recommendation to researchers is for the greater use of comparative implementation study designs that reflect recognised reporting, quality and validity tools.Registration None.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Much of the evidence for individual or groups of ERIC strategies remains narrowly focused, with prior systematic reviews and meta-analyses generally focusing on a specific strategy, subpopulation, disease, outcome, service setting, or geography.
“However, much of the evidence for individual or groups of ERIC strategies remains narrowly focused. Prior systematic reviews and meta-analyses have assessed strategy effectiveness, but have generally focused on a specific strategy, (e.g., Audit and Provide Feedback) [14–16], subpopulation, disease (e.g., individuals living with dementia) [16], outcome [15], service setting (e.g., primary care Clin”
From A systematic review of experimentally tested implementation strategies across health and human service settings: evidence from 2010-2022 (2024) · cites this paper as [19]
Cites
RoB 2: a revised tool for assessing risk of bias in randomised trials
Sterne, J. A. C., Savović, J., Page, M. J., Elbers, R. G., Blencowe, N. S., Boutron, I., Cates, C. J., Cheng, H.-Y., Corbett, M. S., Eldridge, S. M., et al. (2019) · BMJ · doi:10.1136/bmj.l4898 · Cited by 33,583 · see citing works
ROBINS-I: a tool for assessing risk of bias in non-randomised studies of interventions
Sterne, J. A., Hernán, M. A., Reeves, B. C., Savović, J., Berkman, N. D., Viswanathan, M., Henry, D., Altman, D. G., Ansari, M. T., Boutron, I., et al. (2016) · BMJ · doi:10.1136/bmj.i4919 · Cited by 20,329 · see citing works
Damschroder, L. J., Aron, D. C., Keith, R. E., Kirsh, S. R., Alexander, J. A., & Lowery, J. C. (2009) · Implementation Science · doi:10.1186/1748-5908-4-50 · Cited by 14,496 · see citing works
von Elm, E., Altman, D. G., Egger, M., Pocock, S. J., Gøtzsche, P. C., & Vandenbroucke, J. P. (2014) · International Journal of Surgery · doi:10.1016/j.ijsu.2014.07.013 · Cited by 9,909 · see citing works
Proctor, E., Silmere, H., Raghavan, R., Hovmand, P., Aarons, G., Bunger, A., Griffey, R., & Hensley, M. (2011) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-010-0319-7 · Cited by 8,721 · see citing works
Curran, G. M., Bauer, M., Mittman, B., Pyne, J. M., & Stetler, C. (2012) · Medical Care · doi:10.1097/mlr.0b013e3182408812 · Cited by 4,058 · see citing works
Implementation strategies: recommendations for specifying and reporting
Proctor, E. K., Powell, B. J., & McMillen, J. C. (2013) · Implementation Science · doi:10.1186/1748-5908-8-139 · Cited by 2,585 · see citing works
A conceptual framework for implementation fidelity
Carroll, C., Patterson, M., Wood, S., Booth, A., Rick, J., & Balain, S. (2007) · Implementation Science · doi:10.1186/1748-5908-2-40 · Cited by 2,559 · see citing works
Page, M. J., Moher, D., Bossuyt, P., Boutron, I., Hoffmann, T., mulrow, C., Shamseer, L., Tetzlaff, J., Akl, E., Brennan, S. E., et al. (2020) · doi:10.31222/osf.io/gwdhk · Cited by 916 · see citing works
Enhancing the Impact of Implementation Strategies in Healthcare: A Research Agenda
Powell, B. J., Fernandez, M. E., Williams, N. J., Aarons, G. A., Beidas, R. S., Lewis, C. C., McHugh, S. M., & Weiner, B. J. (2019) · Frontiers in Public Health · doi:10.3389/fpubh.2019.00003 · Cited by 775 · see citing works
Evidence-Based Implementation of Evidence-Based Medicine
Grol, R., & Grimshaw, J. (1999) · The Joint Commission Journal on Quality Improvement · doi:10.1016/s1070-3241(16)30464-3 · Cited by 421 · see citing works
Systematic evaluation of implementation fidelity of complex interventions in health and social care
Hasson, H. (2010) · Implementation Science · doi:10.1186/1748-5908-5-67 · Cited by 418 · see citing works
Standards for Reporting Implementation Studies (StaRI): explanation and elaboration document
Pinnock, H., Barwick, M. A., Carpenter, C. R., Eldridge, S. M., Grandes, G., Griffiths, C., Rycroft‐Malone, J., Meißner, P., Murray, E., Patel, A. K., et al. (2017) · BMJ Open · doi:10.1136/bmjopen-2016-013318 · Cited by 342 · see citing works
Designing and undertaking randomised implementation trials: guide for researchers
Wolfenden, L., Foy, R., Presseau, J., Grimshaw, J., Ivers, N. M., Powell, B. J., Taljaard, M., Wiggers, J., Sutherland, R., Nathan, N., et al. (2021) · BMJ · doi:10.1136/bmj.m3721 · Cited by 279 · see citing works
Context and implementation: A concept analysis towards conceptual maturity
Pfadenhauer, L. M., Mozygemba, K., Gerhardus, A., Hofmann, B., Booth, A., Lysdahl, K. B., Tummers, M., Burns, J., & Rehfuess, E. A. (2015) · Zeitschrift für Evidenz, Fortbildung und Qualität im Gesundheitswesen · doi:10.1016/j.zefq.2015.01.004 · Cited by 189 · see citing works
Foy, R., Ovretveit, J., Shekelle, P. G., Pronovost, P. J., Taylor, S. L., Dy, S., Hempel, S., McDonald, K. M., Rubenstein, L. V., & Wachter, R. M. (2011) · BMJ Quality & Safety · doi:10.1136/bmjqs.2010.047993 · Cited by 148 · see citing works
Effectiveness-implementation hybrid designs: implications for quality improvement science
Bernet, A. C., Willens, D. E., & Bauer, M. S. (2013) · Implementation Science · doi:10.1186/1748-5908-8-s1-s2 · Cited by 140 · see citing works
Mehuys, E., Van Bortel, L., De Bolle, L., Van Tongelen, I., Annemans, L., Remon, J.-P., & Giri, M. (2011) · Journal of Clinical Pharmacy and Therapeutics · doi:10.1111/j.1365-2710.2010.01218.x · Cited by 139 · see citing works
Roberts, A. S., Benrimoj, S. I., Chen, T. F., Williams, K. A., & Aslani, P. (2006) · International Journal of Pharmacy Practice · doi:10.1211/ijpp.14.3.0002 · Cited by 134 · see citing works
Pinnock, H., Epiphaniou, E., Pearce, G., Parke, H., Greenhalgh, T., Sheikh, A., Griffiths, C. J., & Taylor, S. J. C. (2015) · BMC Medicine · doi:10.1186/s12916-015-0361-0 · Cited by 132 · see citing works
Moullin, J. C., Sabater-Hernández, D., & Benrimoj, S. I. (2016) · BMC Health Services Research · doi:10.1186/s12913-016-1689-7 · Cited by 108 · see citing works
Bell, J. S., McLachlan, A. J., Chen, T. F., Whitehead, P. A., & Aslani, P. (2005) · Australia and New Zealand Health Policy · doi:10.1071/hp050229 · Cited by 107 · see citing works
Community pharmacy in Australia: A health hub destination of the future
McMillan, S. S., Wheeler, A., Sav, A., King, M. A., Whitty, J. A., Kendall, E. A., & Kelly, F. (2012) · Research in Social and Administrative Pharmacy · doi:10.1016/j.sapharm.2012.11.003 · Cited by 92 · see citing works
A literature review to identify interventions to improve the use of medicines in children
Costello, I., Wong, I. C. K., & Nunn, A. J. (2004) · Child Care Health and Development · doi:10.1111/j.1365-2214.2004.00478.x · Cited by 85 · see citing works
Cargo, M., Harris, J., Tomás Pantoja, C., Booth, A., Harden, A., Hannes, K., Thomas, J., Flemming, K., Garside, R., & Noyes, J. (2017) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2017.11.028 · Cited by 67 · see citing works
Brown, D., Portlock, J. C., Rutter, P. M., & Nazar, Z. J. (2013) · Research in Social and Administrative Pharmacy · doi:10.1016/j.sapharm.2013.04.014 · Cited by 61 · see citing works
An Update on Evidence of Clinical Pharmacy Services’ Impact on Health-Related Quality of Life
Pickard, A. S., & Hung, S.-Y. (2006) · Annals of Pharmacotherapy · doi:10.1345/aph.1g653 · Cited by 55 · see citing works
Pharmacy-based statewide naloxone distribution: A novel “top-down, bottom-up” approach
Morton, K. J., Harrand, B., Floyd, C. C., et al. (2017) · Journal of the American Pharmacists Association · doi:10.1016/j.japh.2017.01.017 · Cited by 54 · see citing works
Advancing pharmacy practice through implementation science
Curran, G. M., & Shoemaker, S. J. (2017) · Research in Social and Administrative Pharmacy · doi:10.1016/j.sapharm.2017.05.018 · Cited by 52 · see citing works
Advocating zoster vaccination in a community pharmacy through use of personal selling
Bryan, A. R., Liu, Y., & Kuehl, P. G. (2013) · Journal of the American Pharmacists Association · doi:10.1331/japha.2013.11097 · Cited by 47 · see citing works
Standards and guidelines for observational studies: quality is in the eye of the beholder
Morton, S. C., Costlow, M. R., Graff, J. S., & Dubois, R. W. (2015) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2015.10.014 · Cited by 43 · see citing works
Bacci, J. L., Bigham, K. A., Dillon‐Sumner, L., Ferreri, S. P., Frail, C. K., Hamada, C. Y., Lantaff, W. M., McGivney, M. S., Renner, H. M., Snyder, M. E., et al. (2019) · JACCP JOURNAL OF THE AMERICAN COLLEGE OF CLINICAL PHARMACY · doi:10.1002/jac5.1136 · Cited by 41 · see citing works
Elevating pharmacists’ scope of practice through a health-system clinical privileging process
Jordan, T. A., Hennenfent, J. A., Lewin, J. J., et al. (2016) · American Journal of Health-System Pharmacy · doi:10.2146/ajhp150820 · Cited by 40 · see citing works
Hattingh, L., Kelly, F., Fowler, J., et al. (2017) · Research in Social and Administrative Pharmacy · doi:10.1016/j.sapharm.2017.05.017 · Cited by 40 · see citing works
Feletto, E., Lui, G. W. Y., Armour, C. L., & Saini, B. (2012) · International Journal of Pharmacy Practice · doi:10.1111/j.2042-7174.2012.00225.x · Cited by 31 · see citing works
Fraeyman, J., Foulon, V., Mehuys, E., Boussery, K., Saevels, J., Vriese, C. D., Dalleur, O., Housiaux, M., Steurbaut, S., Naegels, M., et al. (2016) · Research in Social and Administrative Pharmacy · doi:10.1016/j.sapharm.2016.02.001 · Cited by 30 · see citing works
Isho, N. Y., Kachlic, M. D., Marcelo, J. C., et al. (2017) · Journal of the American Pharmacists Association · doi:10.1016/j.japh.2017.03.006 · Cited by 29 · see citing works
Westrick, S. C., Owen, J. A., Hagel, H. P., Owensby, J. K., & Lertpichitkul, T. (2016) · Journal of the American Pharmacists Association · doi:10.1016/j.japh.2015.11.010 · Cited by 22 · see citing works
Baggarly, S., Jenkins, T., Biglane, G. C., Smith, G. W., Smith, C. M., & Blaylock, B. L. (2010) · Annals of Pharmacotherapy · doi:10.1345/aph.1p226 · Cited by 17 · see citing works
Fuller, J. M., Saini, B., Bosnic-Anticevich, S. Z., García‐Cárdenas, V., Benrimoj, S. I., & Armour, C. L. (2017) · Research in Social and Administrative Pharmacy · doi:10.1016/j.sapharm.2017.05.019 · Cited by 14 · see citing works
Woeppel, J., Clark, R., Underwood, L., et al. (2019) · Research in Social and Administrative Pharmacy · doi:10.1016/j.sapharm.2019.05.018 · Cited by 12 · see citing works
Watkins, K., Wood, H. A., Clifford, R. M., et al. (2016) · Research in Social and Administrative Pharmacy · doi:10.1016/j.sapharm.2016.05.101 · Cited by 5 · see citing works
Planning New Pharmacist Services that Last: The Prescription Shop's Travel Medicine Clinic
Stowe, B., & Winslade, N. E. (2009) · Canadian Pharmacists Journal / Revue des Pharmaciens du Canada · doi:10.3821/1913-701x-142.4.178 · Cited by 4 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
Ashcraft, L. E., Goodrich, D. E., Hero, J., Phares, A., Bachrach, R. L., Quinn, D. A., Qureshi, N., Ernecoff, N. C., Lederer, L. G., Scheunemann, L. P., et al. (2024) · Implementation Science · doi:10.1186/s13012-024-01369-5 · Cited by 89 · see citing works
- Authors
- Seda, V., Moles, R. J., Carter, S. R., & Schneider, C. R.
- Affiliations
- The University of Sydney (AU)
- Corresponding author
- Seda, Veronika
- Venue
- Research in Social and Administrative Pharmacy
- Publisher
- Elsevier BV
- Published
- 2022-09
- Volume
- 18
- Issue
- 9
- Pages
- 3469-3483
- ISSN
- 1551-7411 (ISSN-L)
- OpenAlex
- W4224111840
- Cited by
- 22
- References
- 43
- Citations by year
- 2026: 1 · 2025: 7 · 2024: 12 · 2023: 1 · 2021: 1
- FWCI
- 0.97
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- Locations
- Research in Social and Administrative Pharmacy (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Health Sciences › Health Professions › General Health Professions › Health Policy Implementation Science
- Life Sciences › Pharmacology, Toxicology and Pharmaceutics › Pharmacology › Pharmacy and Medical Practices
- Health Sciences › Medicine › Geriatrics and Gerontology › Pharmaceutical Practices and Patient Outcomes
- Keywords
- implementation strategies, community pharmacy, employee training, comparative effectiveness, primary care services, public health services, reporting quality, risk of bias
- MeSH terms
- Community Pharmacy Services, Delivery of Health Care, Humans, Pharmaceutical Services, Pharmacies, Pharmacists
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
