Stakeholders' contributions to tailored implementation programs: an observational study of group interview methods
Open accessAbstract
BACKGROUND: Tailored strategies to implement evidence-based practice can be generated in several ways. In this study, we explored the usefulness of group interviews for generating these strategies, focused on improving healthcare for patients with chronic diseases. METHODS: Participants included at least four categories of stakeholders (researchers, quality officers, health professionals, and external stakeholders) in five countries. Interviews comprised brainstorming followed by a structured interview and focused on different chronic conditions in each country. We compared the numbers and types of strategies between stakeholder categories and between interview phases. We also determined which strategies were actually used in tailored intervention programs. RESULTS: In total, 127 individuals participated in 25 group interviews across five countries. Brainstorming generated 8 to 120 strategies per group; structured interviews added 0 to 55 strategies. Healthcare professionals and researchers provided the largest numbers of strategies. The type of strategies for improving healthcare practice did not differ systematically between stakeholder groups in four of the five countries. In three out of five countries, all components of the chosen intervention programs were mentioned by the group of researchers. CONCLUSIONS: Group interviews with different stakeholder categories produced many strategies for tailored implementation of evidence-based practice, of which the content was largely similar across stakeholder categories.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the previous review, the rigour of the determinants analyses failed to predict effectiveness.
“However, it was difficult to judge the rigour of the analysis of determinants since little is yet known of the most useful approaches (Huntink 2014; Wensing 2014), and this variable failed to predict effectiveness.”
From Tailored interventions to address determinants of practice (2015) · cites this paper as Huntink 2014
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Flottorp, S. A., Oxman, A. D., Krause, J., Musila, N. R., Wensing, M., Godycki-Cwirko, M., Baker, R., & Eccles, M. P. (2013) · Implementation Science · doi:10.1186/1748-5908-8-35 · Cited by 1,138 · see citing works
Self-citationBaker, R., Camosso-Stefinovic, J., Gillies, C., Shaw, E. J., Cheater, F., Flottorp, S., & Robertson, N. (2010) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd005470.pub2 · Cited by 1,003 · see citing works
Self-citationWhat about N? A methodological study of sample-size reporting in focus group studies
Carlsen, B., & Glenton, C. (2011) · BMC Medical Research Methodology · doi:10.1186/1471-2288-11-26 · Cited by 670 · see citing works
Fern, E. F. (1982) · Journal of Marketing Research · doi:10.1177/002224378201900101 · Cited by 557 · see citing works
Perceived barriers and effective strategies to diabetes self‐management
Nagelkerk, J., Reick, K., & Meengs, L. (2006) · Journal of Advanced Nursing · doi:10.1111/j.1365-2648.2006.03799.x · Cited by 412 · see citing works
Tailoring quality improvement interventions to identified barriers: a multiple case analysis
Bosch, M., Van Der Weijden, T., Wensing, M., & Grol, R. (2007) · Journal of Evaluation in Clinical Practice · doi:10.1111/j.1365-2753.2006.00660.x · Cited by 272 · see citing works
Self-citationFern, E. F. (1982) · Journal of Marketing Research · doi:10.2307/3151525 · Cited by 222 · see citing works
Developing and selecting interventions for translating knowledge to action
Wensing, M., Bosch, M., & Grol, R. P. T. M. (2009) · Canadian Medical Association Journal · doi:10.1503/cmaj.081233 · Cited by 203 · see citing works
Self-citationMultiple stakeholders and multiple city brand meanings
Merrilees, B., Miller, D., & Herington, C. (2012) · European Journal of Marketing · doi:10.1108/03090561211230188 · Cited by 203 · see citing works
Helm, S. (2007) · Corporate Communications An International Journal · doi:10.1108/13563280710776842 · Cited by 195 · see citing works
Tailored Implementation for Chronic Diseases (TICD): a project protocol
Wensing, M., Oxman, A., Baker, R., Godycki-Cwirko, M., Flottorp, S., Szecsenyi, J., Grimshaw, J., & Eccles, M. (2011) · Implementation Science · doi:10.1186/1748-5908-6-103 · Cited by 184 · see citing works
Self-citationEnhancing Ideational Creativity in Groups
Paulus, P. B., & Brown, V. R. (2003) · Oxford University Press eBooks · doi:10.1093/acprof:oso/9780195147308.003.0006 · Cited by 182 · see citing works
Krause, J., van Lieshout, J., Klomp, R., Huntink, E. M., Aakhus, E., Flottorp, S. A., Jäger, C., Steinhaeuser, J., Godycki-Ćwirko, M., Kowalczyk, A., et al. (2014) · Implementation Science · doi:10.1186/s13012-014-0102-3 · Cited by 178 · see citing works
Self-citationIliffe, S., Lepeleire, J. D., van Hout, H. P. J., Kenny, G., Lewis, A., Vernooij-Dassen, M. J. F. J., & The Diadem Group (2005) · Aging & Mental Health · doi:10.1080/13607860412331323791 · Cited by 117 · see citing works
Tailored implementation of evidence-based practice for patients with chronic diseases
Wensing, M., Huntink, E., van Lieshout, J., Godycki-Cwirko, M., Kowalczyk, A., Jäger, C., Steinhäuser, J., Aakhus, E., Flottorp, S., Eccles, M., et al. (2014) · PLoS ONE · doi:10.1371/journal.pone.0101981 · Cited by 74 · see citing works
Self-citationGroup interviews in primary care research: advancing the state of the art or ritualized research?
Twohig, P. L. (2002) · Family Practice · doi:10.1093/fampra/19.3.278 · Cited by 65 · see citing works
Collaborative use of mobile phones for brainstorming
Lucero, A., Keränen, J., & Korhonen, H. (2010) · International Conference on Human-Computer Interaction with Mobile Devices and Services (MobileHCI) · doi:10.1145/1851600.1851659 · Cited by 61 · see citing works
Persistence of Brainstorming Groups: How Do People Know When to Stop?
Nijstad, B. A., Stroebe, W., & Lodewijkx, H. F. M. (1999) · Journal of Experimental Social Psychology · doi:10.1006/jesp.1998.1374 · Cited by 61 · see citing works
Brainstorming rules as assigned goals: Does brainstorming really improve idea quantity?
Litchfield, R. C. (2008) · Motivation and Emotion · doi:10.1007/s11031-008-9109-x · Cited by 50 · see citing works
Kaasalainen, S., Williams, J. L., Hadjistavropoulos, T., Thorpe, L. U., Whiting, S. J., Neville, S., & Tremeer, J. (2010) · Qualitative Health Research · doi:10.1177/1049732310377456 · Cited by 48 · see citing works
Jäger, C., Freund, T., Steinhäuser, J., Joos, S., Wensing, M., & Szécsényi, J. (2013) · Trials · doi:10.1186/1745-6215-14-420 · Cited by 28 · see citing works
Self-citationHuntink, E. M., Heijmans, N., Wensing, M., & van Lieshout, J. (2013) · Trials · doi:10.1186/1745-6215-14-433 · Cited by 28 · see citing works
Self-citationOrsatti, C. L., Nahás, E. A. P., Nahás-Neto, J., Orsatti, F. L., Giorgi, V. S. I., & Witkin, S. S. (2014) · PLoS ONE · doi:10.1371/journal.pone.0109259 · Cited by 26 · see citing works
Godycki-Ćwirko, M., Zakowska, I., Kosiek, K., Wensing, M., Krawczyk, J., & Kowalczyk, A. (2014) · Trials · doi:10.1186/1745-6215-15-109 · Cited by 19 · see citing works
Self-citationKrause, J., Agarwal, S., Bodicoat, D. H., Ring, A., Shepherd, D. J., Rogers, S., Wensing, M., & Baker, R. (2014) · Trials · doi:10.1186/1745-6215-15-82 · Cited by 19 · see citing works
Self-citationAakhus, E., Granlund, I., Odgaard‐Jensen, J., Wensing, M., Oxman, A. D., & Flottorp, S. A. (2014) · Trials · doi:10.1186/1745-6215-15-16 · Cited by 18 · see citing works
Self-citation
Flagged first, then by citations
Research works printed but not linked: 1
- [15]Osborn AF Applied Imagination 1957 Oxford Scribner's
Cited by
Sorted by citations
Qualitative methods in implementation research: An introduction
Hamilton, A. B., & Finley, E. P. (2019) · Psychiatry Research · doi:10.1016/j.psychres.2019.112516 · Cited by 1,414 · see citing works
Tailored interventions to address determinants of practice
Baker, R., Camosso-Stefinovic, J., Gillies, C., Shaw, E. J., Cheater, F., Flottorp, S., Robertson, N., Wensing, M., Fiander, M., Eccles, M. P., et al. (2015) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd005470.pub3 · Cited by 711 · see citing works
Self-citationReprint of: Qualitative methods in implementation research: An introduction
Hamilton, A. B., & Finley, E. P. (2019) · Psychiatry Research · doi:10.1016/j.psychres.2019.112629 · Cited by 158 · see citing works
Lewis, C. C., Scott, K., & Marriott, B. R. (2018) · Implementation Science · doi:10.1186/s13012-018-0761-6 · Cited by 113 · see citing works
Herrera, P., Campos, S., Szabo, W., Martínez, P., Viviana Guajardo, T., & Rojas, G. (2021) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph182212130 · Cited by 98 · see citing works
Conceptual tensions and practical trade-offs in tailoring implementation interventions
McHugh, S., Riordan, F., Curran, G. M., Lewis, C. C., Wolfenden, L., Presseau, J., Lengnick‐Hall, R., & Powell, B. J. (2022) · Frontiers in Health Services · doi:10.3389/frhs.2022.974095 · Cited by 56 · see citing works
Aakhus, E., Granlund, I., Odgaard‐Jensen, J., Oxman, A. D., & Flottorp, S. A. (2015) · Implementation Science · doi:10.1186/s13012-016-0397-3 · Cited by 41 · see citing works
Self-citationShrubsole, K., Power, E., & Hallé, M. (2022) · International Journal of Language & Communication Disorders · doi:10.1111/1460-6984.12805 · Cited by 35 · see citing works
Jäger, C., Steinhäuser, J., Freund, T., Baker, R., Agarwal, S., Godycki-Ćwirko, M., Kowalczyk, A., Aakhus, E., Granlund, I., van Lieshout, J., et al. (2015) · Implementation Science · doi:10.1186/s13012-016-0473-8 · Cited by 29 · see citing works
Self-citationvan Lieshout, J., Huntink, E. M., Koetsenruijter, J., & Wensing, M. (2015) · Implementation Science · doi:10.1186/s13012-016-0460-0 · Cited by 27 · see citing works
Self-citationAakhus, E., Granlund, I., Oxman, A. D., & Flottorp, S. A. (2015) · International Journal of Mental Health Systems · doi:10.1186/s13033-015-0027-5 · Cited by 18 · see citing works
Self-citationRiordan, F., Kerins, C., Pallin, N. D., Albers, B., Clack, L., Morrissey, E. C., Curran, G. M., Lewis, C. C., Powell, B. J., Presseau, J., et al. (2022) · HRB Open Research · doi:10.12688/hrbopenres.13507.2 · Cited by 14 · see citing works
Racine, E., O’Mahony, L., Riordan, F., Flynn, G., Kearney, P. M., & McHugh, S. (2022) · HRB Open Research · doi:10.12688/hrbopenres.13544.1 · Cited by 11 · see citing works
A beginner's guide to implementation science
de Waard, D., Gainer, R. A., Sim, M., Cote, C. L., Tremblay, P., Bonnar, P., & Hirsch, G. M. (2025) · JTCVS Techniques · doi:10.1016/j.xjtc.2025.05.005 · Cited by 10 · see citing works
Chang, W., Wang, Y.-L., Chang, Y., & Lo, S.-Y. (2021) · Applied Sciences · doi:10.3390/app11094229 · Cited by 8 · see citing works
Huntink, E. M., Wensing, M., Timmers, I. M., & van Lieshout, J. (2016) · Implementation Science · doi:10.1186/s13012-016-0526-z · Cited by 7 · see citing works
Self-citationChan, I. Y. S., Ma, P., & Ho, T. (2025) · Journal of Construction Engineering and Management · doi:10.1061/jcemd4.coeng-15704 · Cited by 4 · see citing works
Yount, K. M., Whitaker, D. J., Fang, X., Trang, Q. T., Macaulay, M. K., & Minh, T. (2024) · Trials · doi:10.1186/s13063-024-08401-5 · Cited by 5 · see citing works
Parks, R., & Ramly, E. (2023) · Proceedings of the Human Factors and Ergonomics Society Annual Meeting · doi:10.1177/21695067231192253 · Cited by 3 · see citing works
Riordan, F., Curran, G. M., Pallin, N., Albers, B., Presseau, J., Morrissey, E., Curran, G. M., Lewis, C. C., Powell, B. J., Presseau, J., et al. (2022) · HRB Open Research · doi:10.12688/hrbopenres.13507.1 · Cited by 15 · see citing works
Tong, W. T., Lee, Y. K., Ng, C. J., & Lee, P. Y. (2024) · PLoS ONE · doi:10.1371/journal.pone.0310654 · Cited by 2 · see citing works
The state of implementation science in major depressive disorder: A narrative review
He, Y., Murphy, J., Wang, X., Michalak, E. E., Yang, T., Yang, X., Liu, J., Fang, Y., Lam, R. W. M., & Chen, J. (2024) · Psychiatry Research · doi:10.1016/j.psychres.2024.116330 · Cited by 1 · see citing works
Stolldorf, D. P., Storrow, A. B., Liu, D., Jenkins, C. A., Hilton, R. A., Miller, K. F., Kim, J., Boopathy, D., Gunaga, S., Kea, B., et al. (2025) · BMC Health Services Research · doi:10.1186/s12913-024-12102-9 · Cited by 1 · see citing works
Tong, W. T., Lee, Y. K., Ng, C. J., & Lee, P. Y. (2023) · Research Square · doi:10.21203/rs.3.rs-3339576/v1 · Cited by 1 · see citing works
Een implementatieprogramma CVRM voor praktijkondersteuners
Huntink, E. M., Wensing, M., & van Lieshout, J. (2017) · Huisarts en Wetenschap · doi:10.1007/s12445-017-0393-0
Self-citationSidani, S., & Braden, C. J. (2021) · Wiley eBooks · doi:10.1002/9781119610113.ch3
Wing, R., Albanese, A. M., Prieto, M. M., Greenwald, E. E., Harwayne‐Gidansky, I., Nagler, J., Goldman, M. P., Tanzer, J. R., Miller, K. A., Napolitano, N., et al. (2026) · Implementation Science Communications · doi:10.1186/s43058-026-00935-w
- Authors
- Huntink, E., van Lieshout, J., Aakhus, E., Baker, R., Flottorp, S., Godycki-Cwirko, M., Jäger, C., Kowalczyk, A., Szecsenyi, J., & Wensing, M.
- Affiliations
- Radboud University Medical Center (NL)
- Innlandet Hospital Trust (NO)
- University of Leicester (GB)
- University of Oslo (NO)
- University Hospital Heidelberg (DE)
- Medical University of Lodz (PL)
- Corresponding author
- Wensing, Michel
- Venue
- Implementation Science
- Published
- 2014-12
- Volume
- 9
- Issue
- 1
- Pages
- 185-185
- ISSN
- 1748-5908 (ISSN-L)
- PMC
- PMC4268850
- OpenAlex
- W2120819534
- Cited by
- 27
- References
- 26
- Citations by year
- 2026: 1 · 2025: 3 · 2024: 3 · 2023: 2 · 2022: 5 · 2021: 3 · 2019: 2 · 2018: 1 · 2017: 1 · 2016: 1 · 2015: 5
- FWCI
- 4.21
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Locations
- Implementation Science (publishedVersion, cc-by)
- Europe PMC (PubMed Central) (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- Figshare (submittedVersion, cc-by)
- Leicester Research Archive (University of Leicester) (submittedVersion, public-domain)
- Funders
- European Commission (258837, 2007–2013, FP7 2007-2013, FP7/2007)
- ZonMw (200310011)
- Topics
- Health Sciences › Health Professions › General Health Professions › Health Policy Implementation Science
- Social Sciences › Sociology and Political Science › Delphi Technique in Research
- Health Sciences › Health Professions › General Health Professions › Health Sciences Research and Education
- Keywords
- evidence-based practice, stakeholder engagement, group interviews, brainstorming, chronic disease, healthcare workers, researchers, implementation program, stakeholder categories
- MeSH terms
- Attitude of Health Personnel, Chronic Disease, Diffusion of Innovation, Health Plan Implementation, Health Policy, Humans, Interviews as Topic, Prospective Studies, Evidence-Based Practice, Quality Improvement
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
