Factors associated with the impact of quality improvement collaboratives in mental healthcare: An exploratory study
Open accessAbstract
Background: Quality improvement collaboratives (QICs) bring together groups of healthcare professionals to work in a structured manner to improve the quality of healthcare delivery within particular domains. We explored which characteristics of the composition, participation, functioning, and organization of these collaboratives related to changes in the healthcare for patients with anxiety disorders, dual diagnosis, or schizophrenia. Methods: We studied three QICs involving 29 quality improvement (QI) teams representing a number of mental healthcare organizations in the Netherlands. The aims of the three QICs were the implementation of multidisciplinary practice guidelines in the domains of anxiety disorders, dual diagnosis, and schizophrenia, respectively. We used eight performance indicators to assess the impact of the QI teams on self-reported patient outcomes and process of care outcomes for 1,346 patients. The QI team members completed a questionnaire on the characteristics of the composition, participation in a national program, functioning, and organizational context for their teams. It was expected that an association would be found between these team characteristics and the quality of care for patients with anxiety disorders, dual diagnosis, and schizophrenia. Results: No consistent patterns of association emerged. Theory-based factors did not perform better than practice-based factors. However, QI teams that received support from their management and both active and inspirational team leadership showed better results. Rather surprisingly, a lower average level of education among the team members was associated with better results, although less consistently than the management and leadership characteristics. Team views with regard to the QI goals of the team and attitudes towards multidisciplinary practice guidelines did not correlate with team success. Conclusions: No general conclusions about the impact of the characteristics of QI teams on the quality of healthcare can be drawn, but support of the management and active, inspirational team leadership appear to be important. Not only patient outcomes but also the performance indicators of monitoring and screening/assessment showed improvement in many but not all of the QI teams with such characteristics. More studies are needed to identify factors associated with the impact of multidisciplinary practice guidelines in mental healthcare.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Most sustainability research focuses on categorizing factors presumably associated with program continuation.
“As was documented in a systematic review of 125 empirical studies of health-focused interventions, most sustainability research focuses on categorizing factors presumably associated with program continuation—known as program sustainment [15].”
From Using qualitative comparative analysis to uncover multiple pathways to program sustainment: implications for community-based youth substance misuse prevention (2022) · cites this paper as [15]
The Methods (Data analysis) and Results (Associations between QI team factors and performance indicators) examine factors associated with the impact of mental-healthcare quality-improvement teams. Searches for a systematic review of 125 studies, sustainability, and program continuation found no passage in our copy addressing the attributed claim. (LLM, conf=0.77)
Experimental — accuracy not yet measuredDespite an increase in the number of studies focusing on program sustainment, there remains a relative dearth of empirical evidence on the combinations of factors associated with sustainment, especially those guided by established sustainment frameworks and measurement tools.
“Despite an increase in the number of studies focusing on program sustainment, there remains a relative dearth of empirical evidence on the combinations of factors associated with sustainment [15, 16, 59], especially those guided by established sustainment frameworks and measurement tools [23].”
From Using qualitative comparative analysis to uncover multiple pathways to program sustainment: implications for community-based youth substance misuse prevention (2022) · cites this paper as [15]
Split into 2 atoms — 0 confirmed, 0 partially supported, 0 disputed, 0 misattributed, 2 unverifiable. Expand the claim to see per-atom verdicts.
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Organizational innovation: A meta-analysis of effects of determinants and moderators
Damanpour, F. (1991) · Academy of Management Journal · doi:10.2307/256406 · Cited by 6,542 · see citing works
Kimberly, J. R., & Evanisko, M. J. (1981) · Academy of Management Journal · doi:10.2307/256170 · Cited by 2,386 · see citing works
Antonakis, J., Avolio, B. J., & Sivasubramaniam, N. (2003) · The Leadership Quarterly · doi:10.1016/s1048-9843(03)00030-4 · Cited by 1,533 · see citing works
Aarons, G. A. (2004) · Mental Health Services Research · doi:10.1023/b:mhsr.0000024351.12294.65 · Cited by 1,272 · see citing works
Transactional versus transformational leadership: An analysis of the MLQ
Hartog, D. N. D., van Muijen, J. J., & Koopman, P. L. (1997) · Journal of Occupational and Organizational Psychology · doi:10.1111/j.2044-8325.1997.tb00628.x · Cited by 899 · see citing works
Evidence for the impact of quality improvement collaboratives: systematic review
Schouten, L. M. T., Hulscher, M., van Everdingen, J. J. E., Huijsman, R., & Grol, R. P. T. M. (2008) · BMJ · doi:10.1136/bmj.39570.749884.be · Cited by 683 · see citing works
Quality collaboratives: lessons from research
Øvretveit, J. (2002) · BMJ Quality & Safety · doi:10.1136/qhc.11.4.345 · Cited by 572 · see citing works
Developing and Testing Changes in Delivery of Care
Berwick, D. M. (1998) · Annals of Internal Medicine · doi:10.7326/0003-4819-128-8-199804150-00009 · Cited by 528 · see citing works
A Framework for Collaborative Improvement
Kilo, C. M. (1998) · Quality Management in Health Care · doi:10.1097/00019514-199806040-00001 · Cited by 482 · see citing works
The Link Between Teamwork and Patients’ Outcomes in Intensive Care Units
Wheelan, S. A., Burchill, C. N., & Tilin, F. (2003) · American Journal of Critical Care · doi:10.4037/ajcc2003.12.6.527 · Cited by 323 · see citing works
Creating the Evidence Base for Quality Improvement Collaboratives
Mittman, B. S. (2004) · Annals of Internal Medicine · doi:10.7326/0003-4819-140-11-200406010-00011 · Cited by 279 · see citing works
What Do Collaborative Improvement Projects Do? Experience from Seven Countries
Wilson, T., Berwick, D. M., & Cleary, P. D. (2003) · The Joint Commission Journal on Quality and Safety · doi:10.1016/s1549-3741(03)29011-0 · Cited by 210 · see citing works
Improving Care Through Collaboration
Kilo, C. M. (1999) · PEDIATRICS · doi:10.1542/peds.103.se1.384 · Cited by 139 · see citing works
Thomas, N. (2013) · Journal of Renal Care · doi:10.1111/j.1755-6686.2013.12030.x · Cited by 116 · see citing works
Gezondheidsvoorlichting en gedragsverandering
Brug, J., van Assema, P., & Lechner, L. (2000) · Pure Amsterdam UMC · Cited by 103 · see citing works
Collaborating across organizational boundaries to improve the quality of care
Plsek, P. E. (1997) · American Journal of Infection Control · doi:10.1016/s0196-6553(97)90033-x · Cited by 74 · see citing works
Multidisciplinaire richtlijn angststoornissen
Smalbrugge, M. (2004) · Pure Amsterdam UMC · Cited by 74 · see citing works
Priebe, S., Fakhoury, W. K. H., White, I. R., Watts, J., Bebbington, P., Billings, J., Burns, T., Johnson, S., Muijen, M., Ryrie, I., et al. (2004) · The British Journal of Psychiatry · doi:10.1192/bjp.185.4.306 · Cited by 66 · see citing works
Cross‐Functional Team Processes and Patient Functional Improvement
Alexander, J. A., Lichtenstein, R. L., Jinnett, K., Wells, R. S., Zazzali, J. L., & Liu, D. (2005) · Health Services Research · doi:10.1111/j.1475-6773.2005.00418.x · Cited by 63 · see citing works
The Team Climate Inventory: application in hospital teams and methodological considerations
Ouwens, M. M. M. T. J., Hulscher, M., Akkermans, R., Hermens, R., Grol, R. P. T. M., & Wollersheim, H. C. H. (2008) · BMJ Quality & Safety · doi:10.1136/qshc.2006.021543 · Cited by 63 · see citing works
Strating, M. M. H., & Nieboer, A. P. (2009) · BMC Health Services Research · doi:10.1186/1472-6963-9-126 · Cited by 52 · see citing works
(2008) · International Journal of Health Care Quality Assurance · doi:10.1108/ijhcqa.2008.06221gae.001 · Cited by 10 · see citing works
TQM/CQI effectiveness at team and departmental levels
Routhieaux, R. L., & Gutek, B. A. (1998) · Journal of Quality Management · doi:10.1016/s1084-8568(99)80103-5 · Cited by 7 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
Powell, B. J., Waltz, T. J., Chinman, M. J., Damschroder, L. J., Smith, J. L., Matthieu, M. M., Proctor, E. K., & Kirchner, J. E. (2015) · Implementation Science · doi:10.1186/s13012-015-0209-1 · Cited by 4,963 · see citing works
Implementation strategies: recommendations for specifying and reporting
Proctor, E. K., Powell, B. J., & McMillen, J. C. (2013) · Implementation Science · doi:10.1186/1748-5908-8-139 · Cited by 2,585 · see citing works
Systematic review of the Exploration, Preparation, Implementation, Sustainment (EPIS) framework
Moullin, J. C., Dickson, K. S., Stadnick, N. A., Rabin, B., & Aarons, G. A. (2019) · Implementation Science · doi:10.1186/s13012-018-0842-6 · Cited by 1,223 · see citing works
Methods to Improve the Selection and Tailoring of Implementation Strategies
Powell, B. J., Beidas, R. S., Lewis, C. C., Aarons, G. A., McMillen, J. C., Proctor, E. K., & Mandell, D. S. (2017) · The Journal of Behavioral Health Services & Research · doi:10.1007/s11414-015-9475-6 · Cited by 967 · see citing works
Chaudoir, S. R., Dugan, A. G., & Barr, C. H. (2013) · Implementation Science · doi:10.1186/1748-5908-8-22 · Cited by 800 · see citing works
Barrera, M., Berkel, C., & Castro, F. G. (2017) · Prevention Science · doi:10.1007/s11121-016-0705-9 · Cited by 203 · see citing works
Expert recommendations for implementing change (ERIC): protocol for a mixed methods study
Waltz, T. J., Powell, B. J., Chinman, M. J., Smith, J. L., Matthieu, M. M., Proctor, E. K., Damschroder, L. J., & Kirchner, J. E. (2014) · Implementation Science · doi:10.1186/1748-5908-9-39 · Cited by 202 · see citing works
Writing implementation research grant proposals: ten key ingredients
Proctor, E. K., Powell, B. J., Baumann, A. A., Hamilton, A. M., & Santens, R. L. (2012) · Implementation Science · doi:10.1186/1748-5908-7-96 · Cited by 169 · see citing works
Interagency collaborative team model for capacity building to scale-up evidence-based practice
Hurlburt, M., Aarons, G. A., Fettes, D., Willging, C., Gunderson, L., & Chaffin, M. J. (2014) · Children and Youth Services Review · doi:10.1016/j.childyouth.2013.10.005 · Cited by 132 · see citing works
Recommendations for Evaluation of Health Care Improvement Initiatives
Parry, G. J., Carson-Stevens, A., Luff, D. F., McPherson, M. E., & Goldmann, D. A. (2013) · Academic Pediatrics · doi:10.1016/j.acap.2013.04.007 · Cited by 124 · see citing works
Aarons, G. A., Green, A. E., Willging, C. E., Ehrhart, M. G., Roesch, S. C., Hecht, D. B., & Chaffin, M. J. (2014) · Implementation Science · doi:10.1186/s13012-014-0183-z · Cited by 107 · see citing works
Developing interventions to change recycling behaviors: A case study of applying behavioral science
Gainforth, H. L., Sheals, K., Atkins, L., Jackson, R., & Michie, S. (2016) · Applied Environmental Education & Communication · doi:10.1080/1533015x.2016.1241166 · Cited by 68 · see citing works
Lyon, A. R., Wasse, J. K., Ludwig, K., Zachry, M., Bruns, E. J., Unützer, J., & McCauley, E. (2016) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-015-0637-x · Cited by 63 · see citing works
Melville-Richards, L., Rycroft-Malone, J., Burton, C., & Wilkinson, J. (2020) · Evidence & Policy · doi:10.1332/174426419x15623134271106 · Cited by 26 · see citing works
Spoelstra, S. L., Schueller, M., & Sikorskii, A. (2019) · Implementation Science · doi:10.1186/s13012-019-0907-1 · Cited by 21 · see citing works
Cooper, B. R., Hill, L. G., Parker, L., Jenkins, G. J., Shrestha, G., & Funaiole, A. (2022) · Implementation Science Communications · doi:10.1186/s43058-022-00303-4 · Cited by 7 · see citing works
- Authors
- Versteeg, M. H., Laurant, M. G., Franx, G. C., Jacobs, A. J., & Wensing, M. J.
- Affiliations
- Radboud University Medical Center (NL)
- Trimbos Institute (NL)
- Corresponding author
- Laurant, Miranda GH
- Venue
- Implementation Science
- Published
- 2012-01-09
- Volume
- 7
- Issue
- 1
- Pages
- 1-1
- ISSN
- 1748-5908 (ISSN-L)
- PMC
- PMC3313876
- OpenAlex
- W2116775351
- Cited by
- 382
- References
- 24
- Citations by year
- 2026: 2 · 2025: 4 · 2024: 6 · 2023: 9 · 2022: 31 · 2021: 74 · 2020: 25 · 2019: 31 · 2018: 42 · 2017: 47 · 2016: 42 · 2015: 30 · 2014: 15 · 2013: 22 · 2012: 2
- FWCI
- 35.78
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- Implementation Science (publishedVersion, cc-by)
- Europe PMC (PubMed Central) (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Radboud Repository (Radboud University) (submittedVersion)
- Radboud Repository (Radboud University) (submittedVersion, other-oa)
- Funders
- ZonMw
- Trimbos-instituut
- Topics
- Health Sciences › Health Professions › Health Information Management › Healthcare Quality and Management
- Health Sciences › Health Professions › General Health Professions › Health Policy Implementation Science
- Social Sciences › Psychology › Clinical Psychology › Psychiatric care and mental health services
- Keywords
- quality improvement collaborative, mental health services, anxiety disorders, dual diagnosis, schizophrenia, management support, team leadership, patient outcomes, process of care, screening evaluation, guideline implementation
- MeSH terms
- Anxiety Disorders, Clinical Competence, Cooperative Behavior, Humans, Interprofessional Relations, Mental Health Services, National Health Programs, Netherlands, Patient Care Team, Surveys and Questionnaires, Schizophrenia, Program Evaluation, Outcome Assessment, Health Care, Practice Guidelines as Topic, Efficiency, Organizational, Quality Indicators, Health Care, Quality Improvement
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review