Implementation of the CALM intervention for anxiety disorders: a qualitative study
Open accessThe DOI matches its Crossref record; 47 of the 47 references it cites were found in a registry or an index.
Abstract
BACKGROUND: Investigators recently tested the effectiveness of a collaborative-care intervention for anxiety disorders: Coordinated Anxiety Learning and Management(CALM) []) in 17 primary care clinics around the United States. Investigators also conducted a qualitative process evaluation. Key research questions were as follows: (1) What were the facilitators/barriers to implementing CALM? (2) What were the facilitators/barriers to sustaining CALM after the study was completed? METHODS: Key informant interviews were conducted with 47 clinic staff members (18 primary care providers, 13 nurses, 8 clinic administrators, and 8 clinic staff) and 14 study-trained anxiety clinical specialists (ACSs) who coordinated the collaborative care and provided cognitive behavioral therapy. The interviews were semistructured and conducted by phone. Data were content analyzed with line-by-line analyses leading to the development and refinement of themes. RESULTS: Similar themes emerged across stakeholders. Important facilitators to implementation included the perception of "low burden" to implement, provider satisfaction with the intervention, and frequent provider interaction with ACSs. Barriers to implementation included variable provider interest in mental health, high rates of part-time providers in clinics, and high social stressors of lower socioeconomic-status patients interfering with adherence. Key sustainability facilitators were if a clinic had already incorporated collaborative care for another disorder and presence of onsite mental health staff. The main barrier to sustainability was funding for the ACS. CONCLUSIONS: The CALM intervention was relatively easy to incorporate during the effectiveness trial, and satisfaction was generally high. Numerous implementation and sustainability barriers could limit the reach and impact of widespread adoption. Findings should be interpreted with the knowledge that the ACSs in this study were provided and trained by the study. Future research should explore uptake of CALM and similar interventions without the aid of an effectiveness trial.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Three Approaches to Qualitative Content Analysis
Hsieh, H.-F., & Shannon, S. E. (2005) · Qualitative Health Research · doi:10.1177/1049732305276687 · Cited by 44,601
Rogers, E. M., Singhal, A., & Quinlan, M. M. (2019) · An Integrated Approach to Communication Theory and Research · doi:10.4324/9780203710753-35 · Cited by 37,322
Kessler, R. C., Berglund, P., Demler, O., Jin, R., Merikangas, K. R., & Walters, E. E. (2005) · Archives of General Psychiatry · doi:10.1001/archpsyc.62.6.593 · Cited by 20,391
Damschroder, L. J., Aron, D. C., Keith, R. E., Kirsh, S. R., Alexander, J. A., & Lowery, J. C. (2009) · Implementation Science · doi:10.1186/1748-5908-4-50 · Cited by 14,496 · cited 1×
“, the socio-political climate, mandates, and incentives) [21,34,36,40].”
Valente, T. W. (2003) · Genetics in Medicine · doi:10.1097/01.gim.0000061743.67794.c4 · Cited by 13,723
Kessler, R. C., Chiu, W. T., Demler, O., & Walters, E. E. (2005) · Archives of General Psychiatry · doi:10.1001/archpsyc.62.6.617 · Cited by 12,052
Weber, R. (1990) · doi:10.4135/9781412983488 · Cited by 7,750
Diffusion of Innovations in Service Organizations: Systematic Review and Recommendations
GREENHALGH, T., ROBERT, G., MACFARLANE, F., BATE, P., & KYRIAKIDOU, O. (2004) · The Milbank Quarterly · doi:10.1111/j.0887-378x.2004.00325.x · Cited by 7,448 · cited 5×
“, the socio-political climate, mandates, and incentives) [21,34,36,40].”
BackgroundMethodInfluentialAnxiety disorders in primary care: prevalence, impairment, comorbidity, and detection
Kroenke, K., Spitzer, R. L., Williams, J. B. W., Monahan, P. O., & Löwe, B. (2007) · Annals of Internal Medicine · doi:10.7326/0003-4819-146-5-200703060-00004 · Cited by 4,741 · cited 3×
“Most of the treatment sought for anxiety is in primary care, and the most frequent treatment is medication [3,9].”
Background(2005) · Cited by 3,748
Wang, P. S., Lane, M., Olfson, M., Pincus, H. A., Wells, K. B., & Kessler, R. C. (2005) · Archives of General Psychiatry · doi:10.1001/archpsyc.62.6.629 · Cited by 2,695
Diffusion of Innovations, 5th Edition
Rogers, E. M., Simon, 。., & Schuster (2003) · Cited by 2,049
Enabling the implementation of evidence based practice: a conceptual framework.
Kitson, A., Harvey, G., & McCormack, B. (1998) · Quality in Health Care · doi:10.1136/qshc.7.3.149 · Cited by 1,985
Collaborative Care for Depression: A Cumulative Meta-analysis and Review of Longer-term Outcomes
Gilbody, S. (2006) · Archives of Internal Medicine · doi:10.1001/archinte.166.21.2314 · Cited by 1,340 · cited 1×
“While most of the research and implementation work in the field thus far has concerned itself with collaborative care for depression [13-15], a growing literature supports collaborative-care interventions for panic disorder [16,17] and for both panic disorder and generalized anxiety disorder [18].”
The economic burden of anxiety disorders in the 1990s
Greenberg, P. E., Sisitsky, T., Kessler, R. C., Finkelstein, S. N., Berndt, E. R., Davidson, J. R. T., Ballenger, J. C., & Fyer, A. J. (1999) · The Journal of Clinical Psychiatry · doi:10.4088/jcp.v60n0702 · Cited by 1,242 · cited 1×
“Individuals with anxiety disorders suffer significant impairment and reduced quality of life [3-5], and they are costly to healthcare systems and economies in general due to high use of healthcare and reduced productivity [6-8].”
BackgroundThe role of formative evaluation in implementation research and the QUERI experience
Stetler, C. B., Legro, M. W., Wallace, C. M., Bowman, C., Guihan, M., Hagedorn, H., Kimmel, B., Sharp, N. D., & Smith, J. L. (2006) · Journal of General Internal Medicine · doi:10.1007/s11606-006-0267-9 · Cited by 642 · cited 1×
“[28] refer to as “developmental formative evaluation”, that is, context-specific “diagnostic” evaluation of barriers and facilitators to implementation, which leverages the experiences and lessons learned in effectiveness trials to enhance the development of wider implementation and dissemination interventions.”
BackgroundImproving Patient Care: The Implementation of Change in Clinical Practice
Cosby, J. L. (2006) · Quality and Safety in Health Care · doi:10.1136/qshc.2005.016824 · Cited by 557
Improving Patient Care: The Implementation of Change in Clinical Practice
Grol, R. P. T. M., Wensing, M., Eccles, M., Davis, D., & Wensign, M. (2005) · Cited by 553
Aarons, G. A., & Sawitzky, A. C. (2006) · Psychological Services · doi:10.1037/1541-1559.3.1.61 · Cited by 482
Roy-Byrne, P., Craske, M. G., Sullivan, G., Rose, R. D., Edlund, M. J., Lang, A. J., Bystritsky, A., Welch, S. S., Chavira, D. A., Golinelli, D., et al. (2010) · JAMA · doi:10.1001/jama.2010.608 · Cited by 452 · cited 2×
“As noted above, results from this study have been recently published demonstrating CALM’s clinical effectiveness [20].”
BackgroundResultSelf-citationStrine, T. W., Mokdad, A. H., Balluz, L. S., Gonzalez, O., Crider, R. A., Berry, J. T., & Kroenke, K. (2008) · Psychiatric Services · doi:10.1176/appi.ps.59.12.1383 · Cited by 408
Mendel, P., Meredith, L. S., Schoenbaum, M., Sherbourne, C. D., & Wells, K. B. (2008) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-007-0144-9 · Cited by 407
Self-citationThe epidemiology of generalized anxiety disorder
Kessler, R. C., Keller, M. B., & Wittchen, H.-U. (2001) · Psychiatric Clinics of North America · doi:10.1016/s0193-953x(05)70204-5 · Cited by 337 · cited 1×
“Individuals with anxiety disorders suffer significant impairment and reduced quality of life [3-5], and they are costly to healthcare systems and economies in general due to high use of healthcare and reduced productivity [6-8].”
BackgroundRoy-Byrne, P. P., Craske, M. G., Stein, M. B., Sullivan, G., Bystritsky, A., Katon, W., Golinelli, D., & Sherbourne, C. D. (2005) · Archives of General Psychiatry · doi:10.1001/archpsyc.62.3.290 · Cited by 314
Self-citationIntegrating mental health into primary care within the Veterans Health Administration.
Post, E. P., Metzger, M., Dumas, P., & Lehmann, L. (2010) · Families, Systems, & Health · doi:10.1037/a0020130 · Cited by 167
Roy-Byrne, P. P., Katon, W., Cowley, D. S., & Russo, J. (2001) · Archives of General Psychiatry · doi:10.1001/archpsyc.58.9.869 · Cited by 158 · cited 1×
“While most of the research and implementation work in the field thus far has concerned itself with collaborative care for depression [13-15], a growing literature supports collaborative-care interventions for panic disorder [16,17] and for both panic disorder and generalized anxiety disorder [18].”
BackgroundSelf-citationThe Role of Clinical Opinion Leaders in Guideline Implementation and Quality Improvement
Borbas, C., Morris, N., McLaughlin, B., ASINGER, R. W., & Gobel, F. L. (2000) · CHEST Journal · doi:10.1378/chest.118.2_suppl.24s · Cited by 142
Quality of Life and Anxiety Disorders: A Population Study
Cramer, V., Torgersen, S., & Kringlen, E. (2005) · Journal of Nervous & Mental Disease · doi:10.1097/01.nmd.0000154836.22687.13 · Cited by 128
Brunette, M. F., Asher, D., Whitley, R., Lutz, W. J., Wieder, B. L., Jones, A. M., & McHugo, G. J. (2008) · Psychiatric Services · doi:10.1176/appi.ps.59.9.989 · Cited by 122
Sullivan, G., Craske, M. G., Sherbourne, C. D., Edlund, M. J., Rose, R. D., Golinelli, D., Chavira, D. A., Bystritsky, A., Stein, M. B., & Roy‐Byrne, P. (2007) · General Hospital Psychiatry · doi:10.1016/j.genhosppsych.2007.04.005 · Cited by 116
Self-citationA process for developing an implementation intervention: QUERI Series
Curran, G. M., Mukherjee, S., Allee, E., & Owen, R. R. (2008) · Implementation Science · doi:10.1186/1748-5908-3-17 · Cited by 110
Self-citationPalinkas, L. A., Schoenwald, S. K., Hoagwood, K., Landsverk, J., Chorpita, B. F., & Weisz, J. R. (2008) · Psychiatric Services · doi:10.1176/appi.ps.59.7.738 · Cited by 110
Parker, L. E., Kirchner, J. E., Bonner, L. M., Fickel, J. J., Ritchie, M. J., Simons, C. E., & Yano, E. M. (2009) · Qualitative Health Research · doi:10.1177/1049732308329481 · Cited by 71 · cited 1×
“Organizing the analyses around these top-level codes [35] improved the “usability” of the information and allowed the data to be blended easily with other reports documenting implementation barriers/facilitators for major mental health initiatives.”
MethodFunctioning and disability levels in primary care out-patients with one or more anxiety disorders
Sherbourne, C. D., Sullivan, G., Craske, M. G., Roy-Byrne, P., Golinelli, D., Rose, R. D., Chavira, D. A., Bystritsky, A., & Stein, M. B. (2010) · Psychological Medicine · doi:10.1017/s0033291710000176 · Cited by 70 · cited 1×
“Individuals with anxiety disorders suffer significant impairment and reduced quality of life [3-5], and they are costly to healthcare systems and economies in general due to high use of healthcare and reduced productivity [6-8].”
BackgroundSelf-citationLuck, J., Hagigi, F., Parker, L. E., Yano, E. M., Rubenstein, L. V., & Kirchner, J. E. (2009) · Implementation Science · doi:10.1186/1748-5908-4-64 · Cited by 66
Developing a national dissemination plan for collaborative care for depression: QUERI Series
Smith, J. L., Williams, J. W., Owen, R. R., Rubenstein, L. V., & Chaney, E. (2008) · Implementation Science · doi:10.1186/1748-5908-3-59 · Cited by 66
Tai, B., Straus, M. M., Liu, D., Sparenborg, S., Jackson, R., & McCarty, D. (2010) · Journal of Substance Abuse Treatment · doi:10.1016/j.jsat.2010.01.011 · Cited by 64
Undertreatment of panic disorder in primary care: role of patient and physician characteristics.
Roy‐Byrne, P., Russo, J. E., Dugdale, D. C., Lessler, D. S., Cowley, D. S., & Katon, W. J. (2002) · PubMed · Cited by 54
Self-citationMartino, S., Brigham, G. S., Higgins, C., Gallon, S., Freese, T. E., Albright, L. M., Hulsey, E. G., Krom, L., Storti, S. A., Perl, H. I., et al. (2010) · Journal of Substance Abuse Treatment · doi:10.1016/j.jsat.2009.12.013 · Cited by 51
Collaborative care for mood disorders
Simon, G. (2009) · Current Opinion in Psychiatry · doi:10.1097/yco.0b013e328313e3f0 · Cited by 47
Funding mechanisms for depression care management: opportunities and challenges
Bachman, J. W., Pincus, H. A., Houtsinger, J. K., & Unützer, J. (2006) · General Hospital Psychiatry · doi:10.1016/j.genhosppsych.2006.03.006 · Cited by 47
Curran, G. M., Thrush, C. R., Smith, J. L., Owen, R. R., Ritchie, M. J., & Chadwick, D. (2005) · The Joint Commission Journal on Quality and Patient Safety · doi:10.1016/s1553-7250(05)31091-9 · Cited by 45
Self-citationBray, P., Cummings, D. M., Wolf, M., Massing, M. W., & Reaves, J. (2009) · The Joint Commission Journal on Quality and Patient Safety · doi:10.1016/s1553-7250(09)35069-2 · Cited by 41 · cited 1×
“Most of the barriers and facilitators were similar to those noted for depression collaborative care and perhaps other collaborative-care interventions in other non-mental health conditions [15,41].”
BackgroundRollman, B. L., Belnap, B. H., Reynolds, C. F., Schulberg, H. C., & Shear, M. K. (2003) · General Hospital Psychiatry · doi:10.1016/s0163-8343(03)00004-5 · Cited by 41
De Jong, F. J., Van Steenbergen-Weijenburg, K. M., Huijbregts, K. M. L., Vlasveld, M. C., Van Marwijk, H. W. J., Beekman, A. T. F., & Van der Feltz-Cornelis, C. M. (2009) · International Journal of Integrated Care · doi:10.5334/ijic.313 · Cited by 36
Steps for Implementing Collaborative Care Programs for Depression
Fortney, J. C., Pyne, J. M., Smith, J. L., Curran, G. M., Otero, J. M., Enderle, M. A., & McDougall, S. (2009) · Population Health Management · doi:10.1089/pop.2008.0023 · Cited by 32
Self-citationDiagnose depressie niet zo betrouwbaar te stellen
Terluin, B., van Hout, H. P. J., van Marwijk, H., Adèr, H. J., van der Meer, K., de Haan, M., & van Dyck, R. (2004) · Huisarts en Wetenschap · doi:10.1007/bf03084039 · Cited by 22
Cited by
Local opinion leaders: effects on professional practice and health care outcomes
Flodgren, G., Parmelli, E., Doumit, G., Gattellari, M., O'Brien, M. A., Grimshaw, J., & Eccles, M. P. (2011) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd000125.pub4 · Cited by 1,070
Enhancing the Impact of Implementation Strategies in Healthcare: A Research Agenda
Powell, B. J., Fernandez, M. E., Williams, N. J., Aarons, G. A., Beidas, R. S., Lewis, C. C., McHugh, S. M., & Weiner, B. J. (2019) · Frontiers in Public Health · doi:10.3389/fpubh.2019.00003 · Cited by 775
An introduction to effectiveness-implementation hybrid designs
Landes, S. J., McBain, S. A., & Curran, G. M. (2019) · Psychiatry Research · doi:10.1016/j.psychres.2019.112513 · Cited by 516
Self-citationUsing Measurement-Based Care to Enhance Any Treatment
Scott, K., & Lewis, C. C. (2015) · Cognitive and Behavioral Practice · doi:10.1016/j.cbpra.2014.01.010 · Cited by 461
Cane, J., Richardson, M., Johnston, M., Ladha, R., & Michie, S. (2015) · British Journal of Health Psychology · doi:10.1111/bjhp.12102 · Cited by 376
Metadata
- Authors
- Curran, G. M., Sullivan, G., Mendel, P., Craske, M. G., Sherbourne, C. D., Stein, M. B., McDaniel, A., & Roy-Byrne, P.
- Venue
- Implementation Science
- Published
- 2012-03-09
- Volume
- 7
- Issue
- 1
- Pages
- 1-11
- ISSN
- 1748-5908 (ISSN-L)
- OpenAlex
- W2002452699
- Cited by
- 348
- References
- 47
- FWCI
- 41.10
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.