CoChat
Sign Up
Cited by 38

The DOI matches its Crossref record; 7 of the 7 references it cites were found in a registry or an index.

Implementing for Sustainability: Promoting Use of a Measurement Feedback System for Innovation and Quality Improvement

Douglas, Susan, Button, Suzanne, Casey, Susan E.·2016·Administration and Policy in Mental Health and Mental Health Services Research
DOI 10.1007/s10488-014-0607-8
Open this paper in CoChat — free account

Abstract

Measurement feedback systems (MFSs) are increasingly recognized as evidence-based treatments for improving mental health outcomes, in addition to being a useful administrative tool for service planning and reporting. Promising research findings have driven practice administrators and policymakers to emphasize the incorporation of outcomes monitoring into electronic health systems. To promote MFS integrity and protect against potentially negative outcomes, it is vital that adoption and implementation be guided by scientifically rigorous yet practical principles. In this point of view, the authors discuss and provide examples of three user-centered and theory-based principles: emphasizing integration with clinical values and workflow, promoting administrative leadership with the 'golden thread' of data-informed decision-making, and facilitating sustainability by encouraging innovation. In our experience, enacting these principles serves to promote sustainable implementation of MFSs in the community while also allowing innovation to occur, which can inform improvements to guide future MFS research.

Overview

Integrity signals

Registry

Crossref · 10.1007/s10488-014-0607-8

Cites

7 of 7 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Verification

Claims the paper makes

This paper’s full text isn’t openly available, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • Traditionally, psychotherapists have been reluctant about or even critical of implementing measures on a routine basis.

    “Traditionally, psychotherapists have been reluctant about or even critical of implementing measures on a routine basis (Boswell et al., 2015;de Jong, 2016;Douglas et al., 2016).”

    From Data-Informed Case Formulation with the Trier Treatment Navigator (2022) · cites this paper as Douglas et al., 2016

Citations

Cites

Flagged first, then by citations

Research works printed but not linked: 39

  1. Amble, I., Gude, T., Stubdal, S., Just Andersen, B., & Wampold, B. E. (2014). The effect of implementing the Outcome Questionnaire-45.2 feedback system in Norway: A multisite randomized clinical trial in a naturalistic setting. Psychotherapy Research, 7, 1–9. doi: 10.1080/10503307.2014.928756 . · DOI
  2. Bickman, L. (2008). A measurement feedback system (MFS) is necessary to improve mental health outcomes. Journal of the American Association of Child and Adolescent Psychiatry, 47, 1114–1119. doi: 10.1097/CHI.0b013e3181825af8 . · DOI
  3. Bickman, L., Douglas Kelley, S., & Athay, M. (2012). The technology of measurement feedback systems. Journal of Couple and Family Psychology: Research and Practice, 1(4), 274–284. · DOI
  4. Bickman, L., Douglas, S., Vides de Andrade, A. R., Tomlinson, M., Gleacher, A., & Olin, S. (2014). Implementing a measurement feedback system: A tale of two sites. Manuscript under review.
  5. Boswell, J. F., Kraus, D. R., Miller, S. D., & Lambert, M. J. (2013). Implementing routine outcome monitoring in clinical practice: Benefits, challenges, and solutions. Psychotherapy research, 26, 1–14. doi: 10.1080/10503307.2013.817696 . · DOI · Paper page
  6. Carlier, I. V., Meuldijk, D., Van Vliet, I. M., Van Fenema, E., Van der Wee, N., & Zitman, F. G. (2012). Routine outcome monitoring and feedback on physical or mental health status: Evidence and theory. Journal of Evaluation in Clinical Practice, 18, 104–110. doi: 10.1111/j.1365-2753.2010.01543.x . · DOI
  7. Chorpita, B. F., Bernstein, A. D., Daleiden, E. L., & The Research Network on Youth Mental Health. (2008). Driving with roadmaps and dashboards: Using information resources to structure the decision models in service organizations. Administration and Policy in Mental Health and Mental Health Services Research, 35, 114–123. · DOI
  8. De Leon, P. H., & Pachter, W. S. (2010). Children’s mental health care: A surprisingly steady evolution. Administration and Policy in Mental Health and Mental Health Services Research, 37, 149–153. · DOI
  9. Dorsey, S., Pullmann, M. D., Deblinger, E., Berliner, L., Kerns, S. E., Thompson, K., et al. (2013). Improving practice in community-based settings: A randomized trial of supervision—study protocol. Implementation Science, 8, 89. doi: 10.1186/1748-5908-8-89 . · DOI · Paper page
  10. Douglas Kelley, S., & Bickman, L. (2009). Beyond outcomes monitoring: Measurement feedback systems in child and adolescent clinical practice. Current Opinion in Psychiatry, 22, 363–368. doi: 10.1097/YCO.0b013e32832c9162 . · DOI
  11. Duncan, E. A. S., & Murray, J. (2012). The barriers and facilitators to routine outcome measurement by allied health professionals in practice: A systematic review. BMC Health Services Research, 12, 96. doi: 10.1186/1472-6963-12-96 . · DOI
  12. Evans, C. (2012). Cautionary notes on power steering for psychotherapy. Canadian Psychology/Psychologie Canadienne, 53(2), 131–139. doi: 10.1037/a0027951 . · DOI
  13. Fitzpatrick, M. (2012). Blurring practice–research boundaries using progress monitoring: A personal introduction to this issue of Canadian psychology. Canadian Psychology/Psychologie Canadienne, 53(2), 75–81. doi: 10.1037/a0028051 . · DOI
  14. Fixsen, D. L., Naoom, S. F., Blase, K. A., Friedman, R. M., & Wallace, F. (2005). Implementation research: A synthesis of the literature. Tampa, FL: University of South Florida, Louis de la Parte Florida Mental Health Institute National Implementation Research Network (FMHI Publication #231).
  15. Goodman, J. D., McKay, J. R., & DePhilippis, D. (2013). Progress monitoring in mental health and addiction treatment: A means of improving care. Professional Psychology: Research and Practice, 44(4), 231–246. · DOI
  16. Gresham, F. M. (2014). Measuring and analyzing treatment integrity data in research. In L. M. Hagermoser Sanetti & T. R. Kratochwill (Eds.), Treatment integrity: A foundation for evidence-based practice in applied psychology (pp. 109–130). Washington, DC: American Psychological Association. · DOI
  17. Hall, C. L., Taylor, J., Moldavsky, M., Marriott, M., Pass, S., Newell, K., et al. (2014). A qualitative process evaluation of electronic session-by-session outcome measurement in child and adolescent mental health services. BMC Psychiatry, 14, 113. doi: 10.1186/1471-244X-14-113 . · DOI
  18. Harmon, S. C., Lambert, M. J., Smart, D. M., Hawkins, E., Neilson, S. L., Slade, K., et al. (2007). Enhancing outcome for potential treatment failures: Therapist-client feedback and clinical support tools. Psychotherapy Research, 17(4), 379–392. · DOI
  19. Institute of Medicine. (2001). Crossing the quality chasm: A new health system for the 21st century. Washington, DC: National Academy Press.
  20. Kazdin, A. E. (2008). Evidence-based treatment and practice: New opportunities to bridge clinical research and practice, enhance the knowledge base, and improve patient care. American Psychologist, 63(3), 146–159. · DOI · Paper page
  21. Kluger, A. N., & DeNisi, A. (1996). The effects of feedback interventions on performance: A historical review, a meta-analysis, and a preliminary feedback intervention theory. Psychological Bulletin, 119, 254–284. · DOI · Paper page
  22. Lambert, M. J., Hansen, N. B., & Finch, A. E. (2001). Patient-focused research: Using patient outcome data to enhance treatment effects. Journal of Consulting and Clinical Psychology, 69(2), 159–172. · DOI
  23. Lambert, M. J., Harmon, C., Slade, K., Whipple, J. K., & Hawkins, E. J. (2005). Providing feedback to psychotherapists on their patients’ progress: Clinical results and practice suggestions. Journal of Clinical Psychology, 61(2), 165–174. · DOI
  24. Lambert, M. J., & Hawkins, E. J. (2001). Using information about patient progress in supervision: Are outcomes enhanced? Australian Psychologist, 36(2), 131–138. · DOI
  25. Marriott, L. K., Nelson, D. A., Allen, S., Calhoun, K., Eldredge, C. E., Kimminau, K. S., et al. (2012). Using health information technology to engage communities in health, education, and research. Science Translational Medicine, 4(119), 119mr1. · DOI
  26. Morten, G., Anker, M. G., Duncan, B. L., & Sparks, J. A. (2009). Using client feedback to improve couple therapy outcomes: A randomized clinical trial in a naturalistic setting. Journal of Consulting and Clinical Psychology, 77, 693–704. doi: 10.1037/a0016062 . · DOI
  27. Noell, G. H., & Gansle, K. A. (2014). The use of performance feedback to improve intervention implementation in schools. In L. M. Hagermoser Sanetti & T. R. Kratochwill (Eds.), Treatment integrity: A foundation for evidence-based practice in applied psychology (pp. 161–184). Washington, DC: American Psychological Association. · DOI
  28. Reay, W. E. (2013). Comment to Garland: “With a little help from my friends”. Administration and Policy in Mental Health and Mental Health Services Research, 40, 39–41. · DOI
  29. Riemer, M., & Bickman, L. (2011). Using program theory to link social psychology and program evaluation. In M. M. Mark, S. I. Donaldson, & B. Campbell (Eds.), Social psychology and program/policy evaluation. New York: Guilford.
  30. Riemer, M., Douglas Kelley, S., Casey, S., & Taylor Haynes, K. (2012). Developing effective research-practice partnerships for creating a culture of evidence-based decision making. Administration and Policy in Mental Health and Mental Health Services Research, 39(4), 248–257. Special Issue: Research Practice Partnerships. · DOI
  31. Riemer, M., Rosof-Williams, J., & Bickman, L. (2005). Theories related to changing clinician practice. Child and Adolescent Psychiatric Clinics of North America, 14, 241–254. doi: 10.1016/j.chc.2004.05.002 . viii. · DOI
  32. Sapyta, J., Riemer, M., & Bickman, L. (2005). Feedback to clinicians: Theory, research and practice. Journal of Clinical Psychology, 61, 145–153. doi: 10.1002/jclp.20107 . · DOI
  33. Sexton, T. S., & Douglas Kelley, S. (2010). Finding the common core: Evidence-based practices, clinically relevant evidence, and mechanisms of change. Administration and Policy in Mental Health and Mental Health Services Research, 37(1–2), 81–88. Special Issue: Psychotherapy Practice in Usual Care. · DOI
  34. Sparks, J. A., Kisler, T. S., Adams, J. F., & Blumen, D. G. (2011). Teaching accountability: Using client feedback to train effective family therapists. Journal of Marital and Family Therapy, 37, 452–467. · DOI
  35. Unsworth, G., Cowie, H., & Green, A. (2012). Therapists’ and clients’ perceptions of routine outcome measurement in the NHS: A qualitative study. Counselling and Psychotherapy Research, 12(1), 71–80. doi: 10.1080/14733145.2011.565125 . · DOI
  36. Weisz, J. R., Ng, M. Y., & Bearman, S. K. (2014). Odd couple? Reenvisioning the relation between science and practice in the dissemination-implementation era. Clinical Psychological Science, 2(1), 58–74. doi: 10.1177/2167702613501307 . · DOI
  37. Wolpert, M., Curtis-Tyler, K., & Edbrooke-Childs, J. (2014). A qualitative exploration of patient and clinician views on patient reported outcome measures in child mental health and diabetes services. Administration and Policy in Mental Health and Mental Health Services Research, doi: 10.1007/s10488-014-0586-9 . · DOI
  38. Wolpert, M., Fugard, A. J. B., Deighton, J., & Gorzig, A. (2012). Routine outcomes monitoring as part of children and young people’s Improving Access to Psychological Therapies (CYP IAPT)—improving care or unhelpful burden? Child and Adolescent Mental Health, 17(3), 129–130. · DOI
  39. Worthen, V. E., & Lambert, M. J. (2007). Outcome oriented supervision: Advantages of adding systematic client tracking to supportive consultations. Counseling and Psychotherapy Research, 7(1), 48–53. · DOI

Cited by

Sorted by citations

Metadata

Authors
Douglas, S., Button, S., & Casey, S. E.
Venue
Administration and Policy in Mental Health and Mental Health Services Research
Publisher
Springer Science and Business Media LLC
Published
2014-10-26
Volume
43
Issue
3
Pages
286-291
ISSN
  • 0894-587X
  • 1573-3289
DOI
10.1007/s10488-014-0607-8
Cited by
38
References
7
Language
en
Licence
www.springer.com/tdm (tdm)

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review