Transforming Mental Health Delivery Through Behavioral Economics and Implementation Science: Protocol for Three Exploratory Projects
Open accessPublished version of a preprint
The DOI matches its Crossref record; 128 of the 130 references it cites were found in a registry or an index.
Abstract
BACKGROUND: Efficacious psychiatric treatments are not consistently deployed in community practice, and clinical outcomes are attenuated compared with those achieved in clinical trials. A major focus for mental health services research is to develop effective and cost-effective strategies that increase the use of evidence-based assessment, prevention, and treatment approaches in community settings. OBJECTIVE: The goal of this program of research is to apply insights from behavioral economics and participatory design to advance the science and practice of implementing evidence-based practice (EBP) for individuals with psychiatric disorders across the life span. METHODS: Project 1 (Assisting Depressed Adults in Primary care Treatment [ADAPT]) is patient-focused and leverages decision-making heuristics to compare ways to incentivize adherence to antidepressant medications in the first 6 weeks of treatment among adults newly diagnosed with depression. Project 2 (App for Strengthening Services In Specialized Therapeutic Support [ASSISTS]) is provider-focused and utilizes normative pressure and social status to increase data collection among community mental health workers treating children with autism. Project 3 (Motivating Outpatient Therapists to Implement: Valuing a Team Effort [MOTIVATE]) explores how participatory design can be used to design organizational-level implementation strategies to increase clinician use of EBPs. The projects are supported by a Methods Core that provides expertise in implementation science, behavioral economics, participatory design, measurement, and associated statistical approaches. RESULTS: Enrollment for project ADAPT started in 2018; results are expected in 2020. Enrollment for project ASSISTS will begin in 2019; results are expected in 2021. Enrollment for project MOTIVATE started in 2018; results are expected in 2019. Data collection had begun for ADAPT and MOTIVATE when this protocol was submitted. CONCLUSIONS: This research will advance the science of implementation through efforts to improve implementation strategy design, measurement, and statistical methods. First, we will test and refine approaches to collaboratively design implementation strategies with stakeholders (eg, discrete choice experiments and innovation tournaments). Second, we will refine the measurement of mechanisms related to heuristics used in decision making. Third, we will develop new ways to test mechanisms in multilevel implementation trials. This trifecta, coupled with findings from our 3 exploratory projects, will lead to improvements in our knowledge of what causes successful implementation, what variables moderate and mediate the effects of those causal factors, and how best to leverage this knowledge to increase the quality of care for people with psychiatric disorders. TRIAL REGISTRATION: ClinicalTrials.gov NCT03441399; https://www.clinicaltrials.gov/ct2/show/NCT03441399 (Archived by WebCite at http://www.webcitation.org/74dRbonBD). INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID): DERR1-10.2196/12121.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Statistical Power Analysis for the Behavioral Sciences
Muller, K. (1989) · Technometrics · doi:10.1080/00401706.1989.10488618 · Cited by 99,167
The theory of planned behavior
Ajzen, I. (1991) · Organizational Behavior and Human Decision Processes · doi:10.1016/0749-5978(91)90020-t · Cited by 90,587
Prospect Theory: An Analysis of Decision under Risk
Kahneman, D., & Tversky, A. (1979) · Econometrica · doi:10.2307/1914185 · Cited by 48,524
Self-efficacy: Toward a unifying theory of behavioral change
Bandura, A. (1977) · Psychological Review · doi:10.1037/0033-295x.84.2.191 · Cited by 43,925
The Framing of Decisions and the Psychology of Choice
Tversky, A., & Kahneman, D. (1981) · Science · doi:10.1126/science.7455683 · Cited by 18,497 · cited 2×
“Clinicians likely are influenced in their decision making about which treatment to use and how to use it by heuristics such as availability bias (a case seen recently is particularly salient), hindsight bias (tendency to infer causality from a recent event even if it was not predictable), and status quo bias (the tend…”
BackgroundDamschroder, L. J., Aron, D. C., Keith, R. E., Kirsh, S. R., Alexander, J. A., & Lowery, J. C. (2009) · Implementation Science · doi:10.1186/1748-5908-4-50 · Cited by 14,496
Self-efficacy: Toward a unifying theory of behavioral change
Bandura, A. (1978) · Advances in Behaviour Research and Therapy · doi:10.1016/0146-6402(78)90002-4 · Cited by 10,586
Cohen, J. (1992) · Psychological Bulletin · doi:10.1037//0033-2909.112.1.155 · Cited by 8,771
Proctor, E., Silmere, H., Raghavan, R., Hovmand, P., Aarons, G., Bunger, A., Griffey, R., & Hensley, M. (2011) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-010-0319-7 · Cited by 8,721
Michie, S., Richardson, M., Johnston, M., Abraham, C., Francis, J., Hardeman, W., Eccles, M. P., Cane, J., & Wood, C. E. (2013) · Annals of Behavioral Medicine · doi:10.1007/s12160-013-9486-6 · Cited by 7,629
Diffusion of Innovations in Service Organizations: Systematic Review and Recommendations
GREENHALGH, T., ROBERT, G., MACFARLANE, F., BATE, P., & KYRIAKIDOU, O. (2004) · The Milbank Quarterly · doi:10.1111/j.0887-378x.2004.00325.x · Cited by 7,448 · cited 2×
“Implementation trials almost always are clustered, with patients nested within clinicians and clinicians within organizations [8,9,17].”
BackgroundResultA general multilevel SEM framework for assessing multilevel mediation
Preacher, K. J., Zyphur, M. J., & Zhang, Z. (2010) · Psychological Methods · doi:10.1037/a0020141 · Cited by 3,796 · cited 1×
“This work will build on and extend 2 approaches to test indirect effects in multilevel models—multilevel structural equation modeling [73] and the centered within context with means reintroduced approach [65]—to address 3-level models with mediators, interventions, and randomization at different levels.”
MethodInfluence : science and practice
Cialdini, R. B. (1985) · Cited by 3,581
Advancing a Conceptual Model of Evidence-Based Practice Implementation in Public Service Sectors
Aarons, G. A., Hurlburt, M., & Horwitz, S. M. (2011) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-010-0327-7 · Cited by 3,240 · cited 4×
“Implementation trials almost always are clustered, with patients nested within clinicians and clinicians within organizations [8,9,17].”
BackgroundResultInfluentialO'Donoghue, T., & Rabin, M. (1999) · American Economic Review · doi:10.1257/aer.89.1.103 · Cited by 3,121
Bounded rationality and organizational learning
Simon, H. A. (1991) · Organization Science · doi:10.1287/orsc.2.1.125 · Cited by 3,028
Walker, E. R., McGee, R. E., & Druss, B. G. (2015) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2014.2502 · Cited by 2,976
Psychometric assessment of three newly developed implementation outcome measures
Weiner, B. J., Lewis, C. C., Stanick, C., Powell, B. J., Dorsey, C. N., Clary, A. S., Boynton, M. H., & Halko, H. (2017) · Implementation Science · doi:10.1186/s13012-017-0635-3 · Cited by 2,819
Mediators and Mechanisms of Change in Psychotherapy Research
Kazdin, A. E. (2007) · Annual Review of Clinical Psychology · doi:10.1146/annurev.clinpsy.3.022806.091432 · Cited by 2,504 · cited 1×
“Mechanisms refer to processes that are responsible for change [64]; they can be considered the active ingredients that explain the specific ways in which implementation strategies affect implementation and client outcomes.”
BackgroundBounded Rationality and Organizational Learning
Simon, H. A. (1999) · Reflections: The SoL Journal · doi:10.1162/152417399570142 · Cited by 2,021
Proctor, E. K., Landsverk, J., Aarons, G., Chambers, D., Glisson, C., & Mittman, B. (2009) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-008-0197-4 · Cited by 1,894
Conducting Discrete Choice Experiments to Inform Healthcare Decision Making: A User??s Guide
Lancsar, E., & Louviere, J. (2008) · PharmacoEconomics · doi:10.2165/00019053-200826080-00004 · Cited by 1,707
Experience-weighted Attraction Learning in Normal Form Games
Camerer, C., & Hua Ho, T. (1999) · Econometrica · doi:10.1111/1468-0262.00054 · Cited by 1,487
Managing Clinical Knowledge for Health Care Improvement
Balas, E. A., & Boren, S. A. (2000) · Yearbook of Medical Informatics · doi:10.1055/s-0038-1637943 · Cited by 1,479 · cited 1×
“On average, it takes 17 years for 14% of research to make its way into practice, with the majority of research findings never deployed in the community [10].”
Validation of a Decision Regret Scale
Brehaut, J. C., O'Connor, A. M., Wood, T. J., Hack, T. F., Siminoff, L., Gordon, E., & Feldman-Stewart, D. (2003) · Medical Decision Making · doi:10.1177/0272989x03256005 · Cited by 1,452
Moltu, C., Stefansen, J., Svisdahl, M., & Veseth, M. (2012) · Disability and Rehabilitation · doi:10.3109/09638288.2012.656792 · Cited by 1,247
Management of Children With Autism Spectrum Disorders
Myers, S. M., Johnson, C. P., & the Council on Children With Disabilities (2007) · Pediatrics · doi:10.1542/peds.2007-2362 · Cited by 1,125
Testing Multilevel Mediation Using Hierarchical Linear Models: Problems and Solutions
Zhang, Z., Zyphur, M. J., & Preacher, K. J. (2009) · Organizational Research Methods · doi:10.1177/1094428108327450 · Cited by 1,093
Beidas, R. S., & Kendall, P. C. (2010) · Clinical Psychology: Science and Practice · doi:10.1111/j.1468-2850.2009.01187.x · Cited by 1,085
Self-citationA Randomized Trial of Methods to Help Clinicians Learn Motivational Interviewing.
Miller, W. R., Yahne, C. E., Moyers, T. B., Martinez, J., & Pirritano, M. (2004) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.72.6.1050 · Cited by 1,075
Financial Incentive–Based Approaches for Weight Loss: A Randomized Trial
Volpp, K. G., John, L. K., Troxel, A. B., Norton, L., Fassbender, J., & Loewenstein, G. (2008) · JAMA · doi:10.1001/jama.2008.804 · Cited by 923
Self-citationPatel, V., Chisholm, D., Parikh, R., Charlson, F. J., Degenhardt, L., Dua, T., Ferrari, A. J., Hyman, S., Laxminarayan, R., Levin, C., et al. (2016) · The Lancet · doi:10.1016/s0140-6736(15)00390-6 · Cited by 889 · cited 1×
“Worldwide, psychiatric disorders account for more years lived with disability than any other category of disease [1].”
BackgroundA Randomized, Controlled Trial of Financial Incentives for Smoking Cessation
Volpp, K. G., Troxel, A. B., Pauly, M. V., Glick, H. A., Puig, A., Asch, D. A., Galvin, R., Zhu, J., Wan, F., DeGuzman, J., et al. (2009) · New England Journal of Medicine · doi:10.1056/nejmsa0806819 · Cited by 836
Self-citationFiske, S. (2013) · SAGE Publications Ltd eBooks · doi:10.4135/9781446286395 · Cited by 765
Herschell, A. D., Kolko, D. J., Baumann, B. L., & Davis, A. C. (2010) · Clinical Psychology Review · doi:10.1016/j.cpr.2010.02.005 · Cited by 713
Scherbaum, C. A., & Ferreter, J. M. (2009) · Organizational Research Methods · doi:10.1177/1094428107308906 · Cited by 665
Sholomskas, D. E., Syracuse-Siewert, G., Rounsaville, B. J., Ball, S. A., Nuro, K. F., & Carroll, K. M. (2005) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.73.1.106 · Cited by 628
Lewis, C. C., Klasnja, P., Powell, B. J., Lyon, A. R., Tuzzio, L., Jones, S., Walsh-Bailey, C., & Weiner, B. (2018) · Frontiers in Public Health · doi:10.3389/fpubh.2018.00136 · Cited by 588
Asymmetric Paternalism to Improve Health Behaviors
Loewenstein, G., Brennan, T., & Volpp, K. G. (2007) · JAMA · doi:10.1001/jama.298.20.2415 · Cited by 533 · cited 2×
“Behavioral economics research has highlighted that the design and delivery of financial incentives significantly influence effectiveness [91,92].”
BackgroundSelf-citationTreating Depression in Predominantly Low-Income Young Minority Women: A Randomized Controlled Trial
Miranda, J., Chung, J. Y., Green, B. L., Krupnick, J., Siddique, J., Revicki, D. A., & Belin, T. (2003) · JAMA · doi:10.1001/jama.290.1.57 · Cited by 520
The Behavioral Foundations of Public Policy
(2013) · Princeton University Press eBooks · doi:10.2307/j.ctv550cbm · Cited by 502
Ehrhart, M. G., Aarons, G. A., & Farahnak, L. R. (2014) · Implementation Science · doi:10.1186/s13012-014-0157-1 · Cited by 502 · cited 1×
“Implementation science frameworks also posit the importance of organizational factors in explaining implementation success, emphasizing constructs such as organizational culture (the collective sense of how work is done in an organization), organizational climate (the collective sense of how the work environment affec…”
BackgroundAssessing the economic costs of serious mental illness
Insel, T. R. (2008) · American Journal of Psychiatry · doi:10.1176/appi.ajp.2008.08030366 · Cited by 487 · cited 1×
“The risk of premature mortality of people with severe psychiatric disorders is elevated [2], and the annual burden to the US economy is approximately half a trillion dollars, less than half of which is due to the cost of treatment [3].”
BackgroundAarons, G. A., Ehrhart, M. G., Farahnak, L. R., & Sklar, M. (2014) · Annual Review of Public Health · doi:10.1146/annurev-publhealth-032013-182447 · Cited by 474
Evaluation of Comprehensive Treatment Models for Individuals with Autism Spectrum Disorders
Odom, S. L., Boyd, B. A., Hall, L. J., & Hume, K. (2010) · Journal of Autism and Developmental Disorders · doi:10.1007/s10803-009-0825-1 · Cited by 424
Encyclopedia of Statistics in Behavioral Science
(2006) · Reference Reviews · doi:10.1108/09504120610664123 · Cited by 415
Melfi, C. A., Chawla, A. J., Croghan, T. W., Hanna, M. P., Kennedy, S., & Sredl, K. (1998) · Archives of General Psychiatry · doi:10.1001/archpsyc.55.12.1128 · Cited by 409
Early Performance of Accountable Care Organizations in Medicare
McWilliams, J. M., Hatfield, L. A., Chernew, M. E., Landon, B. E., & Schwartz, A. L. (2016) · New England Journal of Medicine · doi:10.1056/nejmsa1600142 · Cited by 400
Continuity of antidepressant treatment for adults with depression in the United States
Olfson, M., Marcus, S. C., Tedeschi, M., & Wan, G. J. (2006) · American Journal of Psychiatry · doi:10.1176/appi.ajp.163.1.101 · Cited by 392
Self-citationRandomized trial of four financial-incentive programs for smoking cessation
Halpern, S. D., French, B., Small, D. S., Saulsgiver, K., Harhay, M. O., Audrain-McGovern, J., Loewenstein, G., Brennan, T. A., Asch, D. A., & Volpp, K. G. (2015) · New England Journal of Medicine · doi:10.1056/nejmoa1414293 · Cited by 379 · cited 2×
“Tangible financial patient rewards have successfully increased a wide range of health behaviors [31,34,81-84], including medication adherence [85-88].”
BackgroundSelf-citationBeidas, R. S., Edmunds, J. M., Marcus, S. C., & Kendall, P. C. (2012) · Psychiatric Services · doi:10.1176/appi.ps.201100401 · Cited by 370
Self-citationPetry, N. M., Peirce, J. M., Stitzer, M. L., Blaine, J., Roll, J. M., Cohen, A., Obert, J., Killeen, T., Saladin, M. E., Cowell, M., et al. (2005) · Archives of General Psychiatry · doi:10.1001/archpsyc.62.10.1148 · Cited by 369
Financial Incentives for Extended Weight Loss: A Randomized, Controlled Trial
John, L. K., Loewenstein, G., Troxel, A. B., Norton, L., Fassbender, J. E., & Volpp, K. G. (2011) · Journal of General Internal Medicine · doi:10.1007/s11606-010-1628-y · Cited by 346 · cited 1×
“Tangible financial patient rewards have successfully increased a wide range of health behaviors [31,34,81-84], including medication adherence [85-88].”
BackgroundSelf-citationHierarchical Linear Models: Applications and Data Analysis Methods
Calvin, J. A., Bryk, A. S., & Raudenbush, S. W. (1994) · Technometrics · doi:10.2307/1269211 · Cited by 325
Innovation Tournaments: Creating and Selecting Exceptional Opportunities
Terwiesch, C., & Ulrich, K. T. (2009) · Cited by 321
Software Process Improvement: Practical Guidelines for Business Success
Zahran, S. (1998) · CERN Document Server (European Organization for Nuclear Research) · Cited by 315
Continuity of Antidepressant Treatment for Adults With Depression in the United States
Ballenger, J. C. (2007) · Yearbook of Psychiatry and Applied Mental Health · doi:10.1016/s0084-3970(08)70480-8 · Cited by 313
Behavioral Design: A New Approach to Development Policy
Datta, S., & Mullainathan, S. (2014) · Review of Income and Wealth · doi:10.1111/roiw.12093 · Cited by 263
A test of financial incentives to improve warfarin adherence
Volpp, K. G., Loewenstein, G., Troxel, A. B., Doshi, J., Price, M., Laskin, M., & Kimmel, S. E. (2008) · BMC Health Services Research · doi:10.1186/1472-6963-8-272 · Cited by 262
Self-citationTiming of Onset of Antidepressant Response With Fluoxetine Treatment
Nierenberg, A. A., Farabaugh, A. H., Alpert, J. E., Gordon, J., Worthington, J. J., Rosenbaum, J. F., & Fava, M. (2000) · American Journal of Psychiatry · doi:10.1176/appi.ajp.157.9.1423 · Cited by 248
Designing Discrete Choice Experiments: Do Optimal Designs Come at a Price?
Louviere, J. J., Islam, T., Wasi, N., Street, D., & Burgess, L. (2008) · Journal of Consumer Research · doi:10.1086/586913 · Cited by 248
Randomized trial of MST and ARC in a two-level evidence-based treatment implementation strategy.
Glisson, C., Schoenwald, S. K., Hemmelgarn, A., Green, P., Dukes, D., Armstrong, K. S., & Chapman, J. E. (2010) · Journal of Consulting and Clinical Psychology · doi:10.1037/a0019160 · Cited by 243 · cited 1×
“Implementation science frameworks also posit the importance of organizational factors in explaining implementation success, emphasizing constructs such as organizational culture (the collective sense of how work is done in an organization), organizational climate (the collective sense of how the work environment affec…”
BackgroundPerformance Differences in Year 1 of Pioneer Accountable Care Organizations
McWilliams, J. M., Chernew, M. E., Landon, B. E., & Schwartz, A. L. (2015) · New England Journal of Medicine · doi:10.1056/nejmsa1414929 · Cited by 240
Williams, N. J., & Beidas, R. S. (2019) · Journal of Child Psychology and Psychiatry · doi:10.1111/jcpp.12960 · Cited by 233
Self-citationRedesigning Employee Health Incentives — Lessons from Behavioral Economics
Volpp, K. G., Asch, D. A., Galvin, R., & Loewenstein, G. (2011) · New England Journal of Medicine · doi:10.1056/nejmp1105966 · Cited by 214
Self-citationIndividual- Versus Group-Based Financial Incentives for Weight Loss: A Randomized, Controlled Trial
Kullgren, J. T., Troxel, A. B., Loewenstein, G., Asch, D. A., Norton, L. A., Wesby, L., Tao, Y., Zhu, J., & Volpp, K. G. (2013) · Annals of Internal Medicine · doi:10.7326/0003-4819-158-7-201304020-00002 · Cited by 203
Self-citationBehavioral Economics Holds Potential To Deliver Better Results For Patients, Insurers, And Employers
Loewenstein, G., Asch, D. A., & Volpp, K. G. (2013) · Health Affairs · doi:10.1377/hlthaff.2012.1163 · Cited by 200
Self-citationAutomated Hovering in Health Care — Watching Over the 5000 Hours
Asch, D. A., Muller, R. W., & Volpp, K. G. (2012) · New England Journal of Medicine · doi:10.1056/nejmp1203869 · Cited by 193 · cited 1×
“Behavioral economists have identified a wide range of patterns in human decision making that may contribute to poor health outcomes as well as methods of designing the environment to optimize optimal decision making [91,92,119-127].”
Self-citationRoles, Responsibilities, and Concerns of Paraeducators: Findings From a Statewide Survey
Fisher, M., & Pleasants, S. L. (2011) · Remedial and Special Education · doi:10.1177/0741932510397762 · Cited by 180
Predictors of Community Therapists’ Use of Therapy Techniques in a Large Public Mental Health System
Beidas, R. S., Marcus, S., Aarons, G. A., Hoagwood, K. E., Schoenwald, S., Evans, A. C., Hurford, M. O., Hadley, T., Barg, F. K., Walsh, L. M., et al. (2015) · JAMA Pediatrics · doi:10.1001/jamapediatrics.2014.3736 · Cited by 177
Self-citationThe economic approach to human behavior
Redman, M. B. (1978) · Journal of Behavioral Economics · doi:10.1016/0090-5720(78)90018-9 · Cited by 169
Asch, D. A., Troxel, A. B., Stewart, W. F., Sequist, T. D., Jones, J. B., Hirsch, A. G., Hoffer, K., Zhu, J., Wang, W., Hodlofski, A., et al. (2015) · JAMA · doi:10.1001/jama.2015.14850 · Cited by 167
Self-citationCantrell, C. R., Eaddy, M. T., Shah, M. B., Regan, T. S., & Sokol, M. C. (2006) · Medical Care · doi:10.1097/01.mlr.0000204287.82701.9b · Cited by 166
Williams, N. J. (2016) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-015-0693-2 · Cited by 164
Self-citationImproving Community-Based Mental Health Care for Children: Translating Knowledge into Action
Garland, A. F., Haine‐Schlagel, R., Brookman-Frazee, L. I., Baker-Ericzén, M. J., Trask, E. V., & Fawley-King, K. (2012) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-012-0450-8 · Cited by 161
Adherence to Antidepressant Treatment Among Privately Insured Patients Diagnosed With Depression
Akincigil, A., Bowblis, J. R., Levin, C., Walkup, J. T., Jan, S., & Crystal, S. (2007) · Medical Care · doi:10.1097/01.mlr.0000254574.23418.f6 · Cited by 160
Advancing the Science of Team Science
Falk‐Krzesinski, H. J., Börner, K., Contractor, N., Fiore, S. M., Hall, K. L., Keyton, J., Spring, B., Stokols, D., Trochim, W., & Uzzi, B. (2010) · Clinical and Translational Science · doi:10.1111/j.1752-8062.2010.00223.x · Cited by 160
P4P4P: An Agenda For Research On Pay-For-Performance For Patients
Volpp, K. G., Pauly, M. V., Loewenstein, G., & Bangsberg, D. (2009) · Health Affairs · doi:10.1377/hlthaff.28.1.206 · Cited by 136
Self-citationPatel, M. S., Day, S. C., Halpern, S. D., Hanson, C. W., Martinez, J. R., Honeywell, S., & Volpp, K. G. (2016) · JAMA Internal Medicine · doi:10.1001/jamainternmed.2016.1691 · Cited by 136
Self-citationCan behavioural economics make us healthier?
Loewenstein, G. F., Asch, D. A., Friedman, J. Y., Melichar, L., & Volpp, K. G. M. (2012) · BMJ · doi:10.1136/bmj.e3482 · Cited by 135
Self-citationReframing the Dissemination Challenge: A Marketing and Distribution Perspective
Kreuter, M. W., & Bernhardt, J. M. (2009) · American Journal of Public Health · doi:10.2105/ajph.2008.155218 · Cited by 125
Beidas, R. S., Stewart, R. E., Adams, D. R., Fernandez, T., Lustbader, S., Powell, B. J., Aarons, G. A., Hoagwood, K. E., Evans, A. C., Hurford, M. O., et al. (2016) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-015-0705-2 · Cited by 122
Self-citationPincus, H. A., Page, A. E. K., Druss, B., Appelbaum, P. S., Gottlieb, G., & England, M. J. (2007) · American Journal of Psychiatry · doi:10.1176/ajp.2007.164.5.712 · Cited by 121
Giles, E. L., Robalino, S., Sniehotta, F. F., Adams, J. M., & McColl, E. (2015) · Preventive Medicine · doi:10.1016/j.ypmed.2014.12.029 · Cited by 111
Randomized trial of lottery-based incentives to improve warfarin adherence
Kimmel, S. E., Troxel, A. B., Loewenstein, G., Brensinger, C. M., Jaskowiak, J., Doshi, J. A., Laskin, M., & Volpp, K. (2012) · American Heart Journal · doi:10.1016/j.ahj.2012.05.005 · Cited by 109
Self-citationGirlanda, F., Fiedler, I., Becker, T., Barbui, C., & Koesters, M. (2017) · British Journal of Psychiatry · doi:10.1192/bjp.bp.115.179093 · Cited by 105
Factors Associated with Use of Evidence-Based Practice Strategies in Usual Care Youth Psychotherapy
Brookman-Frazee, L., Haine, R. A., Baker-Ericzén, M., Zoffness, R., & Garland, A. F. (2010) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-009-0244-9 · Cited by 104
Chambers, D. A., & Azrin, S. T. (2013) · Psychiatric Services · doi:10.1176/appi.ps.201300032 · Cited by 101
The SAGE Handbook of Multilevel Modeling
Scott, M. A., Simonoff, J. S., & Marx, B. (2013) · SAGE Publications Ltd eBooks · doi:10.4135/9781446247600 · Cited by 101
Community–academic partnerships in implementation research
Pellecchia, M., Mandell, D. S., Nuske, H. J., Azad, G., Benjamin Wolk, C., Maddox, B. B., Reisinger, E. M., Skriner, L. C., Adams, D. R., Stewart, R., et al. (2018) · Journal of Community Psychology · doi:10.1002/jcop.21981 · Cited by 89
Self-citationSalloum, R. G., Shenkman, E. A., Louviere, J. J., & Chambers, D. A. (2017) · Implementation Science · doi:10.1186/s13012-017-0675-8 · Cited by 87
Stewart, R. E., Adams, D. R., Mandell, D. S., Hadley, T. R., Evans, A. C., Rubin, R., Erney, J., Neimark, G., Hurford, M. O., & Beidas, R. S. (2016) · Psychiatric Services · doi:10.1176/appi.ps.201500392 · Cited by 86
Self-citationMarcus, A. C., Kaplan, C. P., Crane, L. A., Berek, J. S., Bernstein, G., Gunning, J. E., & McClatchey, M. W. (1998) · Medical Care · doi:10.1097/00005650-199803000-00015 · Cited by 86
Williams, N. J., Glisson, C., Hemmelgarn, A., & Green, P. (2017) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-016-0742-5 · Cited by 86
Self-citationMitchell, V., Ross, T., May, A., Sims, R., & Parker, C. (2016) · CoDesign · doi:10.1080/15710882.2015.1091894 · Cited by 82
Policy to implementation: evidence-based practice in community mental health – study protocol
Beidas, R. S., Aarons, G., Barg, F., Evans, A., Hadley, T., Hoagwood, K., Marcus, S., Schoenwald, S., Walsh, L., & Mandell, D. S. (2013) · Implementation Science · doi:10.1186/1748-5908-8-38 · Cited by 81
Self-citationChapter seven. Behavioral Economics of Organizations
Camerer, C. F., & Malmendier, U. M. (2007) · Princeton University Press eBooks · doi:10.1515/9781400829149-009 · Cited by 79
Commitment contracts as a way to health
Halpern, S. D., Asch, D. A., & Volpp, K. G. (2012) · BMJ · doi:10.1136/bmj.e522 · Cited by 76
Self-citationChoosing Wisely: Low-Value Services, Utilization, and Patient Cost Sharing
Volpp, K. G. M., Loewenstein, G. F., & Asch, D. A. (2012) · JAMA · doi:10.1001/jama.2012.13616 · Cited by 69
Self-citationInnovation as Discipline, Not Fad
Asch, D. A., & Rosin, R. (2015) · New England Journal of Medicine · doi:10.1056/nejmp1506311 · Cited by 69 · cited 1×
“The goal of rapid-cycle prototyping is to test potential innovations more efficiently, less expensively, and more reliably than traditional clinical trials [49].”
BackgroundGarner, B. R., Godley, S. H., Dennis, M. L., Hunter, B. D., Bair, C. M. L., & Godley, M. D. (2012) · Archives of Pediatrics & Adolescent Medicine · doi:10.1001/archpediatrics.2012.802 · Cited by 63
A Synchronized Prescription Refill Program Improved Medication Adherence
Doshi, J. A., Lim, R., Li, P., Young, P., Lawnicki, V. F., State, J. J., Troxel, A. B., & Volpp, K. G. M. (2016) · Health Affairs · doi:10.1377/hlthaff.2015.1456 · Cited by 60
Self-citationGreen, A. E., Albanese, B. J., Cafri, G., & Aarons, G. A. (2014) · Community Mental Health Journal · doi:10.1007/s10597-013-9668-5 · Cited by 58
Demyttenaere, K., Andersen, H. F., & Reines, E. H. (2008) · International Clinical Psychopharmacology · doi:10.1097/yic.0b013e328303ac5f · Cited by 55
Health Behavior Change in Populations
Kahan, S. I. (2014) · Johns Hopkins University Press eBooks · doi:10.56021/9781421414553 · Cited by 55
Monitoring Depression Care: In Search of an Accurate Quality Indicator
Charbonneau, A., Rosen, A. K., Owen, R. R., Spiro, A., Ash, A. S., Miller, D. R., Kazis, L., Kader, B., Cunningham, F., & Berlowitz, D. R. (2004) · Medical Care · doi:10.1097/01.mlr.0000127999.89246.a6 · Cited by 50
Beidas, R. S., Skriner, L. C., Adams, D. R., Wolk, C. B., Stewart, R. E., Becker‐Haimes, E. M., Williams, N. J., Maddox, B. B., Rubin, R. M., Weaver, S., et al. (2017) · Behaviour Research and Therapy · doi:10.1016/j.brat.2017.08.011 · Cited by 46
Self-citationTraining Paraprofessionals to Improve Socialization in Students with ASD
Koegel, R. L., Kim, S. W., & Koegel, L. K. (2014) · Journal of Autism and Developmental Disorders · doi:10.1007/s10803-014-2094-x · Cited by 43
Behavioral Phenotyping in Health Promotion: Embracing or Avoiding Failure
Kangovi, S., & Asch, D. A. (2018) · JAMA · doi:10.1001/jama.2018.2921 · Cited by 39
Young, H. E., Falco, R. A., & Hanita, M. (2015) · Journal of Autism and Developmental Disorders · doi:10.1007/s10803-015-2597-0 · Cited by 38
Predictors of Use of Evidence-Based Practices for Children and Adolescents in Usual Care
Higa-McMillan, C. K., Nakamura, B. J., Morris, A., Jackson, D. S., & Slavin, L. (2015) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-014-0578-9 · Cited by 38 · cited 10×
“Project MOTIVATE employs behavioral design to generate solutions to improve the implementation of EBPs in community mental health settings.”
BackgroundInfluentialMeléndez‐Torres, G. J., Dickson, K., Fletcher, A., Thomas, J., Hinds, K., Campbell, R. M., Murphy, S., & Bonell, C. P. (2016) · Journal of Epidemiology & Community Health · doi:10.1136/jech-2015-206132 · Cited by 38
Palinkas, L. A., Um, M. Y., Jeong, C. H., Chor, K. H. B., Olin, S., Horwitz, S. M., & Hoagwood, K. E. (2017) · Health Research Policy and Systems · doi:10.1186/s12961-017-0190-z · Cited by 36
Locke, J., Wolk, C. B., Harker, C., Olsen, A., Shingledecker, T., Barg, F., Mandell, D., & Beidas, R. (2017) · Autism · doi:10.1177/1362361316664474 · Cited by 35
Self-citationCan We Pay for Performance in Behavioral Health Care?
Stewart, R. E., Lareef, I., Hadley, T. R., & Mandell, D. S. (2016) · Psychiatric Services · doi:10.1176/appi.ps.201600475 · Cited by 35
Self-citationReinforcing Adherence to Antihypertensive Medications
Petry, N. M., Alessi, S. M., Byrne, S. A., & White, W. B. (2014) · Journal of Clinical Hypertension · doi:10.1111/jch.12441 · Cited by 33
Stein, B. D., Celedonia, K. L., Kogan, J. N., Swartz, H. A., & Frank, E. (2013) · Psychiatric Services · doi:10.1176/appi.ps.201200508 · Cited by 29
Innovating in health delivery: The Penn medicine innovation tournament
Terwiesch, C., Mehta, S. J., & Volpp, K. G. M. (2013) · Healthcare · doi:10.1016/j.hjdsi.2013.05.003 · Cited by 26
Self-citationCounselor Incentives to Improve Client Retention in an Outpatient Substance Abuse Aftercare Program
Shepard, D. S., Calabro, J. A. B., Love, C. T., McKay, J. R., Tetreault, J., & Yeom, H. S. (2006) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-006-0054-2 · Cited by 25
One-to-One Assistant Engagement in Autism Support Classrooms
Azad, G. F., Locke, J. J., Downey, M. M., Xie, M., & Mandell, D. S. (2015) · Teacher Education and Special Education The Journal of the Teacher Education Division of the Council for Exceptional Children · doi:10.1177/0888406415603208 · Cited by 24
Self-citationWolk, C. B., Marcus, S. C., Weersing, V. R., Hawley, K. M., Evans, A. C., Hurford, M. O., & Beidas, R. S. (2016) · Psychiatric Services · doi:10.1176/appi.ps.201500022 · Cited by 24
Self-citationThe impact of pay-for-performance on therapists' intentions to deliver high-quality treatment
Garner, B. R., Godley, S. H., & Bair, C. M. L. (2011) · Journal of Substance Abuse Treatment · doi:10.1016/j.jsat.2011.01.012 · Cited by 22
Performance in Year 1 of Pioneer Accountable Care Organizations
Weeks, W. B., Greene, R. A., & Weinstein, J. N. (2015) · New England Journal of Medicine · doi:10.1056/nejmc1507320 · Cited by 20
Assessing Value in Health Care Programs
Volpp, K. G. M., Loewenstein, G. F., & Asch, D. A. (2012) · JAMA · doi:10.1001/jama.2012.3619 · Cited by 19
Self-citationFinancing changes and their impact on the organization of the public mental health system
Hadley, T. R. (1996) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/bf02112900 · Cited by 16
Acevedo, A., Lee, M. T., Garnick, D. W., Horgan, C. M., Ritter, G. A., Panas, L., Campbell, K. M., & Bean-Mortinson, J. (2017) · Drug and Alcohol Dependence · doi:10.1016/j.drugalcdep.2017.11.009 · Cited by 16
Variation in outpatient mental health service utilization under capitation.
Chou, A. F., Wallace, N., Bloom, J. R., & Hu, T.-W. (2005) · PubMed · Cited by 11
ISPOR’s Initiative on US Value Assessment Frameworks: An Industry Perspective
Burkholder, R., Dougherty, J. S., & Neves, L. A. (2018) · Value in Health · doi:10.1016/j.jval.2017.12.001 · Cited by 8
Research works printed but not linked: 3
- Balas, EA, 2000, Yearb Med Inform, 65
- Tantia, P, 2017, Stanford Social Innovation Review, 15, 29
- Chou, AF, 2005, J Ment Health Policy Econ, 8, 3
Cited by
Wu, A., Scult, M. A., Barnes, E. D., Betancourt, J. A., Falk, A., & Gunning, F. M. (2021) · npj Digital Medicine · doi:10.1038/s41746-021-00386-8 · Cited by 161
Beidas, R. S., Ahmedani, B. K., Linn, K. A., Marcus, S. C., Johnson, C., Maye, M. P., Westphal, J. A., Wright, L., Beck, A. L., Buttenheim, A. M., et al. (2021) · Implementation Science · doi:10.1186/s13012-021-01154-8 · Cited by 41
Self-citationDigital health should augment (not replace) autism treatment providers
Nuske, H. J., & Mandell, D. S. (2021) · Autism · doi:10.1177/13623613211043368 · Cited by 34
Self-citationEstimating Downstream Budget Impacts in Implementation Research
Wagner, T. H., Dopp, A. R., & Gold, H. T. (2020) · Medical Decision Making · doi:10.1177/0272989x20954387 · Cited by 24
Applying concepts from “rapid” and “agile” implementation to advance implementation research
Quanbeck, A., Garza, R. H., & Park, L. (2022) · Implementation Science Communications · doi:10.1186/s43058-022-00366-3 · Cited by 23
Metadata
- Authors
- Beidas, R. S., Volpp, K. G., Buttenheim, A. N., Marcus, S. C., Olfson, M., Pellecchia, M., Stewart, R. E., Williams, N. J., Becker-Haimes, E. M., Candon, M., Cidav, Z., Fishman, J., Lieberman, A., Zentgraf, K., & Mandell, D.
- Affiliations
- Leonard Davis Institute of Health Economics (US)
- Philadelphia VA Medical Center (US)
- University of Pennsylvania (US)
- Columbia University (US)
- Boise State University (US)
- Corresponding author
- Beidas, Rinad S
- ORCID
- Venue
- JMIR Research Protocols
- Publisher
- JMIR Publications Inc.
- Published
- 2019-02-12
- Volume
- 8
- Issue
- 2
- Pages
- e12121
- ISSN
- 1929-0748 (ISSN-L)
- PMC
- PMC6390186
- OpenAlex
- W2897627697
- Cited by
- 28
- References
- 130
- Citations by year
- 2026: 1 · 2025: 1 · 2024: 3 · 2023: 6 · 2022: 5 · 2021: 8 · 2020: 4
- FWCI
- 4.58
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by
- Locations
- JMIR Research Protocols (publishedVersion, cc-by)
- Europe PMC (PubMed Central) (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- Funders
- University of Pennsylvania (P50 MH113840)
- National Institute of Mental Health (P50MH113840)
- Topics
- Health Sciences › Health Professions › General Health Professions › Health Policy Implementation Science
- Health Sciences › Medicine › Psychiatry and Mental health › Mental Health Treatment and Access
- Social Sciences › Psychology › Clinical Psychology › Psychiatric care and mental health services
- Keywords
- implementation science, behavioral economics, evidence-based practice, depression, antidepressant adherence, primary care, heuristic decision making, incentives, autism spectrum disorder, community mental health workers, data collection, normative pressure, social status, participatory design, discrete choice experiment, innovation competition, implementation mechanisms, mental health service delivery, children and adolescents
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.