A strategy for optimizing and evaluating behavioral interventions
Abstract
BACKGROUND: Although the optimization of behavioral interventions offers the potential of both public health and research benefits, currently there is no widely agreed-upon principled procedure for accomplishing this. PURPOSE: This article suggests a multiphase optimization strategy (MOST) for achieving the dual goals of program optimization and program evaluation in the behavioral intervention field. METHODS: MOST consists of the following three phases: (a) screening, in which randomized experimentation closely guided by theory is used to assess an array of program and/or delivery components and select the components that merit further investigation; (b) refining, in which interactions among the identified set of components and their interrelationships with covariates are investigated in detail, again via randomized experiments, and optimal dosage levels and combinations of components are identified; and (c) confirming, in which the resulting optimized intervention is evaluated by means of a standard randomized intervention trial. To make the best use of available resources, MOST relies on design and analysis tools that help maximize efficiency, such as fractional factorials. RESULTS: A slightly modified version of an actual application of MOST to develop a smoking cessation intervention is used to develop and present the ideas. CONCLUSIONS: MOST has the potential to husband program development resources while increasing our understanding of the individual program and delivery components that make up interventions. Considerations, challenges, open questions, and other potential benefits are discussed.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Randomized controlled trials can estimate the combined causal impact of enhancement strategies, yet they are not efficient for testing each strategy separately.
“This approach enables assessment of the causal effects of the enhancement strategies as a package. However, it is not an efficient means of evaluating the effectiveness of individual enhancement strategies (Collins et al. 2005, 2007, 2009a, 2011).”
From Translational research in South Africa: evaluating implementation quality using a factorial design (2012) · cites this paper as Collins et al. 2005
In the late 2000s, Collins and colleagues introduced the multiphase optimisation strategy (MOST) framework-a strategy for developing and optimising behaviour interventions.
“In the late 2000s, Collins and colleagues introduced the multiphase optimisation strategy (MOST) framework—a strategy for developing and optimising behaviour interventions.”
From Optimisation of complex health interventions prior to a randomised controlled trial: a scoping review of strategies used (2016) · cites this paper as [10]
The MOST framework focuses on the role of different intervention components and their contribution to overall success, as complex interventions may contain inactive components.
“The element of focus of this framework is the role of the different intervention components and their contribution to the overall success of the intervention, as complex interventions may contain inactive components [10].”
From Optimisation of complex health interventions prior to a randomised controlled trial: a scoping review of strategies used (2016) · cites this paper as [10]
The MOST framework proposes a programmatic and sequenced experimental approach that can efficiently and systematically identify the most promising components, in order to assemble these in an optimised version of the intervention, which is finally tested in a RCT.
“The framework proposes to adopt a programmatic and sequenced experimental approach that can efficiently and systematically identify the most promising components, in order to assemble these in an optimised version of the intervention, which is finally tested in a RCT.”
From Optimisation of complex health interventions prior to a randomised controlled trial: a scoping review of strategies used (2016) · cites this paper as [10]
The interventions reported across the review varied widely and included a few targeting behavioural change at the individual patient level, such as weight reduction and smoking cessation programs, or at the level of healthcare professionals, such as interventions targeting general practitioners to reduce inappropriate prescribing behaviours.
“The interventions reported across the review varied widely and included a few targeting behavioural change at the individual patient level, such as weight reduction [27] and smoking cessation programs [10, 44, 49], or at the level of healthcare professionals, such as interventions targeting general practitioners to reduce inappropriate prescribing behaviours [26, 45, 46, 48].”
From Optimisation of complex health interventions prior to a randomised controlled trial: a scoping review of strategies used (2016) · cites this paper as [10]
Two included studies applied the MOST framework.
“and two applied the MOST framework [10, 44].”
From Optimisation of complex health interventions prior to a randomised controlled trial: a scoping review of strategies used (2016) · cites this paper as [10]
Seven included studies were a preliminary investigation of the effect of the intervention or a combination of its components on proxy or final outcomes and intervention long-term impact.
“Seven studies were a preliminary investigation of the effect of the intervention or a combination of its components on proxy or final outcomes and intervention long-term impact [10, 24, 44–46, 49, 50].”
From Optimisation of complex health interventions prior to a randomised controlled trial: a scoping review of strategies used (2016) · cites this paper as [10]
A number of included studies adopted quantitative methods such as fractional factorial experiments, economic modelling, small uncontrolled pilot studies (with no control group), experimental 2×2 randomised controlled trials, probability models and evaluation questionnaires.
“A number of studies adopted quantitative methods such as fractional factorial experiments [10, 44], economic modelling [33], small uncontrolled pilot studies (with no control group) [25, 29, 38], experimental 2 × 2 randomised controlled trials [45, 46], probability models [49, 50] and evaluation questionnaires [43].”
From Optimisation of complex health interventions prior to a randomised controlled trial: a scoping review of strategies used (2016) · cites this paper as [10]
Factorial experiments, uncontrolled pilot studies and probability models tended to be used to test specific components and to identify an intervention's potential effect.
“For example, factorial experiments, uncontrolled pilot studies and probability models tended to be used to test specific components and to identify an intervention’s potential effect [10, 25, 29, 38, 44, 49, 50].”
From Optimisation of complex health interventions prior to a randomised controlled trial: a scoping review of strategies used (2016) · cites this paper as [10]
Data on the outcome of two included optimisation studies were not available despite attempts to contact the leading authors.
“Despite attempts to contact the leading authors, data on the outcome of two of the included optimisation studies were not available [10, 44].”
From Optimisation of complex health interventions prior to a randomised controlled trial: a scoping review of strategies used (2016) · cites this paper as [10]
MOST draws on engineering and related fields and adapts those ideas to behavioral intervention science.
“Based on ideas drawn from engineering and related fields and adapted to behavioral intervention science, MOST is a principled and comprehensive framework for optimizing and evaluating behavioral interventions.”
From The Multiphase Optimization Strategy for Engineering Effective Tobacco Use Interventions (2011) · cites this paper as [4]
MOST uses the resource management and continuous optimization principles to improve smoking cessation research efficiency and intervention effectiveness and cost-effectiveness.
“MOST (4, 5), which has some conceptual roots in the phased approach to intervention development and evaluation proposed by the United Kingdom’s Medical Research Council (14, 15) applies the resource management and continuous optimization principles to improve the efficiency of smoking cessation research and the effectiveness and cost-effectiveness of smoking cessation interventions.”
From The Multiphase Optimization Strategy for Engineering Effective Tobacco Use Interventions (2011) · cites this paper as [4]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
(2002) · Cited by 13,211 · see citing works
(1979) · Medical Entomology and Zoology · Cited by 11,252 · see citing works
Myers, R. H., & Montgomery, D. C. (1996) · IIE Transactions · doi:10.1080/15458830.1996.11770760 · Cited by 6,141 · see citing works
Quasi-experimentation: Design and analysis issues for field settings
Shrout, P. E. (1980) · Evaluation and Program Planning · doi:10.1016/0149-7189(80)90063-4 · Cited by 6,107 · see citing works
Empirical Model Building and Response Surfaces
Freeny, A. E., Box, G. E. P., & Draper, N. R. (1988) · Technometrics · doi:10.2307/1270169 · Cited by 5,238 · see citing works
Statistics for experimenters. An introduction to design, data analysis, and model building.
Box, G. E. P., Hunter, W. G., & Hunter, J. S. (1978) · Cited by 4,021 · see citing works
Dictionary of Statistics and Methodology: A Nontechnical Guide for the Social Sciences
Vaidyanathan, R., & Vogt, W. P. (1994) · Journal of Marketing Research · doi:10.2307/3152235 · Cited by 880 · see citing works
One size does not fit all: the case for tailoring print materials
Kreuter, M. W., Strecher, V. J., & Glassman, B. (1999) · Annals of Behavioral Medicine · doi:10.1007/bf02895958 · Cited by 831 · see citing works
Self-citationFlay, B. R. (1986) · Preventive Medicine · doi:10.1016/0091-7435(86)90024-1 · Cited by 723 · see citing works
Empirical Model-Building and Response Surfaces.
Pike, D. J., Box, G. E. P., & Draper, N. R. (1988) · Journal of the Royal Statistical Society Series A (Statistics in Society) · doi:10.2307/2982196 · Cited by 723 · see citing works
Statistics for Experimenters: An Introduction to Design, Data Analysis, and Model Building
Parameswaran, R., Box, G. E. P., Hunter, W. G., & Hunter, J. S. (1979) · Journal of Marketing Research · doi:10.2307/3150696 · Cited by 685 · see citing works
A Conceptual Framework for Adaptive Preventive Interventions
Collins, L. M., Murphy, S. A., & Bierman, K. L. (2004) · Prevention Science · doi:10.1023/b:prev.0000037641.26017.00 · Cited by 608 · see citing works
Self-citationDictionary of statistics and methodology: a nontechnical guide for the social sciences
(1993) · Choice Reviews Online · doi:10.5860/choice.31-1310 · Cited by 438 · see citing works
Computer-tailored smoking cessation materials: A review and discussion
Strecher, V. J. (1999) · Patient Education and Counseling · doi:10.1016/s0738-3991(98)00128-1 · Cited by 287 · see citing works
Self-citationDeveloping School-Based Tobacco Use Prevention and Cessation Programs
Sussman, S. Y., Dent, C. W., Burton, D., Stacy, A. W., & Flay, B. R. (1994) · Scholarship - Claremont (Claremont Colleges) · Cited by 245 · see citing works
Copeland, K. A. F. (1996) · Journal of Quality Technology · doi:10.1080/00224065.1996.11979672 · Cited by 179 · see citing works
West, S. G., & Aiken, L. S. (1997) · American Psychological Association eBooks · doi:10.1037/10222-006 · Cited by 174 · see citing works
Behavioral therapy research: A conceptualization of a process.
Onken, L. S., BLAINE, J. D., & Battjes, R. J. (1997) · Cited by 90 · see citing works
The Scientific Approach to Cancer Control
Greenwald, P., & Cullen, J. W. (1984) · CA A Cancer Journal for Clinicians · doi:10.3322/canjclin.34.6.328 · Cited by 74 · see citing works
Innovative Approaches for Difficult-to-Treat Populations
Barrett, D. M. (1998) · The Journal of Nervous and Mental Disease · doi:10.1097/00005053-199808000-00016 · Cited by 21 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
Durlak, J. A., Weissberg, R. P., Dymnicki, A. B., Taylor, R. D., & Schellinger, K. B. (2011) · Child Development · doi:10.1111/j.1467-8624.2010.01564.x · Cited by 8,746 · see citing works
Collins, L. M., Murphy, S. A., & Strecher, V. (2007) · American Journal of Preventive Medicine · doi:10.1016/j.amepre.2007.01.022 · Cited by 1,082 · see citing works
Self-citationMichie, S., Yardley, L., West, R., Patrick, K., & Greaves, F. (2017) · Journal of Medical Internet Research · doi:10.2196/jmir.7126 · Cited by 865 · see citing works
Understanding tailoring in communicating about health
Hawkins, R. P., Kreuter, M., Resnicow, K., Fishbein, M., & Dijkstra, A. (2008) · Health Education Research · doi:10.1093/her/cyn004 · Cited by 934 · see citing works
Microrandomized trials: An experimental design for developing just-in-time adaptive interventions.
Klasnja, P., Hekler, E. B., Shiffman, S., Boruvka, A., Almirall, D., Tewari, A., & Murphy, S. A. (2015) · Health Psychology · doi:10.1037/hea0000305 · Cited by 671 · see citing works
Self-citationHarnessing context sensing to develop a mobile intervention for depression
Burns, M. N., Begale, M., Duffecy, J., Gergle, D., Karr, C. J., Giangrande, E., & Mohr, D. C. (2011) · Journal of Medical Internet Research · doi:10.2196/jmir.1838 · Cited by 646 · see citing works
Dombrowski, S. U., Sniehotta, F. F., Avenell, A., Johnston, M., MacLennan, G., & Araújo-Soares, V. (2012) · Health Psychology Review · doi:10.1080/17437199.2010.513298 · Cited by 504 · see citing works
Mohr, D. C., Lyon, A. R., Lattie, E. G., Reddy, M., & Schueller, S. M. (2017) · Journal of Medical Internet Research · doi:10.2196/jmir.7725 · Cited by 432 · see citing works
Online Prevention Aimed at Lifestyle Behaviors: A Systematic Review of Reviews
Kohl, L. F., Crutzen, R., & de Vries, N. K. (2013) · Journal of Medical Internet Research · doi:10.2196/jmir.2665 · Cited by 388 · see citing works
Collins, L. M., Dziak, J. J., & Li, R. (2009) · Psychological Methods · doi:10.1037/a0015826 · Cited by 431 · see citing works
Self-citationExperimental and quasi-experimental designs in implementation research
Miller, C. J., Smith, S. N., & Pugatch, M. (2020) · Psychiatry Research · doi:10.1016/j.psychres.2019.06.027 · Cited by 373 · see citing works
Collins, L. M., Dziak, J. J., Kugler, K. C., & Trail, J. B. (2014) · American Journal of Preventive Medicine · doi:10.1016/j.amepre.2014.06.021 · Cited by 335 · see citing works
Self-citationIntegrated models of school-based prevention: Logic and theory
Domitrovich, C. E., Bradshaw, C. P., Greenberg, M. T., Embry, D., Poduska, J. M., & Ialongo, N. S. (2010) · Psychology in the Schools · doi:10.1002/pits.20452 · Cited by 352 · see citing works
The Multiphase Optimization Strategy for Engineering Effective Tobacco Use Interventions
Collins, L. M., Baker, T. B., Mermelstein, R. J., Piper, M. E., Jorenby, D. E., Smith, S. S., Christiansen, B. A., Schlam, T. R., Cook, J. W., & Fiore, M. C. (2011) · Annals of Behavioral Medicine · doi:10.1007/s12160-010-9253-x · Cited by 300 · see citing works
Self-citationSociety for Prevention Research Type 2 Translational Task Force Members and Contributing Authors, Spoth, R., Rohrbach, L. A., Greenberg, M., Leaf, P., Brown, C. H., Fagan, A., Catalano, R. F., Pentz, M. A., Sloboda, Z., et al. (2013) · Prevention Science · doi:10.1007/s11121-012-0362-6 · Cited by 283 · see citing works
Strecher, V., McClure, J., Alexander, G., Chakraborty, B., Nair, V., Konkel, J., Greene, S., Couper, M., Carlier, C., Wiese, C., et al. (2008) · Journal of Medical Internet Research · doi:10.2196/jmir.1002 · Cited by 264 · see citing works
Self-citationCowan, L. T., Van Wagenen, S. A., Brown, B. A., Hedin, R. J., Seino-Stephan, Y., Hall, P. C., & West, J. H. (2013) · Health Education & Behavior · doi:10.1177/1090198112452126 · Cited by 264 · see citing works
Web-Based Smoking-Cessation Programs
Strecher, V. J., McClure, J. B., Alexander, G. L., Chakraborty, B., Nair, V. N., Konkel, J. M., Greene, S. M., Collins, L. M., Carlier, C. C., Wiese, C. J., et al. (2008) · American Journal of Preventive Medicine · doi:10.1016/j.amepre.2007.12.024 · Cited by 266 · see citing works
Self-citationCollins, L. M. (2018) · Statistics for Social and Behavioral Sciences · doi:10.1007/978-3-319-72206-1 · Cited by 257 · see citing works
Self-citationKlasnja, P., Smith, S., Seewald, N. J., Lee, A., Hall, K., Luers, B., Hekler, E. B., & Murphy, S. A. (2019) · Annals of Behavioral Medicine · doi:10.1093/abm/kay067 · Cited by 241 · see citing works
Self-citationAlmirall, D., Compton, S. N., Gunlicks‐Stoessel, M., Duan, N., & Murphy, S. A. (2012) · Statistics in Medicine · doi:10.1002/sim.4512 · Cited by 223 · see citing works
Self-citationMohr, D. C., Schueller, S. M., Riley, W. T., Brown, C. H., Cuijpers, P., Duan, N., Kwasny, M. J., Stiles-Shields, C., & Cheung, K. (2015) · Journal of Medical Internet Research · doi:10.2196/jmir.4391 · Cited by 216 · see citing works
Advancing the science of mHealth
Nilsen, W., Kumar, S., Shar, A., Varoquiers, C., Wiley, T., Riley, W. T., Pavel, M., & Atienza, A. A. (2012) · Journal of Health Communication · doi:10.1080/10810730.2012.677394 · Cited by 226 · see citing works
Seven lessons for interdisciplinary research on interactive digital health interventions
Blandford, A., Gibbs, J., Newhouse, N., Perski, O., Singh, A., & Murray, E. (2018) · DIGITAL HEALTH · doi:10.1177/2055207618770325 · Cited by 209 · see citing works
Experimental pretesting of hand-washing interventions in a natural setting
Judah, G., Aunger, R., Schmidt, W.-P., Michie, S., Granger, S., & Curtis, V. (2009) · American Journal of Public Health · doi:10.2105/ajph.2009.164160 · Cited by 196 · see citing works
Trajectories of change in youth anxiety during cognitive—behavior therapy.
Peris, T. S., Compton, S. N., Kendall, P. C., Birmaher, B., Sherrill, J., March, J., Gosch, E., Ginsburg, G., Rynn, M., McCracken, J. T., et al. (2015) · Journal of Consulting and Clinical Psychology · doi:10.1037/a0038402 · Cited by 191 · see citing works
Adaptive Designs for Randomized Trials in Public Health
Brown, C. H., Ten Have, T. R., Jo, B., Dagne, G., Wyman, P. A., Muthén, B., & Gibbons, R. D. (2009) · Annual Review of Public Health · doi:10.1146/annurev.publhealth.031308.100223 · Cited by 184 · see citing works
Syndemics and Health Disparities: A Methodological Note
Tsai, A. C., & Venkataramani, A. S. (2016) · AIDS and Behavior · doi:10.1007/s10461-015-1260-2 · Cited by 176 · see citing works
Rivera, D. E., Pew, M. D., & Collins, L. M. (2007) · Drug and Alcohol Dependence · doi:10.1016/j.drugalcdep.2006.10.020 · Cited by 151 · see citing works
Self-citationSchembre, S. M., Liao, Y., Robertson, M. C., Dunton, G. F., Kerr, J., Haffey, M. E., Burnett, T., Basen-Engquist, K., & Hicklen, R. S. (2018) · Journal of Medical Internet Research · doi:10.2196/jmir.8701 · Cited by 154 · see citing works
Dziak, J. J., Nahum-Shani, I., & Collins, L. M. (2012) · Psychological Methods · doi:10.1037/a0026972 · Cited by 142 · see citing works
Self-citationGarland, E. L. (2016) · Annals of the New York Academy of Sciences · doi:10.1111/nyas.13034 · Cited by 137 · see citing works
Evaluating the Impact of Physical Activity Apps and Wearables: Interdisciplinary Review
McCallum, C., Rooksby, J., & Gray, C. M. (2018) · JMIR mhealth and uhealth · doi:10.2196/mhealth.9054 · Cited by 126 · see citing works
Levati, S., Campbell, P., Frost, R., Dougall, N., Wells, M., Donaldson, C., & Hagen, S. (2016) · Pilot and Feasibility Studies · doi:10.1186/s40814-016-0058-y · Cited by 101 · see citing works
Wang, L., Rotnitzky, A., Lin, X., Millikan, R. E., & Thall, P. F. (2012) · Journal of the American Statistical Association · doi:10.1080/01621459.2011.641416 · Cited by 108 · see citing works
Morrison, L., Moss‐Morris, R., Michie, S., & Yardley, L. (2014) · British Journal of Health Psychology · doi:10.1111/bjhp.12083 · Cited by 110 · see citing works
Vlaeyen, J. W. S., Morley, S., & Crombez, G. (2016) · Behaviour Research and Therapy · doi:10.1016/j.brat.2016.08.016 · Cited by 117 · see citing works
Kelders, S. M., Bohlmeijer, E. T., Pots, W. T. M., & van Gemert-Pijnen, J. E. W. C. (2015) · Behaviour Research and Therapy · doi:10.1016/j.brat.2015.06.014 · Cited by 105 · see citing works
Goldstein, S. P., Evans, B. C., Flack, D., Juarascio, A., Manasse, S., Zhang, F., & Forman, E. M. (2017) · International Journal of Behavioral Medicine · doi:10.1007/s12529-016-9627-y · Cited by 112 · see citing works
McClure, J. B., Shortreed, S. M., Bogart, A., Derry, H., Riggs, K., St John, J., Nair, V., & An, L. (2013) · Journal of Medical Internet Research · doi:10.2196/jmir.2508 · Cited by 83 · see citing works
Self-citationCollins, L. M., Chakraborty, B., Murphy, S. A., & Strecher, V. (2009) · Clinical Trials · doi:10.1177/1740774508100973 · Cited by 80 · see citing works
Self-citationWagner, L. I., Tooze, J. A., Hall, D. L., Levine, B. J., Beaumont, J., Duffecy, J., Victorson, D., Gradishar, W., Leach, J., Saphner, T., et al. (2021) · JNCI: Journal of the National Cancer Institute · doi:10.1093/jnci/djab100 · Cited by 67 · see citing works
Impact of an acceptance facilitating intervention on psychotherapists' acceptance of blended therapy
Baumeister, H., Terhorst, Y., Grässle, C., Freudenstein, M., Nübling, R., & Ebert, D. D. (2020) · PLoS ONE · doi:10.1371/journal.pone.0236995 · Cited by 53 · see citing works
“For optimization purposes a multiphase optimization strategy (MOST) using fractional factorial designs as recommended by Collins and colleagues could be used [59,60].”
MethodWyrick, D. L., Rulison, K. L., Fearnow-Kenney, M., Milroy, J. J., & Collins, L. M. (2014) · Translational Behavioral Medicine · doi:10.1007/s13142-013-0247-7 · Cited by 57 · see citing works
Self-citationThe future of psychological treatments: The Marburg Declaration
Rief, W., Asmundson, G. J. G., Bryant, R. A., Clark, D. M., Ehlers, A., Holmes, E. A., McNally, R. J., Neufeld, C. B., Wilhelm, S., Jaroszewski, A. C., et al. (2024) · Clinical Psychology Review · doi:10.1016/j.cpr.2024.102417 · Cited by 54 · see citing works
Effectiveness of a Multimodal Online Well-Being Intervention
Cobb, N. K., & Poirier, J. (2014) · American Journal of Preventive Medicine · doi:10.1016/j.amepre.2013.08.018 · Cited by 53 · see citing works
Translational research in South Africa: evaluating implementation quality using a factorial design
Caldwell, L. L., Smith, E. A., Collins, L. M., Graham, J. W., Lai, M., Wegner, L., Vergnani, T., Matthews, C., & Jacobs, J. (2012) · Child & Youth Care Forum · doi:10.1007/s10566-011-9164-4 · Cited by 50 · see citing works
Self-citationHardeman, W., Kinmonth, A., Michie, S., Sutton, S., & the ProActive Project Team (2009) · International Journal of Behavioral Nutrition and Physical Activity · doi:10.1186/1479-5868-6-16 · Cited by 47 · see citing works
Toward Usable Evidence: Optimizing Knowledge Accumulation in HCI Research on Health Behavior Change
Klasnja, P., Hekler, E. B., Korinek, E. V., Harlow, J., & Mishra, S. R. (2017) · Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3025453.3026013 · Cited by 44 · see citing works
Watkins, E., Newbold, A., Tester-Jones, M., Collins, L. M., & Mostazir, M. (2023) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2023.1937 · Cited by 40 · see citing works
Self-citationIntegrating user perspectives into the development of a web‐based weight management intervention
Yardley, L., Williams, S., Bradbury, K., Garip, G., Renouf, S., Ware, L., Dorling, H., Smith, E., & Little, P. (2012) · Clinical Obesity · doi:10.1111/cob.12001 · Cited by 39 · see citing works
Terpstra, J. A., van der Vaart, R., van Beugen, S., van Eersel, R. A., Gkika, I., Erdős, D., Schmidt, J., Radstake, C., Kloppenburg, M., van Middendorp, H., et al. (2022) · Internet Interventions · doi:10.1016/j.invent.2022.100587 · Cited by 38 · see citing works
Barney, J. L., Murray, H. B., Manasse, S. M., Dochat, C., & Juarascio, A. S. (2019) · European Eating Disorders Review · doi:10.1002/erv.2673 · Cited by 39 · see citing works
McClure, J. B., Derry, H., Riggs, K. R., Westbrook, E. W., St. John, J., Shortreed, S. M., Bogart, A., & An, L. C. (2012) · Contemporary Clinical Trials · doi:10.1016/j.cct.2012.06.009 · Cited by 33 · see citing works
Dombrowski, S. U., Sniehotta, F. F., Johnston, M., Broom, I., Kulkarni, U., Brown, J., Murray, L., & Araújo-Soares, V. (2012) · Patient Education and Counseling · doi:10.1016/j.pec.2011.08.003 · Cited by 33 · see citing works
Understanding adherence to web-based interventions
Kelders, S. M. (2012) · doi:10.3990/1.9789036534178 · Cited by 29 · see citing works
Wells, R. D., Guastaferro, K., Azuero, A., Rini, C., Hendricks, B. A., Dosse, C., Taylor, R., Williams, G. R., Engler, S., Smith, C., et al. (2021) · Journal of Pain and Symptom Management · doi:10.1016/j.jpainsymman.2020.11.017 · Cited by 28 · see citing works
Hadjistavropoulos, H. D., Peynenburg, V., Thiessen, D. L., Nugent, M., Adlam, K., Owens, K. M. B., Karin, E., Dear, B. F., & Titov, N. (2020) · Internet Interventions · doi:10.1016/j.invent.2020.100357 · Cited by 25 · see citing works
Wagner, L. I., Duffecy, J., Penedo, F., Mohr, D. C., & Cella, D. (2017) · Cancer · doi:10.1002/cncr.30602 · Cited by 24 · see citing works
Almirall, D., Lizotte, D. J., & Murphy, S. A. (2012) · Journal of the American Statistical Association · doi:10.1080/01621459.2012.665615 · Cited by 19 · see citing works
Self-citationInvestigating the Impact of Selection Bias in Dose-Response Analyses of Preventive Interventions
Conduct Problems Prevention Research Group*, McGowan, H. M., Nix, R. L., Murphy, S. A., & Bierman, K. L. (2010) · Prevention Science · doi:10.1007/s11121-010-0169-2 · Cited by 19 · see citing works
Self-citationPischke, C. R., Helmer, S. M., Pohlabeln, H., Muellmann, S., Schneider, S., Reintjes, R., Schmidt-Pokrzywniak, A., Girbig, M., Krämer, A., Icks, A., et al. (2021) · Frontiers in Public Health · doi:10.3389/fpubh.2021.659875 · Cited by 16 · see citing works
Fortuna, K. L., Lebby, S., Geiger, P., Johnson, D., MacDonald, S., Chefetz, I., Ferron, J. C., St George, L., Rossom, R., Kalisa, J., et al. (2023) · JAMA Network Open · doi:10.1001/jamanetworkopen.2023.15479 · Cited by 18 · see citing works
Braun, T. D., Riley, K. E., Kunicki, Z. J., Finkelstein-Fox, L., Conboy, L. A., Park, C. L., Schifano, E., Abrantes, A. M., & Lazar, S. W. (2021) · Health Psychology and Behavioral Medicine · doi:10.1080/21642850.2021.1992282 · Cited by 17 · see citing works
Treweek, S., & Sullivan, F. (2006) · BMC Medical Research Methodology · doi:10.1186/1471-2288-6-28 · Cited by 7 · see citing works
Levinson, C. A., Christian, C., & Vanzhula, I. A. (2020) · Eating and Weight Disorders - Studies on Anorexia Bulimia and Obesity · doi:10.1007/s40519-019-00751-3 · Cited by 3 · see citing works
- Authors
- Collins, L. M., Murphy, S. A., Nair, V. N., & Strecher, V. J.
- Affiliations
- Pennsylvania State University (US)
- University of Michigan (US)
- Corresponding author
- Collins, Linda M.
- Venue
- Annals of Behavioral Medicine
- Publisher
- Oxford University Press (OUP)
- Published
- 2005-08-01
- Volume
- 30
- Issue
- 1
- Pages
- 65-73
- ISSN
- 0742-5554 (ISSN-L)
- 0883-6612
- 1532-4796
- OpenAlex
- W1994319704
- Cited by
- 492
- References
- 20
- Citations by year
- 2026: 11 · 2025: 33 · 2024: 28 · 2023: 27 · 2022: 44 · 2021: 37 · 2020: 45 · 2019: 30 · 2018: 26 · 2017: 27 · 2016: 25 · 2015: 24 · 2014: 22 · 2013: 19 · 2012: 24
- FWCI
- 22.39
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Annals of Behavioral Medicine (publishedVersion)
- PubMed (publishedVersion)
- Funders
- National Science Foundation (0204247)
- National Institute on Drug Abuse (K02DA015674, P50-DA-10075, P50DA010075, K02-DA15674)
- National Cancer Institute (P50CA101451)
- Topics
- Health Sciences › Health Professions › General Health Professions › Health Policy Implementation Science
- Health Sciences › Medicine › Physiology › Smoking Behavior and Cessation
- Social Sciences › Decision Sciences › Management Science and Operations Research › Optimal Experimental Design Methods
- Keywords
- multiphase optimization strategy, program evaluation, dose optimization, fractional factorial design, smoking cessation interventions, intervention development
- MeSH terms
- Behavior Therapy, Humans, Public Health, Research Design, Reproducibility of Results, Randomized Controlled Trials as Topic, Treatment Outcome, Endpoint Determination
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
