Comparison of a phased experimental approach and a single randomized clinical trial for developing multicomponent behavioral interventions

Collins, Linda M; Chakraborty, Bibhas; Murphy, Susan A; Strecher, Victor

doi:10.1177/1740774508100973

Cited by 80Statistical Methods in Clinical TrialsHealth Policy Implementation ScienceAdvanced Causal Inference Techniques

Comparison of a phased experimental approach and a single randomized clinical trial for developing multicomponent behavioral interventions

Open access

Collins, Linda M, Chakraborty, Bibhas, Murphy, Susan A, Strecher, Victor·2009·Clinical Trials

DOI 10.1177/1740774508100973PMC PMC2711350

Open this paper in CoChat — free account

Abstract

Background Many interventions in today's health sciences are multicomponent, and often one or more of the components are behavioral. Two approaches to building behavioral interventions empirically can be identified. The more typically used approach, labeled here the classical approach, consists of constructing a likely best intervention a priori, and then evaluating the intervention in a standard randomized controlled trial (RCT). By contrast, the emergent phased experimental approach involves programmatic phases of empirical research and discovery aimed at identifying individual intervention component effects and the best combination of components and levels. Purpose The purpose of this article is to provide a head-to-head comparison between the classical and phased experimental approaches and thereby highlight the relative advantages and disadvantages of these approaches when they are used to select program components and levels so as to arrive at the most potent intervention. Methods A computer simulation was performed in which the classical and phased experimental approaches to intervention development were applied to the same randomly generated data. Results The phased experimental approach resulted in better mean intervention outcomes when the intervention effect size was medium or large, whereas the classical approach resulted in better mean intervention outcomes when the effect size was small. The phased experimental approach led to identification of the correct set of intervention components and levels at a higher rate than the classical approach across all conditions. Limitations Some potentially important factors were not varied in the simulation, for example the underlying structural model and the number of intervention components. Conclusions The phased experimental approach merits serious consideration, because it has the potential to enable intervention scientists to develop more efficacious behavioral interventions. Clinical Trials 2009; 6: 5—15. http://ctj.sagepub.com

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

Integrity signals

Registry

Crossref · 10.1177/1740774508100973

Cites

45 of 45 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Factorial designs are often used in MOST's optimization stage to develop more potent interventions.
“factorial designs (along with other approaches) are often used in the optimization stage of MOST to develop more potent interventions [65,67]”
From Introduction to SMART designs for the development of adaptive interventions: with application to weight loss research (2014) · cites this paper as [67]

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Statistical Power Analysis for the Behavioral Sciences
Muller, K. E., & Cohen, J. (1989) · Technometrics · doi:10.2307/1270020 · Cited by 99,588 · see citing works
Statistical power analysis for the behavioral sciences
Cohen, J. (1990) · Computers Environment and Urban Systems · doi:10.1016/0198-9715(90)90050-4 · Cited by 65,406 · see citing works
Untitled work
(2002) · Cited by 13,211 · see citing works
Developing and evaluating complex interventions: the new Medical Research Council guidance
Craig, P., Dieppe, P., Macintyre, S., Michie, S., Nazareth, I., & Petticrew, M. (2008) · BMJ · doi:10.1136/bmj.a1655 · Cited by 10,995 · see citing works
Response surface methodology
Myers, R. H., & Montgomery, D. C. (1996) · IIE Transactions · doi:10.1080/15458830.1996.11770760 · Cited by 6,141 · see citing works
Acute and longer-term outcomes in depressed outpatients requiring one or several treatment steps: a STAR*D report
Rush, A. J., Trivedi, M. H., Wisniewski, S. R., Nierenberg, A. A., Stewart, J. W., Warden, D., Niederehe, G., Thase, M. E., Lavori, P. W., Lebowitz, B. D., et al. (2006) · American Journal of Psychiatry · doi:10.1176/ajp.2006.163.11.1905 · Cited by 5,643 · cited 1× · see citing works
“pharmacotherapy and talk therapy [4,5]; cardiovas-”
Empirical Model Building and Response Surfaces
Freeny, A. E., Box, G. E. P., & Draper, N. R. (1988) · Technometrics · doi:10.2307/1270169 · Cited by 5,238 · see citing works
Statistics for experimenters. An introduction to design, data analysis, and model building.
Box, G. E. P., Hunter, W. G., & Hunter, J. S. (1978) · Cited by 4,021 · see citing works
Framework for design and evaluation of complex interventions to improve health
Campbell, M. (2000) · BMJ · doi:10.1136/bmj.321.7262.694 · Cited by 3,474 · see citing works
A Multifactorial Intervention to Reduce the Risk of Falling among Elderly People Living in the Community
Tinetti, M. E., Baker, D. I., McAvay, G., Claus, E. B., Garrett, P., Gottschalk, M., Koch, M. L., Trainor, K. M., & Horwitz, R. I. (1994) · New England Journal of Medicine · doi:10.1056/nejm199409293311301 · Cited by 2,135 · see citing works
Statistics for Experimenters: An Introduction to Design, Data Analysis and Model Building.
Pearce, S. C., Box, G. E. P., Hunter, W. G., & Hunter, J. S. (1979) · Biometrics · doi:10.2307/2530361 · Cited by 2,003 · see citing works
The Multiphase Optimization Strategy (MOST) and the Sequential Multiple Assignment Randomized Trial (SMART)
Collins, L. M., Murphy, S. A., & Strecher, V. (2007) · American Journal of Preventive Medicine · doi:10.1016/j.amepre.2007.01.022 · Cited by 1,082 · see citing works
Self-citation
Dictionary of Statistics and Methodology: A Nontechnical Guide for the Social Sciences
Vaidyanathan, R., & Vogt, W. P. (1994) · Journal of Marketing Research · doi:10.2307/3152235 · Cited by 880 · see citing works
Initial impact of the fast track prevention trial for conduct problems: I. The high-risk sample.
Bierman, K. L., Coie, J. D., Dodge, K. A., Greenberg, M. T., Lochman, J. E., McMahon, R. J., & Pinderhughes, E. E. (1999) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.67.5.631 · Cited by 582 · see citing works
A strategy for optimizing and evaluating behavioral interventions
Collins, L. M., Murphy, S. A., Nair, V. N., & Strecher, V. J. (2005) · Annals of Behavioral Medicine · doi:10.1207/s15324796abm3001_8 · Cited by 492 · see citing works
Self-citation
Dictionary of statistics and methodology: a nontechnical guide for the social sciences
(1993) · Choice Reviews Online · doi:10.5860/choice.31-1310 · Cited by 438 · see citing works
Initial impact of the fast track prevention trial for conduct problems: II. Classroom effects.
(1999) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.67.5.648 · Cited by 402 · see citing works
Graphs, Causality, and Structural Equation Models
PEARL, J. (1998) · Sociological Methods & Research · doi:10.1177/0049124198027002004 · Cited by 341 · see citing works
Design, analysis and presentation of factorial randomised controlled trials
Montgomery, A. A., Peters, T. J., & Little, P. S. (2003) · BMC Medical Research Methodology · doi:10.1186/1471-2288-3-26 · Cited by 320 · see citing works
Randomized controlled trial of a web‐based computer‐tailored smoking cessation program as a supplement to nicotine patch therapy
Strecher, V. J., Shiffman, S. M., & West, R. (2005) · Addiction · doi:10.1111/j.1360-0443.2005.01093.x · Cited by 308 · see citing works
Self-citation
Systematic review of multifaceted interventions to improve depression care
Williams, J. W., Gerrity, M., Holsinger, T., Dobscha, S. K., Gaynes, B. N., & Dietrich, A. J. (2007) · General Hospital Psychiatry · doi:10.1016/j.genhosppsych.2006.12.003 · Cited by 270 · see citing works
Web-Based Smoking-Cessation Programs
Strecher, V. J., McClure, J. B., Alexander, G. L., Chakraborty, B., Nair, V. N., Konkel, J. M., Greene, S. M., Collins, L. M., Carlier, C. C., Wiese, C. J., et al. (2008) · American Journal of Preventive Medicine · doi:10.1016/j.amepre.2007.12.024 · Cited by 266 · see citing works
Self-citation
The children of divorce parenting intervention: Outcome evaluation of an empirically based program
Wolchik, S. A., West, S. G., Westover, S., Sandler, I. N., Martin, A., Lustig, J. L., Tein, J., & Fisher, J. L. (1993) · American Journal of Community Psychology · doi:10.1007/bf00941505 · Cited by 214 · see citing works
Interventions to Prevent or Treat Obesity in Preschool Children: A Review of Evaluated Programs
Bluford, D. A., Sherry, B., & Scanlon, K. S. (2007) · Obesity · doi:10.1038/oby.2007.163 · Cited by 192 · see citing works
Testing Combined Pharmacotherapies and Behavioral Interventions in Alcohol Dependence: Rationale and Methods
The COMBINE Study Research Group (2003) · Alcoholism: Clinical and Experimental Research · doi:10.1111/j.1530-0277.2003.tb02873.x · Cited by 174 · see citing works
Does Multiple Risk Factor Reduction Explain the Reduction in Fall Rate in the Yale FICSIT Trial?
Tinetti, M. E., McAvay, G., & Claus, E. (1996) · American Journal of Epidemiology · doi:10.1093/oxfordjournals.aje.a008940 · Cited by 162 · see citing works
Initial impact of the Fast Track prevention trial for conduct problems: I. The high-risk sample. Conduct Problems Prevention Research Group.
(1999) · PubMed · Cited by 154 · see citing works
Using engineering control principles to inform the design of adaptive interventions: A conceptual introduction
Rivera, D. E., Pew, M. D., & Collins, L. M. (2007) · Drug and Alcohol Dependence · doi:10.1016/j.drugalcdep.2006.10.020 · Cited by 151 · see citing works
Self-citation
A 2-Arm, Randomized, Controlled Trial of a Motivational Interviewing-Based Intervention to Improve Adherence to Antiretroviral Therapy (ART) Among Patients Failing or Initiating ART
Golin, C. E., Earp, J. A., Tien, H. C., Stewart, P. W., Porter, C. Q., & Howie, L. J. (2006) · JAIDS Journal of Acquired Immune Deficiency Syndromes · doi:10.1097/01.qai.0000219771.97303.0a · Cited by 144 · see citing works
Texas Medication Algorithm Project, Phase 3 (TMAP-3)
Rush, A. J., Crismon, M. L., Kashner, T. M., Toprac, M. G., Carmody, T. J., Trivedi, M. H., Suppes, T. M., Miller, A. L., Biggs, M. M., Shores‐Wilson, K., et al. (2003) · The Journal of Clinical Psychiatry · doi:10.4088/jcp.v64n0402 · Cited by 108 · see citing works
Initial impact of the Fast Track prevention trial for conduct problems: II. Classroom effects. Conduct Problems Prevention Research Group.
(1999) · PubMed · Cited by 104 · see citing works
Factorial designs for randomized clinical trials.
Byar, D. P., & Piantadosi, S. (1985) · PubMed · Cited by 85 · see citing works
Factorial Design Considerations
Green, S., Liu, P., & OʼSullivan, J. (2002) · Journal of Clinical Oncology · doi:10.1200/jco.2002.03.003 · Cited by 77 · see citing works
Probing the effects of individual components in multiple component prevention programs
West, S. G., Aiken, L. S., & Todd, M. (1993) · American Journal of Community Psychology · doi:10.1007/bf00942173 · Cited by 69 · see citing works
Screening Experiments and the Use of Fractional Factorial Designs in Behavioral Intervention Research
Nair, V. N., Strecher, V. J., Fagerlin, A., Ubel, P. A., Resnicow, K., Murphy, S. A., Little, R. J. A., Chakraborty, B., & Zhang, A. (2008) · American Journal of Public Health · doi:10.2105/ajph.2007.127563 · Cited by 68 · see citing works
Self-citation
Experimental designs for multicomponent interventions among persons with multifactorial geriatric syndromes
Allore, H. G., Tinettia, M. E., Gill, T. M., & Peduzzi, P. N. (2005) · Clinical Trials · doi:10.1191/1740774505cn067oa · Cited by 41 · see citing works
Factorial designs: a graphical aid for choosing study designs accounting for interaction
Byth, K., & Gebski, V. (2004) · Clinical Trials · doi:10.1191/1740774504cn026oa · Cited by 24 · see citing works
Lifestyle Intervention for the Prevention of Type 2 Diabetes Mellitus
Narayan, K. M. V., Kanaya, A. M., & Gregg, E. W. (2003) · Treatments in Endocrinology · doi:10.2165/00024677-200302050-00003 · Cited by 23 · see citing works
Parent Program Component Analysis in a Drug Abuse Prevention Trial
Riggs, N. R., Elfenbaum, P., & Pentz, M. A. (2006) · Journal of Adolescent Health · doi:10.1016/j.jadohealth.2005.09.013 · Cited by 22 · see citing works
Smoking Cessation 3: Multicomponent Interventions
Cofta-Woerpel, L. M., Wright, K. L., & Wetter, D. W. (2007) · Behavioral Medicine · doi:10.3200/bmed.32.4.135-149 · Cited by 21 · see citing works
Society for Medical Decision Making
Goodman, C. (1988) · Cited by 20 · see citing works
A Prospective, Nonrandomized, Open-Labeled Pilot Study Investigating the Use of Magnesium in Patients Undergoing Nonacute Percutaneous Coronary Intervention with Stent Implantation
Rukshin, V., Santos, R. D., Gheorghiu, M., Shah, P. K., Kar, S., Padmanabhan, S., Azarbal, B., Tsang, V. T., Makkar, R. R., Samuels, B. A., et al. (2003) · Journal of Cardiovascular Pharmacology and Therapeutics · doi:10.1177/107424840300800304 · Cited by 19 · see citing works
Using explicit clinician preferences in nonrandomized study designs
Korn, E. L., Teeter, D. M., & Baumrind, S. (2001) · Journal of Statistical Planning and Inference · doi:10.1016/s0378-3758(00)00324-4 · Cited by 14 · see citing works
Design and analysis of trials of combination therapies.
Hosking, J. D., Cisler, R. A., Couper, D. J., Gastfriend, D. R., Kivlahan, D. R., & Anton, R. F. (2005) · Journal of Studies on Alcohol Supplement · doi:10.15288/jsas.2005.s15.34 · Cited by 12 · see citing works
The patient with cardiovascular disease: Treatment strategies for preventing major events
Cuffe, M. S. (2009) · Clinical Cardiology · doi:10.1002/clc.4960291403 · Cited by 8 · see citing works

Flagged first, then by citations

Research works printed but not linked: 1

[28]Wu CFJ Hamada M Planning, analysis, and parameter design optimization 2000 New York Wiley

Sorted by citations

Scaling Up mHealth: Where Is the Evidence?
Tomlinson, M., Rotheram-Borus, M. J., Swartz, L., & Tsai, A. C. (2013) · PLoS Medicine · doi:10.1371/journal.pmed.1001382 · Cited by 673 · see citing works
Microrandomized trials: An experimental design for developing just-in-time adaptive interventions.
Klasnja, P., Hekler, E. B., Shiffman, S., Boruvka, A., Almirall, D., Tewari, A., & Murphy, S. A. (2015) · Health Psychology · doi:10.1037/hea0000305 · Cited by 671 · see citing works
Self-citation
Development, Evaluation, and Multinational Dissemination of the Triple P-Positive Parenting Program
Sanders, M. R. (2012) · Annual Review of Clinical Psychology · doi:10.1146/annurev-clinpsy-032511-143104 · Cited by 619 · see citing works
Introduction to SMART designs for the development of adaptive interventions: with application to weight loss research
Almirall, D., Nahum-Shani, I., Sherwood, N. E., & Murphy, S. A. (2014) · Translational Behavioral Medicine · doi:10.1007/s13142-014-0265-0 · Cited by 453 · see citing works
Self-citation
No more ‘business as usual’ with audit and feedback interventions: towards an agenda for a reinvigorated intervention
Ivers, N. M., Sales, A., Colquhoun, H., Michie, S., Foy, R., Francis, J. J., & Grimshaw, J. M. (2014) · Implementation Science · doi:10.1186/1748-5908-9-14 · Cited by 400 · see citing works
Design of experiments with multiple independent variables: A resource management perspective on complete and reduced factorial designs.
Collins, L. M., Dziak, J. J., & Li, R. (2009) · Psychological Methods · doi:10.1037/a0015826 · Cited by 431 · see citing works
Self-citation
Optimization of behavioral dynamic treatment regimens based on the sequential, multiple assignment, randomized trial (SMART)
Collins, L. M., Nahum-Shani, I. B., & Almirall, D. (2014) · Clinical Trials · doi:10.1177/1740774514536795 · Cited by 194 · see citing works
Self-citation
Syndemics and Health Disparities: A Methodological Note
Tsai, A. C., & Venkataramani, A. S. (2016) · AIDS and Behavior · doi:10.1007/s10461-015-1260-2 · Cited by 176 · see citing works
Just-in-Time Feedback in Diet and Physical Activity Interventions: Systematic Review and Practical Design Framework
Schembre, S. M., Liao, Y., Robertson, M. C., Dunton, G. F., Kerr, J., Haffey, M. E., Burnett, T., Basen-Engquist, K., & Hicklen, R. S. (2018) · Journal of Medical Internet Research · doi:10.2196/jmir.8701 · Cited by 154 · see citing works
Preventing smoking progression in young adults: the concept of prevescalation.
Villanti, A. C., Niaura, R. S., Abrams, D. B., & Mermelstein, R. (2019) · Prevention Science · doi:10.1007/s11121-018-0880-y · Cited by 130 · see citing works
Evaluating individual intervention components: Making decisions based on the results of a factorial screening experiment
Collins, L. M., Trail, J. B., Kugler, K. C., Baker, T. B., Piper, M. E., & Mermelstein, R. J. (2014) · Translational Behavioral Medicine · doi:10.1007/s13142-013-0239-7 · Cited by 119 · see citing works
Self-citation
Evaluation of Viable Dynamic Treatment Regimes in a Sequentially Randomized Trial of Advanced Prostate Cancer
Wang, L., Rotnitzky, A., Lin, X., Millikan, R. E., & Thall, P. F. (2012) · Journal of the American Statistical Association · doi:10.1080/01621459.2011.641416 · Cited by 108 · see citing works
Developing multicomponent interventions using fractional factorial designs
Chakraborty, B., Collins, L. M., Strecher, V. J., & Murphy, S. A. (2009) · Statistics in Medicine · doi:10.1002/sim.3643 · Cited by 107 · see citing works
Self-citation
Current experience with applying the GRADE approach to public health interventions: an empirical study
Rehfuess, E. A., & Akl, E. A. (2013) · BMC Public Health · doi:10.1186/1471-2458-13-9 · Cited by 93 · see citing works
Lipid profile of HIV-infected patients in relation to antiretroviral therapy: a review
Souza, S. J., Luzia, L. A., dos Santos, S. D. S., & Rondó, P. H. D. C. (2013) · Revista da Associação Médica Brasileira · doi:10.1016/j.ramb.2012.11.003 · Cited by 93 · see citing works
Intervention Optimization: A Paradigm Shift and Its Potential Implications for Clinical Psychology
Collins, L. M., Nahum-Shani, I. B., Guastaferro, K., Strayhorn, J. C., Vanness, D. J., & Murphy, S. A. (2024) · Annual Review of Clinical Psychology · doi:10.1146/annurev-clinpsy-080822-051119 · Cited by 73 · see citing works
Self-citation
Attachment and Biobehavioral Catch-up: An evidence-based intervention for vulnerable infants and their families
Dozier, M., Roben, C. K. P., Caron, E., Hoye, J. R., & Bernard, K. (2016) · Psychotherapy Research · doi:10.1080/10503307.2016.1229873 · Cited by 71 · see citing works
Comparative effectiveness of motivation phase intervention components for use with smokers unwilling to quit: a factorial screening experiment
Cook, J. W., Collins, L. M., Fiore, M. C., Smith, S. S., Fraser, D. L., Bolt, D. M., Baker, T. B., Piper, M. E., Schlam, T. R., Jorenby, D. E., et al. (2015) · Addiction · doi:10.1111/add.13161 · Cited by 60 · see citing works
Self-citation
Impact of an acceptance facilitating intervention on psychotherapists' acceptance of blended therapy
Baumeister, H., Terhorst, Y., Grässle, C., Freudenstein, M., Nübling, R., & Ebert, D. D. (2020) · PLoS ONE · doi:10.1371/journal.pone.0236995 · Cited by 53 · see citing works
“For optimization purposes a multiphase optimization strategy (MOST) using fractional factorial designs as recommended by Collins and colleagues could be used [59,60].”
Method
Moving beyond the treatment package approach to developing behavioral interventions: addressing questions that arose during an application of the Multiphase Optimization Strategy (MOST)
Wyrick, D. L., Rulison, K. L., Fearnow-Kenney, M., Milroy, J. J., & Collins, L. M. (2014) · Translational Behavioral Medicine · doi:10.1007/s13142-013-0247-7 · Cited by 57 · see citing works
Self-citation
Intervention Synthesis: A Missing Link between a Systematic Review and Practical Treatment(s)
Glasziou, P., Chalmers, I., Green, S., & Michie, S. (2014) · PLoS Medicine · doi:10.1371/journal.pmed.1001690 · Cited by 54 · see citing works
Factorial Designs Help to Understand How Psychological Therapy Works
Watkins, E. R., & Newbold, A. (2020) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2020.00429 · Cited by 52 · see citing works
Implementing multifactorial psychotherapy research in online virtual environments (IMPROVE-2): study protocol for a phase III trial of the MOST randomized component selection method for internet cognitive-behavioural therapy for depression
Watkins, E. R., Newbold, A., Tester‐Jones, M., Javaid, M., Cadman, J., Collins, L. M., Graham, J., & Mostazir, M. (2016) · BMC Psychiatry · doi:10.1186/s12888-016-1054-8 · Cited by 51 · see citing works
Self-citation
Translational research in South Africa: evaluating implementation quality using a factorial design
Caldwell, L. L., Smith, E. A., Collins, L. M., Graham, J. W., Lai, M., Wegner, L., Vergnani, T., Matthews, C., & Jacobs, J. (2012) · Child & Youth Care Forum · doi:10.1007/s10566-011-9164-4 · Cited by 50 · see citing works
Self-citation
Toward Usable Evidence: Optimizing Knowledge Accumulation in HCI Research on Health Behavior Change
Klasnja, P., Hekler, E. B., Korinek, E. V., Harlow, J., & Mishra, S. R. (2017) · Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3025453.3026013 · Cited by 44 · see citing works
Optimization of a technology-supported physical activity intervention for breast cancer survivors: Fit2Thrive study protocol
Phillips, S. M., Collins, L. M., Penedo, F. J., Courneya, K. S., Welch, W. A., Cottrell, A., Lloyd, G. R., Gavin, K. L., Cella, D. F., Ackermann, R. T., et al. (2018) · Contemporary Clinical Trials · doi:10.1016/j.cct.2018.01.001 · Cited by 37 · see citing works
Self-citation
Engagement With a Behavior Change App for Alcohol Reduction: Data Visualization for Longitudinal Observational Study
Bell, L., Garnett, C. V., Qian, T., Perski, O., Williamson, E., & POTTS, H. W. W. (2020) · Journal of Medical Internet Research · doi:10.2196/23369 · Cited by 33 · see citing works
What You Don't Know: Improving Family Health History Knowledge among Multigenerational Families of Mexican Origin
Goergen, A. F., Ashida, S., Skapinsky, K., de Heer, H. ‘., Wilkinson, A. V., & Koehly, L. M. (2016) · Public Health Genomics · doi:10.1159/000443473 · Cited by 30 · see citing works
Effectiveness of a school-based multi-component smoking prevention intervention: The LdP cluster randomized controlled trial
Gorini, G., Carreras, G., Bosi, S., Tamelli, M., Monti, C., Storani, S., Martini, A., Allara, E., Angelini, P., & Faggiano, F. (2014) · Preventive Medicine · doi:10.1016/j.ypmed.2014.01.004 · Cited by 30 · see citing works
Supporting adjuvant endocrine therapy adherence in women with breast cancer: the development of a complex behavioural intervention using Intervention Mapping guided by the Multiphase Optimisation Strategy
Green, S. M. C., French, D., Graham, C. D., Hall, L., Rousseau, N. S., Foy, R., Clark, J., Parbutt, C., Raine, E., Gardner, B., et al. (2022) · BMC Health Services Research · doi:10.1186/s12913-022-08243-4 · Cited by 31 · see citing works
Weight loss maintenance: An agenda for health psychology
Sniehotta, F. F., Simpson, S. A., & Greaves, C. J. (2014) · British Journal of Health Psychology · doi:10.1111/bjhp.12107 · Cited by 26 · see citing works
Group-based exercise interventions for increasing physical activity in cancer survivors: a systematic review of face-to-face randomized and non-randomized trials
Leach, H. J., Mama, S. K., & Harden, S. M. (2019) · Supportive Care in Cancer · doi:10.1007/s00520-019-04670-y · Cited by 29 · see citing works
Reinforcement Learning in Modern Biostatistics: Constructing Optimal Adaptive Interventions
Deliu, N., Williams, J. J., & Chakraborty, B. (2024) · International Statistical Review · doi:10.1111/insr.12583 · Cited by 24 · see citing works
Self-citation
Optimization of Early Mobilization Program for Patients With Acute Ischemic Stroke: An Orthogonal Design
Zhang, M., Wang, Q., Jiang, Y., Shi, H., Peng, T., & Wang, M. (2021) · Frontiers in Neurology · doi:10.3389/fneur.2021.645811 · Cited by 21 · see citing works
Misplaced obsession with prospectively randomized studies
Gleicher, N., & Barad, D. H. (2010) · Reproductive BioMedicine Online · doi:10.1016/j.rbmo.2010.06.042 · Cited by 20 · see citing works
Comment
Almirall, D., Lizotte, D. J., & Murphy, S. A. (2012) · Journal of the American Statistical Association · doi:10.1080/01621459.2012.665615 · Cited by 19 · see citing works
Self-citation
Cognitive computing and eScience in health and life science research: artificial intelligence and obesity intervention programs
Marshall, T. E., Champagne-Langabeer, T., Castelli, D. M., & Hoelscher, D. M. (2017) · Health Information Science and Systems · doi:10.1007/s13755-017-0030-0 · Cited by 21 · see citing works
Statistical challenges in assessing potential efficacy of complex interventions in pilot or feasibility studies
Wilson, D. T., Walwyn, R. E. A., Brown, J. M., Farrin, A. J., & Brown, S. (2015) · Statistical Methods in Medical Research · doi:10.1177/0962280215589507 · Cited by 16 · see citing works
A Gambling Just-In-Time Adaptive Intervention (GamblingLess: In-The-Moment): Protocol for a Microrandomized Trial
Dowling, N. A., Merkouris, S., Youssef, G. J., Lubman, D. I., Bagot, K. L., Hawker, C. O., Portogallo, H. J., Thomas, A. C., & Rodda, S. N. (2022) · JMIR Research Protocols · doi:10.2196/38958 · Cited by 18 · see citing works
Applying the Just-In-Time Adaptive Intervention Framework to the Development of Gambling Interventions
Dowling, N. A., Rodda, S. N., & Merkouris, S. (2023) · Journal of Gambling Studies · doi:10.1007/s10899-023-10250-x · Cited by 17 · see citing works
Design Lessons from a Micro-Randomized Pilot Study in Mobile Health
Smith, S. N., Lee, J. S., Hall, K., Seewald, N. J., Boruvka, A., Murphy, S. A., & Klasnja, P. (2017) · Springer eBooks · doi:10.1007/978-3-319-51394-2_4 · Cited by 17 · see citing works
Self-citation
Synergistic and antagonistic influences of trace elements on volatile fatty acids degradation and methane production during the methanization of a mixture of volatile fatty acids
Ezebuiro, N. C., Techamanoon, K., & Körner, I. (2018) · Journal of environmental chemical engineering · doi:10.1016/j.jece.2017.12.017 · Cited by 15 · see citing works
General Practitioners’ Attitudes Toward a Web-Based Mental Health Service for Adolescents: Implications for Service Design and Delivery
Subotic-Kerry, M., King, C., O'Moore, K., Achilles, M., & O'Dea, B. (2018) · JMIR Human Factors · doi:10.2196/humanfactors.8913 · Cited by 14 · see citing works
Optimizing treatment protocols for spinal manipulative therapy: study protocol for a randomized trial
Fritz, J. M., Sharpe, J. A., Lane, E., Santillo, D., Greene, T., & Kawchuk, G. N. (2018) · Trials · doi:10.1186/s13063-018-2692-6 · Cited by 14 · see citing works
Respiratory Sinus Arrhythmia Change during Trauma-Focused Cognitive-Behavioral Therapy: Results from a Randomized Controlled Feasibility Trial
Shenk, C. E., Allen, B., Dreschel, N. A., Wang, M., Felt, J. M., Brown, M. P., Bucher, A. M., Chen, M. J., & Olson, A. E. (2022) · Research on Child and Adolescent Psychopathology · doi:10.1007/s10802-022-00946-w · Cited by 12 · see citing works
Reach out behavioral intervention for hypertension initiated in the emergency department connecting multiple health systems: study protocol for a randomized control trial
Meurer, W. J., Dinh, M., Kidwell, K., Flood, A., Champoux, E., Whitfield, C., Trimble, D., Cowdery, J. E., Borgialli, D. A., Montas, S. M., et al. (2020) · Trials · doi:10.1186/s13063-020-04340-z · Cited by 11 · see citing works
Usability and effectiveness of adherence monitoring of a mobile app designed to monitor and improve adherence to event-driven and daily HIV pre-exposure prophylaxis among men who have sex with men in Taiwan
Wu, H., Yu, Y.-F., Ku, S. W., Tseng, Y., Yuan, C. W., Li, C., Huang, P., Ko, N., Anderson, P. L., & Strong, C. (2022) · Digital Health · doi:10.1177/20552076221102770 · Cited by 9 · see citing works
Optimizing the development and evaluation of complex interventions: lessons learned from the BetterBirth Program and associated trial
Barnhart, D. A., Semrau, K. E. A., Zigler, C. M., Molina, R. L., Delaney, M. M., Hirschhorn, L. R., & Spiegelman, D. L. (2020) · Implementation Science Communications · doi:10.1186/s43058-020-00014-8 · Cited by 8 · see citing works
Wie spezifisch ist evidenzbasierte Kinder- und Jugendlichenpsychotherapie?
Goldbeck, L. (2011) · Praxis der Kinderpsychologie und Kinderpsychiatrie · doi:10.13109/prkk.2011.60.8.639 · Cited by 8 · see citing works
Adaptive Intervention Designs in Substance Use Prevention
Hall, K. L., Nahum-Shani, I. B., August, G. J., Patrick, M. E., Murphy, S. A., & Almirall, D. (2019) · Advances in prevention science · doi:10.1007/978-3-030-00627-3_17 · Cited by 6 · see citing works
Self-citation
Supporting adjuvant endocrine therapy adherence in women with breast cancer: the development of a complex behavioural intervention using Intervention Mapping guided by the Multiphase Optimisation StrategyPreprint
Green, S. M. C., French, D., Graham, C. D., Hall, L., Rousseau, N. S., Foy, R., Clark, J., Parbutt, C., Raine, E., Gardner, B., et al. (2022) · Research Square · doi:10.21203/rs.3.rs-1239166/v1 · Cited by 6 · see citing works
A Systematic Review and Taxonomy of Neuroticism Interventions for the General Public
Wright, A. J., Haehner, P., Hopwood, C. J., & Bleidorn, W. (2026) · Personality Science · doi:10.1177/27000710261421531 · Cited by 5 · see citing works
Artificial Intelligence-Based Decision Support Systems for Precision and Digital Health
Deliu, N., & Chakraborty, B. (2025) · Springer eBooks · doi:10.1007/978-981-96-0742-6_1 · Cited by 12 · see citing works
Self-citation
Dosing parameters for the effects of high-frequency transcranial magnetic stimulation on smoking cessation: study protocol for a randomized factorial sham-controlled clinical trial
Carl, E. M., Liskiewicz, A., Rivard, C., Alberico, R. A., Belal, A., Mahoney, M. C., Quisenberry, A. J., Bickel, W. K., & Sheffer, C. E. (2020) · BMC Psychology · doi:10.1186/s40359-020-00403-7 · Cited by 5 · see citing works
Enhancing Communities through the Design, Development and Dissemination of Positive Parenting Interventions
Pickering, J., & Sanders, M. R. (2013) · Journal of Applied Research on Children Informing Policy for Children at Risk · doi:10.58464/2155-5834.1158 · Cited by 4 · see citing works
Strengthening Prevention Science to Ensure Effectiveness of Intervention in Practice: Setting up an International Agenda
Faggiano, F., Giannotta, F., & Allara, E. (2014) · Springer eBooks · doi:10.1007/978-1-4899-7424-2_26 · Cited by 3 · see citing works
Multiphase Optimization Strategy (MOST)
Goldstein, C. M., & Kugler, K. C. (2019) · Springer eBooks · doi:10.1007/978-1-4614-6439-6_101966-1 · Cited by 3 · see citing works
Efficacy of an intervention to promote spatial thinking skills
Kremer, F. E., Stark, L., Rebholz, F., Bardach, L., Golle, J., Nagengast, B., & Trautwein, U. (2025) · Learning and Instruction · doi:10.1016/j.learninstruc.2025.102184 · Cited by 2 · see citing works
Optimization of an mHealth lifestyle intervention for families with hereditary cancer syndromes: Study protocol for a multiphase optimization strategy feasibility study
Basen-Engquist, K. M., Raber, M. R., Strong, L. L., Schembre, S. M., Li, L., Arun, B. K., Lu, K. H., You, N., Vilar, E., Lynch, P. M., et al. (2021) · Contemporary Clinical Trials · doi:10.1016/j.cct.2021.106662 · Cited by 2 · see citing works
Methods and tools used to describe and quantify the associations between diet, inflammation, and health
Hébert, J. R. (2022) · Elsevier eBooks · doi:10.1016/b978-0-12-822130-3.00005-3 · Cited by 2 · see citing works
The Data: Observational Studies and Sequentially Randomized Trials
Chakraborty, B., & Moodie, E. E. M. (2013) · Statistics in the health sciences · doi:10.1007/978-1-4614-7428-9_2 · Cited by 1 · see citing works
Self-citation
Multiphase Optimization Strategy (MOST)
Goldstein, C. M., & Kugler, K. C. (2020) · Springer eBooks · doi:10.1007/978-3-030-39903-0_101966 · Cited by 1 · see citing works
GamblingLess In-The-Moment: Protocol for a micro-randomised trial of a gambling Just-In-Time Adaptive Intervention (Preprint)Preprint
Dowling, N. A. (2022) · doi:10.2196/preprints.38958 · Cited by 1 · see citing works
A study of non-regularity in dynamic treatment regimes and some design considerations for multicomponent interventions
Chakraborty, B. (2009) · Deep Blue (University of Michigan) · Cited by 1 · see citing works
Self-citation
Introduction to the Multiphase Optimization Strategy (MOST)
Collins, L. M., Kugler, K. C., Gwadz, M. V., Fraser, D. L., Bolt, D. M., Mermelstein, R. J., Schlam, T. R., Cook, J. W., Jorenby, D. E., Loh, W., et al. (2014)
Self-citation
Raising the bar: Engineering optimized behavioral interventions for increased public health impact
Collins, L. M. (2013)
Self-citation
Innovation, engagement, and the evaluation of a parenting intervention for improving sibling relationships
Pickering, J. (2016) · The University of Queensland · doi:10.14264/uql.2016.44
Micro‐Randomized Trial
Xu, G., Wu, Z., & Murphy, S. A. (2018) · Wiley StatsRef: Statistics Reference Online · doi:10.1002/9781118445112.stat08050
Self-citation
Physical Activity Interventions to Reduce Metabolic Risk Factors to Cognitive Health
Castelli, D. M., & Julien, C. (2023) · Kinesiology Review · doi:10.1123/kr.2022-0037
Additional file 5 of Reach out behavioral intervention for hypertension initiated in the emergency department connecting multiple health systems: study protocol for a randomized control trial
Meurer, W. J., Dinh, M., Kidwell, K., Flood, A., Champoux, E., Whitfield, C., Trimble, D., Cowdery, J. E., Borgialli, D. A., Montas, S. M., et al. (2020) · Figshare · doi:10.6084/m9.figshare.12421775
Additional file 4 of Reach out behavioral intervention for hypertension initiated in the emergency department connecting multiple health systems: study protocol for a randomized control trial
Meurer, W. J., Dinh, M., Kidwell, K., Flood, A., Champoux, E., Whitfield, C., Trimble, D., Cowdery, J. E., Borgialli, D. A., Montas, S. M., et al. (2020) · Figshare · doi:10.6084/m9.figshare.12421772
Additional file 1 of Reach out behavioral intervention for hypertension initiated in the emergency department connecting multiple health systems: study protocol for a randomized control trial
Meurer, W. J., Dinh, M., Kidwell, K., Flood, A., Champoux, E., Whitfield, C., Trimble, D., Cowdery, J. E., Borgialli, D. A., Montas, S. M., et al. (2020) · Figshare · doi:10.6084/m9.figshare.12421745
Additional file 2 of Reach out behavioral intervention for hypertension initiated in the emergency department connecting multiple health systems: study protocol for a randomized control trial
Meurer, W. J., Dinh, M., Kidwell, K., Flood, A., Champoux, E., Whitfield, C., Trimble, D., Cowdery, J. E., Borgialli, D. A., Montas, S. M., et al. (2020) · Figshare · doi:10.6084/m9.figshare.12421757
Additional file 3 of Reach out behavioral intervention for hypertension initiated in the emergency department connecting multiple health systems: study protocol for a randomized control trial
Meurer, W. J., Dinh, M., Kidwell, K., Flood, A., Champoux, E., Whitfield, C., Trimble, D., Cowdery, J. E., Borgialli, D. A., Montas, S. M., et al. (2020) · Figshare · doi:10.6084/m9.figshare.12421763
Additional file 2 of Supporting adjuvant endocrine therapy adherence in women with breast cancer: the development of a complex behavioural intervention using Intervention Mapping guided by the Multiphase Optimisation Strategy
Green, S. M. C., French, D., Graham, C. D., Hall, L., Rousseau, N., Foy, R., Clark, J., Parbutt, C., Raine, E., Gardner, B., et al. (2022) · Figshare · doi:10.6084/m9.figshare.20619870
Additional file 6 of Reach out behavioral intervention for hypertension initiated in the emergency department connecting multiple health systems: study protocol for a randomized control trial
Meurer, W. J., Dinh, M., Kidwell, K., Flood, A., Champoux, E., Whitfield, C., Trimble, D., Cowdery, J. E., Borgialli, D. A., Montas, S. M., et al. (2020) · Figshare · doi:10.6084/m9.figshare.12421781
Additional file 1 of Supporting adjuvant endocrine therapy adherence in women with breast cancer: the development of a complex behavioural intervention using Intervention Mapping guided by the Multiphase Optimisation Strategy
Green, S. M. C., French, D., Graham, C. D., Hall, L., Rousseau, N., Foy, R., Clark, J., Parbutt, C., Raine, E., Gardner, B., et al. (2022) · Figshare · doi:10.6084/m9.figshare.20619867
Additional file 4 of Supporting adjuvant endocrine therapy adherence in women with breast cancer: the development of a complex behavioural intervention using Intervention Mapping guided by the Multiphase Optimisation Strategy
Green, S. M. C., French, D., Graham, C. D., Hall, L., Rousseau, N., Foy, R., Clark, J., Parbutt, C., Raine, E., Gardner, B., et al. (2022) · Figshare · doi:10.6084/m9.figshare.20619876
Effectiveness of school-based intervention in smoking reduction: A systematic review and synthesis without meta-analyses (SwiM)
Phuyal, S., & Khanal, A. (2025) · Population Medicine · doi:10.18332/popmed/216016
An App-Delivered Just-In-Time Adaptive Intervention for Gambling in Adults (GamblingLess: In-The-Moment): A Microrandomized Optimization Trial and Single-Arm Outcome Evaluation (Preprint)
Dowling, N. A., Merkouris, S., Greenwood, C. J., Youssef, G. J., Thomas, A. C., Hawker, C. O., Lubman, D. I., & Rodda, S. N. (2025) · Journal of Medical Internet Research · doi:10.2196/79852

A comparison of randomized trials and the multi-phase optimization strategy for behavioral interventions
Chakraborty, B., Collins, L. M., Murphy, S. A., Nair, V. N., & Strecher, V. J. (2005)
Self-citation
Evaluating behavioral interventions: need for randomized controlled trials
Gerber, A. R. (1994) · JAMA · doi:10.1001/jama.271.17.1317a · Cited by 3 · see citing works
The Multiphase Optimization Strategy for Developing and Evaluating Behavioral Interventions
Guastaferro, K., Shenk, C. E., & Collins, L. M. (2020) · Cambridge University Press eBooks · doi:10.1017/9781316995808.025 · Cited by 6 · see citing works
Self-citation
Pipelines for Designing, Evaluating, and Implementing Interventions
(2018) · Springer Publishing Company eBooks · doi:10.1891/9780826126597.0002
The Clinical Trial Method for Evaluating Behavioral Interventions
Ragland, D. R., & Brand, R. (1982) · Annals of Behavioral Medicine · doi:10.1093/abm/4.2.25

Authors: Collins, L. M., Chakraborty, B., Murphy, S. A., & Strecher, V.
Affiliations: Pennsylvania State University (US)
University of Michigan (US)
Corresponding author: Collins, Linda M
ORCID: Collins, Linda M
Chakraborty, Bibhas
Murphy, Susan A
Strecher, Victor
Venue: Clinical Trials
Publisher: SAGE Publications
Published: 2009-02
Volume: 6
Issue: 1
Pages: 5-15
ISSN: 1740-7745 (ISSN-L)
1740-7753
DOI: 10.1177/1740774508100973
PMC: PMC2711350
OpenAlex: W1985553578
Cited by: 80
References: 45
Citations by year: 2026: 1 · 2025: 4 · 2024: 2 · 2023: 2 · 2022: 10 · 2021: 2 · 2020: 13 · 2019: 3 · 2018: 7 · 2017: 3 · 2016: 4 · 2015: 4 · 2014: 9 · 2013: 7 · 2012: 4
FWCI: 2.47
Type: journal article
Language: en
Open access: green
www.ncbi.nlm.nih.gov
Licence: journals.sagepub.com/page/policies/text-and-data-mining-license (tdm)
Locations: Clinical Trials (publishedVersion)
PubMed (publishedVersion)
PubMed Central (acceptedVersion)
Funders: National Institute on Drug Abuse (K05DA018206, P50DA010075)
Topics: Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Clinical Trials
Health Sciences › Health Professions › General Health Professions › Health Policy Implementation Science
Physical Sciences › Mathematics › Statistics and Probability › Advanced Causal Inference Techniques
Keywords: intervention development, randomized controlled trials, intervention levels, computer simulation, intervention efficacy, effect size
MeSH terms: Behavior Therapy, Humans, Research Design, Effect Modifier, Epidemiologic, Randomized Controlled Trials as Topic, Sample Size

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Comparison of a phased experimental approach and a single randomized clinical trial for developing multicomponent behavioral interventions

Abstract

Integrity signals

Claims the paper makes

Claims other papers make about this one

Self-check

Cites

Cited by

Related

Record

About these checks