Evaluating individual intervention components: Making decisions based on the results of a factorial screening experiment
Open accessAbstract
The multiphase optimization strategy (MOST) is a framework for not only evaluating but also optimizing behavioral interventions. A tool critical for MOST is the screening experiment, which enables efficient gathering of information for deciding which components to include in an optimized intervention. This article outlines a procedure for making decisions based on data from a factorial screening experiment. The decision making procedure is illustrated with artificial data generated to resemble empirical data. The illustration suggests that this approach is useful for selecting intervention components and settings based on the results of a factorial screening experiment. It is important to develop methods for making decisions based on factorial screening experiments. The approach demonstrated here is potentially useful, but has limited generalizability. Future research should develop additional decision making procedures for a variety of situations.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Conducting optimization trials before finalizing and testing the complete intervention is an approach to developing more effective interventions.
“One approach to developing interventions that are more effective is to conduct so-called optimization trials, that is, evaluating the effects of single-intervention components and their combinations (8), before finalizing and testing the complete intervention in a randomized controlled trial.”
From Which Components of a Smartphone Walking App Help Users to Reach Personalized Step Goals? Results From an Optimization Trial (2020) · cites this paper as [8]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Experimental Design: Procedures for the Behavioral Sciences
Kirk, R. (2013) · doi:10.4135/9781483384733 · Cited by 8,539 · see citing works
Fisher, R. A. (1936) · BMJ · doi:10.1136/bmj.1.3923.554-a · Cited by 4,980 · see citing works
Experiments - Planning, Analysis and Parameter Design Optimization
(2001) · Journal of Tropical Pediatrics · doi:10.1093/tropej/47.2.126 · Cited by 1,132 · see citing works
A Conceptual Framework for Adaptive Preventive Interventions
Collins, L. M., Murphy, S. A., & Bierman, K. L. (2004) · Prevention Science · doi:10.1023/b:prev.0000037641.26017.00 · Cited by 608 · see citing works
Self-citationExperiments: Planning, Analysis, and Parameter Design Optimization
Altland, H. W. (2001) · Technometrics · doi:10.1198/004017001316975952 · Cited by 538 · see citing works
Collins, L. M., Dziak, J. J., & Li, R. (2009) · Psychological Methods · doi:10.1037/a0015826 · Cited by 431 · see citing works
Self-citationThe Multiphase Optimization Strategy for Engineering Effective Tobacco Use Interventions
Collins, L. M., Baker, T. B., Mermelstein, R. J., Piper, M. E., Jorenby, D. E., Smith, S. S., Christiansen, B. A., Schlam, T. R., Cook, J. W., & Fiore, M. C. (2011) · Annals of Behavioral Medicine · doi:10.1007/s12160-010-9253-x · Cited by 300 · see citing works
Self-citationWeb-Based Smoking-Cessation Programs
Strecher, V. J., McClure, J. B., Alexander, G. L., Chakraborty, B., Nair, V. N., Konkel, J. M., Greene, S. M., Collins, L. M., Carlier, C. C., Wiese, C. J., et al. (2008) · American Journal of Preventive Medicine · doi:10.1016/j.amepre.2007.12.024 · Cited by 266 · see citing works
Self-citationNew Methods for Tobacco Dependence Treatment Research
Baker, T. B., Mermelstein, R. J., Collins, L. M., Piper, M. E., Jorenby, D. E., Smith, S. S., Christiansen, B. A., Schlam, T. R., Cook, J. W., & Fiore, M. C. (2010) · Annals of Behavioral Medicine · doi:10.1007/s12160-010-9252-y · Cited by 169 · see citing works
Self-citationThe Concise Oxford Dictionary of Mathematics
Clapham, C., & Nicholson, J. (2009) · Oxford University Press eBooks · doi:10.1093/acref/9780199235940.001.0001 · Cited by 147 · see citing works
Developing multicomponent interventions using fractional factorial designs
Chakraborty, B., Collins, L. M., Strecher, V. J., & Murphy, S. A. (2009) · Statistics in Medicine · doi:10.1002/sim.3643 · Cited by 107 · see citing works
Self-citationEffect magnitude: A different focus
Kirk, R. (2007) · Journal of Statistical Planning and Inference · doi:10.1016/j.jspi.2006.09.011 · Cited by 101 · see citing works
Collins, L. M., Chakraborty, B., Murphy, S. A., & Strecher, V. (2009) · Clinical Trials · doi:10.1177/1740774508100973 · Cited by 80 · see citing works
Self-citationSmith, E. A., Palen, L.-A., Caldwell, L. L., Flisher, A. J., Graham, J. W., Mathews, C., Wegner, L., & Vergnani, T. (2008) · Prevention Science · doi:10.1007/s11121-008-0103-z · Cited by 77 · see citing works
Translational research in South Africa: evaluating implementation quality using a factorial design
Caldwell, L. L., Smith, E. A., Collins, L. M., Graham, J. W., Lai, M., Wegner, L., Vergnani, T., Matthews, C., & Jacobs, J. (2012) · Child & Youth Care Forum · doi:10.1007/s10566-011-9164-4 · Cited by 50 · see citing works
Self-citationEffect coding versus dummy coding in analysis of data from factorial experiments
Kugler, K. C., Trail, J. B., Dziak, J. J., & Collins, L. M. (2012) · Cited by 36 · see citing works
Self-citation
Flagged first, then by citations
Cited by
Sorted by citations
Klasnja, P., Smith, S., Seewald, N. J., Lee, A., Hall, K., Luers, B., Hekler, E. B., & Murphy, S. A. (2019) · Annals of Behavioral Medicine · doi:10.1093/abm/kay067 · Cited by 241 · see citing works
Moller, A. C., Merchant, G., Conroy, D. E., West, R., Hekler, E., Kugler, K. C., & Michie, S. (2017) · Journal of Behavioral Medicine · doi:10.1007/s10865-016-9818-7 · Cited by 151 · see citing works
Self-citationKramer, J.-N., Künzler, F., Mishra, V., Smith, S. N., Kotz, D., Scholz, U., Fleisch, E., & Kowatsch, T. (2020) · Annals of Behavioral Medicine · doi:10.1093/abm/kaaa002 · Cited by 84 · see citing works
Riley, W. T., Serrano, K. J., Nilsen, W., & Atienza, A. A. (2015) · Current Opinion in Psychology · doi:10.1016/j.copsyc.2015.03.024 · Cited by 76 · see citing works
Conceptual Introduction to the Multiphase Optimization Strategy (MOST)
Collins, L. M. (2018) · Statistics for Social and Behavioral Sciences · doi:10.1007/978-3-319-72206-1_1 · Cited by 51 · see citing works
Self-citationWells, R. D., Guastaferro, K., Azuero, A., Rini, C., Hendricks, B. A., Dosse, C., Taylor, R., Williams, G. R., Engler, S., Smith, C., et al. (2021) · Journal of Pain and Symptom Management · doi:10.1016/j.jpainsymman.2020.11.017 · Cited by 28 · see citing works
Pellegrini, C. A., Hoffman, S. A., Collins, L. M., & Spring, B. (2015) · Contemporary Clinical Trials · doi:10.1016/j.cct.2015.09.001 · Cited by 16 · see citing works
Self-citation
- Authors
- Collins, L. M., Trail, J. B., Kugler, K. C., Baker, T. B., Piper, M. E., & Mermelstein, R. J.
- Affiliations
- Pennsylvania State University (US)
- University of Wisconsin–Madison (US)
- University of Illinois Chicago (US)
- Corresponding author
- Collins, Linda M
- Venue
- Translational Behavioral Medicine
- Publisher
- Oxford University Press (OUP)
- Published
- 2013-11-26
- Volume
- 4
- Issue
- 3
- Pages
- 238-251
- ISSN
- 1613-9860 (ISSN-L)
- 1869-6716
- PMC
- PMC4167900
- OpenAlex
- W2039433490
- Cited by
- 119
- References
- 16
- Citations by year
- 2026: 6 · 2025: 7 · 2024: 11 · 2023: 9 · 2022: 13 · 2021: 16 · 2020: 15 · 2019: 5 · 2018: 13 · 2017: 10 · 2016: 6 · 2015: 7 · 2014: 1
- FWCI
- 6.38
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Locations
- Translational Behavioral Medicine (publishedVersion)
- Europe PMC (PubMed Central) (publishedVersion)
- PubMed Central (publishedVersion)
- PubMed (publishedVersion)
- Funders
- National Institutes of Health
- National Institute on Drug Abuse (P50DA010075)
- National Cancer Institute (P50CA143188, P50CA143188-3, P01CA180945)
- Topics
- Social Sciences › Decision Sciences › Management Science and Operations Research › Optimal Experimental Design Methods
- Health Sciences › Health Professions › General Health Professions › Health Policy Implementation Science
- Social Sciences › Psychology › Applied Psychology › Behavioral Health and Interventions
- Keywords
- multiphase optimization strategy, decision-making, intervention settings, artificial data
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
