Implementing Clinical Research Using Factorial Designs: A Primer
Open accessThe DOI matches its Crossref record; 10 of the 10 references it cites were found in a registry or an index.
Abstract
Factorial experiments have rarely been used in the development or evaluation of clinical interventions. However, factorial designs offer advantages over randomized controlled trial designs, the latter being much more frequently used in such research. Factorial designs are highly efficient (permitting evaluation of multiple intervention components with good statistical power) and present the opportunity to detect interactions amongst intervention components. Such advantages have led methodologists to advocate for the greater use of factorial designs in research on clinical interventions (Collins, Dziak, & Li, 2009). However, researchers considering the use of such designs in clinical research face a series of choices that have consequential implications for the interpretability and value of the experimental results. These choices include: whether to use a factorial design, selection of the number and type of factors to include, how to address the compatibility of the different factors included, whether and how to avoid confounds between the type and number of interventions a participant receives, and how to interpret interactions. The use of factorial designs in clinical intervention research poses choices that differ from those typically considered in randomized clinical trial designs. However, the great information yield of the former encourages clinical researchers’ increased and careful execution of such designs.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Fisher, R. A. (1936) · BMJ · doi:10.1136/bmj.1.3923.554-a · Cited by 4,980
Brennan, R. L. (2001) · doi:10.1007/978-1-4757-3456-0 · Cited by 1,121
Collins, L. M., Murphy, S. A., & Strecher, V. (2007) · American Journal of Preventive Medicine · doi:10.1016/j.amepre.2007.01.022 · Cited by 1,082
Self-citationGlasgow, R. E., Klesges, L. M., Dzewaltowski, D. A., Bull, S. S., & Estabrooks, P. (2004) · Annals of Behavioral Medicine · doi:10.1207/s15324796abm2701_2 · Cited by 635
Collins, L. M., Dziak, J. J., & Li, R. (2009) · Psychological Methods · doi:10.1037/a0015826 · Cited by 431 · cited 8×
“Further, this problem is reduced if factorial designs are used as screening experiments, whose purpose is not to identify the single best combination of ICs (Collins et al., 2009).”
BackgroundMethodSelf-citationMoore, D., Aveyard, P., Connock, M., Wang, D., Fry-Smith, A., & Barton, P. (2009) · BMJ · doi:10.1136/bmj.b1024 · Cited by 372 · cited 1×
“In theory, smoking reduction should ultimately lead to quit attempts and greater quitting success (cf. Baker et al., 2011; Moore et al., 2009).”
BackgroundRapid, responsive, relevant (R3) research: a call for a rapid learning health research enterprise
Riley, W. T., Glasgow, R. E., Etheredge, L., & Abernethy, A. P. (2013) · Clinical and Translational Medicine · doi:10.1186/2001-1326-2-10 · Cited by 267
Hernández-López, M., Luciano, M. C., Bricker, J. B., Roales-Nieto, J. G., & Montesinos, F. (2009) · Psychology of Addictive Behaviors · doi:10.1037/a0017632 · Cited by 137
Collins, L. M., Trail, J. B., Kugler, K. C., Baker, T. B., Piper, M. E., & Mermelstein, R. J. (2014) · Translational Behavioral Medicine · doi:10.1007/s13142-013-0239-7 · Cited by 119 · cited 3×
“) Collins and her colleagues have proposed relatively straightforward steps for identifying promising components, steps that arise from engineering research and that prioritize main effects versus interactions (Collins et al., 2014).”
BackgroundSelf-citationDeveloping multicomponent interventions using fractional factorial designs
Chakraborty, B., Collins, L. M., Strecher, V. J., & Murphy, S. A. (2009) · Statistics in Medicine · doi:10.1002/sim.3643 · Cited by 107
Self-citation
Cited by
Kraepelien, M., Schibbye, R., Månsson, K., Sundström, C., Riggare, S., Andersson, G., Lindefors, N., Svenningsson, P., & Kaldo, V. (2020) · Journal of Parkinson's Disease · doi:10.3233/jpd-191894 · Cited by 41
“The intervention could probably be further optimized to consist of the right package of efficient components and type of support, possibly using factorial experiment [38].”
MethodWatkins, E., Newbold, A., Tester-Jones, M., Collins, L. M., & Mostazir, M. (2023) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2023.1937 · Cited by 40
Self-citationBerg, M., Rozental, A., de Brun Mangs, J., Näsman, M., Strömberg, K., Viberg, L., Wallner, E., Åhman, H., Silfvernagel, K., Zetterqvist, M., et al. (2020) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2020.00503 · Cited by 35
Metadata
- Authors
- Baker, T. B., Smith, S. S., Bolt, D. M., Loh, W.-Y., Mermelstein, R., Fiore, M. C., Piper, M. E., & Collins, L. M.
- Venue
- Behavior Therapy
- Publisher
- Elsevier BV
- Published
- 2017-07
- Volume
- 48
- Issue
- 4
- Pages
- 567-580
- ISSN
- 0005-7894 (ISSN-L)
- OpenAlex
- W2571197552
- Cited by
- 99
- References
- 10
- FWCI
- 5.47
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Implementing Clinical Research Using Factorial Designs: A Primer. https://app.cochat.ai/papers/10.1016/j.beth.2016.12.005
- The paper
- Baker, T. B., Smith, S. S., Bolt, D. M., Loh, W.-Y., Mermelstein, R., Fiore, M. C., Piper, M. E., & Collins, L. M. (2017). Implementing Clinical Research Using Factorial Designs: A Primer. Behavior Therapy. https://doi.org/10.1016/j.beth.2016.12.005
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.