CoChat
Sign Up
Cited by 300Smoking Behavior and CessationHealth Policy Implementation ScienceBehavioral Health and Interventions

The Multiphase Optimization Strategy for Engineering Effective Tobacco Use Interventions

Open access
Collins, Linda M., Baker, Timothy B., Mermelstein, Robin J., Piper, Megan E., Jorenby, Douglas E., Smith, Stevens S., Christiansen, Bruce A., Schlam, Tanya R. +2 more·2011·Annals of Behavioral Medicine
DOI 10.1007/s12160-010-9253-xPMC PMC3053423
Open this paper in CoChat — free accountOpen PDF

Abstract

The multiphase optimization strategy (MOST) is a new methodological approach for building, optimizing, and evaluating multicomponent interventions. Conceptually rooted in engineering, MOST emphasizes efficiency and careful management of resources to move intervention science forward steadily and incrementally. MOST can be used to guide the evaluation of research evidence, develop an optimal intervention (the best set of intervention components), and enhance the translation of research findings, particularly type II translation. This article uses an ongoing study to illustrate the application of MOST in the evaluation of diverse intervention components derived from the phase-based framework reviewed in the companion article by Baker et al. (Ann Behav Med, in press, 2011). The article also discusses considerations, challenges, and potential benefits associated with using MOST and similar principled approaches to improving intervention efficacy, effectiveness, and cost-effectiveness. The applicability of this methodology may extend beyond smoking cessation to the development of behavioral interventions for other chronic health challenges.

Integrity signals

Registry

Crossref · 10.1007/s12160-010-9253-x

Cites

50 of 50 references verified0 citation errors · 0 not checkable

Statistics

Nothing to recompute.

Claims the paper makes

0 of 54 cited sources checked · 0 supported · 0 flagged

  • Findingown data

    A complete factorial experiment with six two-level factors would require N=512 subjects.

    “Table 2 shows that a factorial experiment examining the six intervention components of interest here would require only N=512 subjects, which is less than 20 percent of what is required by the individual experiments approach and less than 30 percent of what is required by the comparative treatment approach.”
    Quote in the paperSubstantial claim
  • Findingreasoning

    For six two-level factors, a factorial experiment needs 64 experimental conditions.

    “Table 2 shows that a factorial experiment with six two-level factors requires 64 experimental conditions (i.e., unique combinations of factors for a group of subjects).”
    Quote in the paperSubstantial claim
  • Findingreasoning

    The individual experiments approach would need six separate two-condition experiments, each with N=512, totaling N=3,072.

    “To maintain power each experiment would require N=512, for a total required sample size of N=3,072 across the six experiments.”
    Quote in the paperSubstantial claim
  • Findingreasoning

    The comparative treatment design would need seven experimental conditions and N=1,792 subjects to keep the same power as six separate experiments.

    “Thus the comparative treatment approach requires only seven experimental conditions, as opposed to a total of 12 conditions required by the individual experiments approach. To maintain the same level of power as conducting six separate experiments, the comparative treatment experiment would require N=1,792 subjects.”
    Quote in the paperSubstantial claim
  • Findingown data

    In our research, even the higher levels of phone and in-person cessation phase counseling examined are relatively brief and involve only a few contacts.

    “For instance, in our research, as described above, even the higher levels of phone and in-person cessation phase counseling examined are relatively brief and involve only a few contacts.”
    Quote in the paperSubstantial claim
  • May combine two claims. 33
  • Classified as probably not a substantial claim. 78

  • May combine two claims.

    Findingown data

    A factorial experiment with six components uses less than 20 percent of the sample size of individual experiments and less than 30 percent of the comparative treatment approach.

    “Table 2 shows that a factorial experiment examining the six intervention components of interest here would require only N=512 subjects, which is less than 20 percent of what is required by the individual experiments approach and less than 30 percent of what is required by the comparative treatment approach.”
    Quote in the paperSubstantial claim

  • Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing).

    Interpretationreasoning

    In intervention science, optimization is a process rather than a final endpoint.

    “Thus, in intervention science, optimization can be considered a process rather than an end goal per se.”
    Quote in the paperNot a substantial claim

  • Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

    Interpretationnone given

    MOST may apply beyond smoking cessation to behavioral interventions for other chronic health problems.

    “The applicability of this methodology may extend beyond smoking cessation to the development of behavioral interventions for other chronic health challenges.”
    Quote in the paperNot a substantial claim

  • Classified as probably not a substantial claim. May combine two claims.

    Interpretationnone given

    MOST can help evaluate research evidence, build an optimal intervention, and improve translation, especially Type II translation.

    “MOST can be used to guide the evaluation of research evidence, develop an optimal intervention (the best set of intervention components), and enhance the translation of research findings, particularly Type II translation.”
    Quote in the paperSubstantial claim

  • Classified as probably not a substantial claim.

    Premisecitation

    Baker et al.'s framework divides cessation into four phases: motivation, precessation, cessation, and maintenance.

    “Briefly, the Baker et al. framework partitions the cessation process into four discrete phases based on current theories of cessation and empirical data: (a) motivation, (b) precessation, (c) cessation, and (d) maintenance.”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites Baker et al. (1) Baker TB, Mermelstein R, Collins LM, et al. New methods for tobacco dependence treatment research. Ann Behav Med. 2011; in press. source

      Not checked in the free run.

  • Classified as probably not a substantial claim.

    Interpretationnone given

    MOST stresses efficiency and careful resource management to advance intervention science steadily and incrementally.

    “Conceptually rooted in engineering, MOST emphasizes efficiency and careful management of resources to move intervention science forward steadily and incrementally.”
    Quote in the paperSubstantial claim

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    In smoking cessation, it is common to combine behavioral and pharmacotherapy treatments into multicomponent interventions.

    “Multicomponent interventions that combine various behavioral and pharmacotherapy treatments are common in smoking cessation (e.g. (2, 3)).”
    Quote in the paperNot a substantial claim0 of 2 sources checked
    • cites [2] Fiore MC, Bailey WC, Cohen SJ. Treating tobacco use and dependence: Clinical practice guideline. Rockville: U.S. Department of Health and Human Services, U.S. Public Health Service; 2000.

      Not checked in the free run.

    • cites [3] Fiore MC, Jaen CR, Baker TB, et al. Treating tobacco use and dependence: 2008 update. Rockville: U.S. Department of Health and Human Services, U.S. Public Health Service; 2008.

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S4 (based). May combine two claims.

    Interpretationreasoning

    MOST can make Type II translational research more efficient and more common.

    “We see MOST as a means of making Type II translational research more efficient and, we hope, more common.”
    Quote in the paperNot a substantial claim

  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Interpretationreasoning

    Components that performed satisfactorily can be retained for future inclusion and generally do not need to be re-examined.

    “Any components that performed satisfactorily can be retained for future inclusion in the intervention, and in general do not need to be re-examined in the new experimentation and refinement steps.”
    Quote in the paperNot a substantial claim

  • Classified as probably not a substantial claim.

    Premisecitation

    In manufacturing and product development, theory often suggests many component parts that can be combined into many alternative prototypes.

    “In manufacturing and product development, theory often suggests many different component parts or materials that could be used, which could then be combined to form many alternative “draft” versions of the product, or prototypes, that could be built and tested.”
    Quote in the paperSubstantial claim0 of 2 sources checked
    • cites [11] Box GEP, Hunter, W.G., & Hunter, J.S. Statistics for experimenters: An introduction to design, data analysis, and model building. New York: Wiley; 1978.

      Not checked in the free run.

    • cites [12] Wu CF, Hamada M. Experiments: Planning, analysis, and parameter design optimization. New York: Wiley; 2000.

      Not checked in the free run.

  • Classified as probably not a substantial claim.

    Premisereasoning

    The main effect of precessation counseling is based on comparing the mean of conditions with counseling to the mean of conditions without counseling.

    “Similarly, the main effect of precessation counseling will be based on a comparison of the mean of the conditions in which precessation counseling is provided (conditions 1–4, 9–12, 17–20, and 25–28 in Table 4) to the mean of the conditions in which precessation counseling is not provided (conditions 5–8, 13–16, 21–24, and 29–32).”
    Quote in the paperSubstantial claim

  • Classified as probably not a substantial claim.

    Interpretationnone given

    Factorial experiments allow estimation of interactions between factors.

    “Another attractive property of factorial experiments is that they enable estimation of interactions between factors.”
    Quote in the paperSubstantial claim

  • May combine two claims.

    Interpretationcitation

    In individual experiments and comparative treatment designs, interactions among treatment components cannot be estimated, although such interactions exist and may affect results.

    “A key limitation to both the individual experiments and comparative treatment approaches is that interactions among treatment components cannot be estimated, even though these interactions remain present (33) and potentially have an impact on the results.”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites [33] Collins LM, Dziak JJ, Li R. Design of experiments with multiple independent variables: A resource management perspective on complete and reduced factorial designs. Psychol Methods. 2009;14(3):202–24. source

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisereasoning

    The continuous optimization principle says a new research cycle should start as soon as the prior development round ends.

    “The second principle, the continuous optimization principle, states that a new cycle of research should begin as soon as the previous round of development research is concluded, in order to build on previous work and make further incremental improvements.”
    Quote in the paperNot a substantial claim

  • Probably not a substantial claim: may not pass S2 (checkable). May combine two claims.

    Interpretationnone given

    The experimental design chosen should separate component effects and be highly efficient.

    “In general, the experimental design chosen should possess two signature characteristics. First, it must separate component effects, enabling estimation of the contribution of each component. Second, it must husband time and research resources—in other words, it must be highly efficient.”
    Quote in the paperNot a substantial claim

  • May combine two claims.

    Interpretationreasoning

    A phased experimental approach will speed progress in building better smoking cessation interventions while making the most of research resources.

    “We believe that just as it has hastened product development in other fields, a phased experimental approach will hasten progress in building better smoking cessation interventions, while making the most of research resources.”
    Quote in the paperNot a substantial claim

  • Classified as probably not a substantial claim. May combine two claims.

    Premisecitation

    According to these authors, successful translation of smoking cessation interventions depends on three criteria: ease of delivery, effectiveness in real-world settings, and compatibility and integration with real-world delivery systems.

    “According to these authors successful translation of smoking cessation interventions depends upon three criteria: (a) ease of delivery; (b) effectiveness in real-world settings; and (c) compatibility and integration with real-world delivery systems.”
    Quote in the paperSubstantial claim0 of 5 sources checked
    • cites [3] Fiore MC, Jaen CR, Baker TB, et al. Treating tobacco use and dependence: 2008 update. Rockville: U.S. Department of Health and Human Services, U.S. Public Health Service; 2008.

      Not checked in the free run.

    • cites [40] Carroll KM, Rounsaville BJ. Bridging the gap: A hybrid model to link efficacy and effectiveness research in substance abuse treatment. Psychiatr Serv. 2003;54(3):333–9. source

      Not checked in the free run.

    • cites [41] Carroll KM, Rounsaville BJ. A vision of the next generation of behavioral therapies research in the addictions. Addiction. 2007;102(6):850–62; discussion 63–9. source

      Not checked in the free run.

    • cites [42] Hopkins DP, Briss PA, Ricard CJ, et al. Reviews of evidence regarding interventions to reduce tobacco use and exposure to environmental tobacco smoke. Am J Prev Med. 2001;20(2 Suppl):16–66. source

      Not checked in the free run.

    • cites [43] Hopkins DP, Husten CG, Fielding JE, Rosenquist JN, Westphal LL. Evidence reviews and recommendations on interventions to reduce tobacco use and exposure to environmental tobacco smoke: A summary of selected guidelines. Am J Prev Med. 2001;20(2 Suppl):67–87. source

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S2 (checkable).

    Premisenone given

    The resource management principle holds that research resources should be managed strategically to gain the most and most reliable information and to advance science fastest.

    “According to the first, the resource management principle, available research resources must be managed strategically so as to gain the most information and the most reliable information, and thereby move science forward fastest.”
    Quote in the paperNot a substantial claim

  • May combine two claims.

    Premisereasoning

    A programmatic and sequenced experimental approach lets product development progress faster while conserving research resources.

    “Taking a programmatic and sequenced experimental approach enables product development to make faster progress while husbanding research resources.”
    Quote in the paperSubstantial claim0 of 2 sources checked
    • cites [11] Box GEP, Hunter, W.G., & Hunter, J.S. Statistics for experimenters: An introduction to design, data analysis, and model building. New York: Wiley; 1978.

      Not checked in the free run.

    • cites [12] Wu CF, Hamada M. Experiments: Planning, analysis, and parameter design optimization. New York: Wiley; 2000.

      Not checked in the free run.

  • May combine two claims.

    Study design and conductreasoning

    In the chosen design, each main effect is aliased with a five-way interaction, and each two-way interaction is aliased with a four-way interaction.

    “Each main effect is aliased with a five-way interaction, and each two-way interaction is aliased with a four-way interaction.”
    Quote in the paperSubstantial claim
    • The authors state this as an assumption: Using fractional factorial designs requires assuming that most higher-order interactions (three or more factors) are in Category B (likely negligible).

  • Classified as probably not a substantial claim.

    Interpretationreasoning

    The research described here is meant to produce unique information: estimates of individual component effects in a real-world effectiveness setting.

    “It is important to recognize that although these intervention components have been analyzed previously in clinical trials, the research described here is intended to produce unique information on these components, i.e., estimates of individual component effects in a real-world effectiveness setting.”
    Quote in the paperSubstantial claim
    • Rests on an assumption: Prior research does not directly provide estimates of individual component effects in a real-world effectiveness setting.

  • Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing). May combine two claims.

    Interpretationreasoning

    Returning to the beginning represents a continuation of incremental progress, and previously completed work provides a foundation for further progress.

    “This return to the beginning represents a continuation of incremental progress toward a successful intervention. The previously completed work is not wasted; on the contrary, it provides a firm foundation for further progress.”
    Quote in the paperNot a substantial claim

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premiseown data

    A fractional factorial experiment with six factors requires between 8 and 32 experimental conditions depending on the design chosen.

    “Table 2 shows that depending on the design chosen, a fractional factorial experiment with six factors requires anywhere from eight to 32 experimental conditions.”
    Quote in the paperNot a substantial claim

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisenone given

    Previous steps of MOST are aimed at selecting intervention components that are feasible, effective, and cost-effective.

    “The previous steps of MOST have been aimed at selection of intervention components that are feasible, effective, and cost-effective.”
    Quote in the paperNot a substantial claim

  • Classified as probably not a substantial claim.

    Premisecitation

    Several authors have suggested that translation of research findings into real-world interventions could be hastened by a strategy that builds translation potential into initial treatment evaluation.

    “Several authors (e.g., (3, 40–43)) have suggested that the process of translating research findings into real-world interventions could be hastened through the use of a strategy that builds translation potential into initial treatment evaluation.”
    Quote in the paperSubstantial claim0 of 5 sources checked
    • cites [3] Fiore MC, Jaen CR, Baker TB, et al. Treating tobacco use and dependence: 2008 update. Rockville: U.S. Department of Health and Human Services, U.S. Public Health Service; 2008.

      Not checked in the free run.

    • cites [40] Carroll KM, Rounsaville BJ. Bridging the gap: A hybrid model to link efficacy and effectiveness research in substance abuse treatment. Psychiatr Serv. 2003;54(3):333–9. source

      Not checked in the free run.

    • cites [41] Carroll KM, Rounsaville BJ. A vision of the next generation of behavioral therapies research in the addictions. Addiction. 2007;102(6):850–62; discussion 63–9. source

      Not checked in the free run.

    • cites [42] Hopkins DP, Briss PA, Ricard CJ, et al. Reviews of evidence regarding interventions to reduce tobacco use and exposure to environmental tobacco smoke. Am J Prev Med. 2001;20(2 Suppl):16–66. source

      Not checked in the free run.

    • cites [43] Hopkins DP, Husten CG, Fielding JE, Rosenquist JN, Westphal LL. Evidence reviews and recommendations on interventions to reduce tobacco use and exposure to environmental tobacco smoke: A summary of selected guidelines. Am J Prev Med. 2001;20(2 Suppl):67–87. source

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisenone given

    Usually selected two-factor interactions, and for some studies a three-factor interaction, are placed in Category A.

    “Usually, selected two-factor interactions, and for some studies a three-factor interaction, are placed in Category A as well.”
    Quote in the paperNot a substantial claim

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisereasoning

    The centralized database is cumulative, so as MOST is repeated, more data are acquired, archived, and made available for analysis.

    “This database is cumulative, so that as the MOST procedure is repeated (as the continuous optimization principle suggests), more data are acquired, archived, and made available for analysis.”
    Quote in the paperNot a substantial claim

  • Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

    Premisenone given

    In every fractional factorial experiment, all main effects are primary targets and are placed in Category A.

    “It is a given in every fractional factorial experiment that all the main effects are primary targets of the experiment and are therefore in Category A.”
    Quote in the paperNot a substantial claim

  • May combine two claims.

    Premisenone given

    Fractional factorial designs have the same statistical power as complete factorial experiments and require the same number of subjects.

    “These designs have the same statistical power as a complete factorial experiment, and therefore require the same number of subjects.”
    Quote in the paperNot a substantial claim

  • May combine two claims.

    Interpretationreasoning

    MOST uses clinical experience, informal hypotheses, and post-hoc nonexperimental analyses to inform randomized experiments that give definitive answers about each component's performance.

    “In contrast, MOST calls for using this kind of information to inform randomized experimentation designed to provide definitive answers about the performance of each component.”
    Quote in the paperSubstantial claim
    • Rests on an assumption: The traditional approach to choosing intervention components and levels relies solely on clinical experience, informal hypotheses, and post-hoc nonexperimental analyses.

  • May combine two claims.

    Premisecitation

    Aliasing is also present in individual experiments and comparative treatment designs; only complete factorial experiments are free of aliasing.

    “(Aliasing is also present in individual experiments and comparative treatment designs; see Collins, Dziak and Li (33). Only complete factorial experiments are free of aliasing.)”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Collins, Dziak and Li (33) Collins LM, Dziak JJ, Li R. Design of experiments with multiple independent variables: A resource management perspective on complete and reduced factorial designs. Psychol Methods. 2009;14(3):202–24. source

      Not checked in the free run.

  • Classified as probably not a substantial claim.

    Interpretationreasoning

    A comparative treatment design with N=512 would have a control group plus six experimental conditions, roughly 73 subjects per condition.

    “By contrast, suppose we had used a comparative treatment design with N=512. This design would have a control group plus six experimental conditions, one corresponding to each intervention component; there would be roughly 73 subjects assigned to each condition.”
    Quote in the paperSubstantial claim

  • May combine two claims.

    Interpretationreasoning

    These conditions are expendable because the purpose is to examine the effect of each of the six components, not to evaluate a treatment package as a whole.

    “Although it may seem counterintuitive, these conditions are expendable in this design because the purpose is to examine the effect of each of the six components, not to evaluate a treatment package as a whole.”
    Quote in the paperSubstantial claim

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisereasoning

    The more economy a fractional factorial design provides, the more aliasing of effects it requires.

    “In general, the more economy that is afforded by a fractional factorial design, the more aliasing of effects is required.”
    Quote in the paperNot a substantial claim

  • Probably not a substantial claim: may not pass S2 (checkable).

    Interpretationcitation

    Methods from engineering, manufacturing, and product development can serve as a blueprint for efficient and programmatic smoking cessation research.

    “We suggest turning to research methods developed for fields such as engineering, manufacturing, and product development (e.g. (11, 12)) to provide a blueprint for efficient and programmatic smoking cessation research.”
    Quote in the paperNot a substantial claim0 of 2 sources checked
    • cites [11] Box GEP, Hunter, W.G., & Hunter, J.S. Statistics for experimenters: An introduction to design, data analysis, and model building. New York: Wiley; 1978.

      Not checked in the free run.

    • cites [12] Wu CF, Hamada M. Experiments: Planning, analysis, and parameter design optimization. New York: Wiley; 2000.

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisereasoning

    In fractional factorial designs, certain effects cannot be disentangled from other effects, a phenomenon called aliasing.

    “The trade-off presented by fractional factorial designs is that certain effects cannot be disentangled from other effects.”
    Quote in the paperNot a substantial claim

  • May combine two claims.

    Study design and conductreasoning

    The fractional factorial design in Table 4 does not contain a traditional control condition with all factors at the lower level, nor a full condition with all factors at the higher level.

    “Like many fractional factorial designs, it does not contain a traditional control condition in which each factor is set to the lower level. It also does not contain a “full” experimental condition in which each treatment factor is set to the higher level.”
    Quote in the paperSubstantial claim

  • Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

    Premisenone given

    In a two-arm RCT, half the participants are assigned to the control group.

    “By contrast, in a two-arm RCT half the participants are assigned to the control group.”
    Quote in the paperNot a substantial claim

  • Classified as probably not a substantial claim.

    Premisereasoning

    The main effect of precessation nicotine patch is based on comparing the mean of conditions with patch to the mean of conditions without patch.

    “For example, the main effect of precessation nicotine patch will be based on a comparison of the mean of the conditions in which the patch is given (conditions 1–16 in Table 4) to the mean of the conditions in which the patch is not given (conditions 17–32).”
    Quote in the paperSubstantial claim

  • May combine two claims.

    Premisecitation

    The phase-based framework and dependence theories suggest intervention components and phase-specific outcomes.

    “As discussed in the Baker et al.(1) companion paper, the phase-based framework, in concert with dependence theories, not only suggests intervention components, it also suggests the use of phase-specific outcomes.”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites Baker et al.(1) Baker TB, Mermelstein R, Collins LM, et al. New methods for tobacco dependence treatment research. Ann Behav Med. 2011; in press. source

      Not checked in the free run.

  • May combine two claims.

    Interpretationcitation

    MOST uses the resource management and continuous optimization principles to improve smoking cessation research efficiency and intervention effectiveness and cost-effectiveness.

    “MOST (4, 5), which has some conceptual roots in the phased approach to intervention development and evaluation proposed by the United Kingdom’s Medical Research Council (14, 15) applies the resource management and continuous optimization principles to improve the efficiency of smoking cessation research and the effectiveness and cost-effectiveness of smoking cessation interventions.”
    Quote in the paperSubstantial claim0 of 4 sources checked
    • cites [4] Collins LM, Murphy SA, Nair VN, Strecher VJ. A strategy for optimizing and evaluating behavioral interventions. Ann Behav Med. 2005;30(1):65–73. source

      Not checked in the free run.

    • cites [5] Collins LM, Murphy SA, Strecher V. The Multiphase Optimization Strategy (MOST) and the Sequential Multiple Assignment Randomized Trial (SMART): New methods for more potent eHealth interventions. Am J Prev Med. 2007;32(5 Suppl):S112–8. source

      Not checked in the free run.

    • cites [14] Campbell MK, Mollison J, Steen N, Grimshaw JM, Eccles M. Analysis of cluster randomized trials in primary care: A practical approach. Fam Pract. 2000;17(2):192–6. source

      Not checked in the free run.

    • cites [15] Craig P, Dieppe P, Macintyre S, Michie S, Nazareth I, Petticrew M. Developing and evaluating complex interventions: The new Medical Research Council guidance. BMJ. 2008;337:a1655. source

      Not checked in the free run.

  • Classified as probably not a substantial claim. May combine two claims.

    Interpretationreasoning

    This will facilitate release of the intervention package and its incorporation into regular clinical practice.

    “This will facilitate the release of this intervention package and its incorporation into regular clinical practice.”
    Quote in the paperSubstantial claim

  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Premisereasoning

    Because any fractional factorial design's aliasing can be readily determined, the investigator can choose strategically among available designs.

    “Because any fractional factorial design’s aliasing can be readily determined, the investigator can choose strategically from among the wide variety of available fractional factorial designs.”
    Quote in the paperNot a substantial claim

  • May combine two claims.

    Premisereasoning

    Fractional factorial designs require fewer experimental conditions, making them more economical and easier to implement.

    “However, they require fewer experimental conditions, and thus are more economical and easier to implement.”
    Quote in the paperNot a substantial claim

  • Classified as probably not a substantial claim.

    Interpretationreasoning

    Weighing efficacy or effectiveness against cost can play an important role in selecting intervention components and levels.

    “Weighing efficacy or effectiveness against cost can play an important role in selecting intervention components and levels of components.”
    Quote in the paperSubstantial claim

  • Classified as probably not a substantial claim.

    Premisereasoning

    Different experimental designs address subtly different research questions.

    “Different experimental designs address subtly different research questions.”
    Quote in the paperSubstantial claim

  • Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing).

    Premisereasoning

    Efficacy and effectiveness research are not mutually exclusive.

    “Of course, efficacy and effectiveness research are not mutually exclusive.”
    Quote in the paperNot a substantial claim

  • Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based). May combine two claims.

    Premisenone given

    In some fields it may be possible to measure outcomes of ultimate interest soon after the intervention, whereas in others it may be necessary to wait months or even years.

    “As discussed above, in some fields it may be possible to measure outcomes of ultimate interest soon after the intervention, whereas in others it may be necessary to wait months or even years.”
    Quote in the paperNot a substantial claim

  • Probably not a substantial claim: may not pass S2 (checkable), S4 (based).

    Interpretationreasoning

    Because MOST is a principled and systematic approach to improving smoking cessation interventions, it is likely to be the fastest and most direct way to more effective smoking cessation in the long run.

    “First, because this is a principled and systematic approach to improving smoking cessation interventions, it is likely to be the fastest and most direct way to more effective smoking cessation in the long run.”
    Quote in the paperNot a substantial claim

  • Probably not a substantial claim: may not pass S2 (checkable).

    Interpretationreasoning

    If research to optimize smoking cessation interventions in real-world contexts is to be successful and yield broadly generalizable effects, the relation between intervention elements and the real-world context must be broadly applicable, feasible, and effective.

    “If research to optimize smoking cessation interventions in real-world contexts is to be successful and yield broadly generalizable effects, then the relation between the intervention elements and the real-world context (e.g., a health care program) must be broadly applicable, feasible, and effective.”
    Quote in the paperNot a substantial claim

  • Probably not a substantial claim: may not pass S4 (based).

    Premisenone given

    A key feature of MOST is that each new intervention produced will have been engineered, and empirically demonstrated, to be an improvement over the previous version.

    “A key feature of MOST is that each new intervention produced will have been engineered, and empirically demonstrated, to be an improvement over the previous version.”
    Quote in the paperNot a substantial claim

  • Classified as probably not a substantial claim.

    Premisenone given

    MOST provides a straightforward method to test hypotheses about new intervention components or the revision of existing components as they are suggested by emerging new scientific findings, technologies, counseling approaches or pharmaceuticals.

    “Second, this approach provides a straightforward method to test hypotheses about new intervention components or the revision of existing components as they are suggested by emerging new scientific findings, technologies, counseling approaches or pharmaceuticals.”
    Quote in the paperSubstantial claim

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Interpretationreasoning

    This may make it impossible for an applicant to be specific about downstream elements of the proposed research.

    “This may make it impossible for an applicant to be specific about downstream elements of the proposed research.”
    Quote in the paperNot a substantial claim

  • Classified as probably not a substantial claim.

    Interpretationcitation

    Feasibility of system features can be assessed by gathering input from targeted participants, consumers, and providers during intervention and research program development.

    “This feasibility can be assessed by gathering input from targeted participants, consumers, and providers during intervention and research program development (44).”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites [44] Glasgow RE, Klesges LM, Dzewaltowski DA, Bull SS, Estabrooks P. The future of health behavior change research: What is needed to improve translation of research into health promotion practice? Ann Behav Med. 2004;27(1):3–12. source

      Not checked in the free run.

  • Classified as probably not a substantial claim.

    Premisereasoning

    The efficacy or effectiveness of each intervention component can be viewed in relation to its cost in terms of money, time, logistics, training, or other resources.

    “The efficacy or effectiveness of each intervention component can be viewed in relation to its cost in terms of money, length of time required, implementation logistics, amount of training required, or other resources.”
    Quote in the paperSubstantial claim

  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Premisecitation

    Recent methodological work on adaptive interventions includes development of the SMART Trial and exploration of applying engineering control algorithms to adaptive behavioral interventions.

    “Recent methodological work on building and optimizing adaptive interventions has included development of the Sequential Multiple Assignment Randomized Trial (SMART Trial) (58) and exploration of the idea of applying control algorithms from engineering to adaptive behavioral interventions to improve their performance (38, 39).”
    Quote in the paperNot a substantial claim0 of 3 sources checked
    • cites [58] Murphy SA, Lynch KG, Oslin D, McKay JR, TenHave T. Developing adaptive treatment strategies in substance abuse research. Drug Alcohol Depend. 2007;88 Suppl 2:S24–30. source

      Not checked in the free run.

    • cites [38] Rivera DE, Pew MD, Collins LM. Using engineering control principles to inform the design of adaptive interventions: A conceptual introduction. Drug Alcohol Depend. 2007;88 Suppl 2:S31–40. source

      Not checked in the free run.

    • cites [39] Zafra-Cabeza A, Rivera DE, Collins LM, Riado MA, Camacho EF. A risk-based model predictive control approach to adaptive interventions in behavioral health. Proceedings of the 45th IEEE Conference on Decision and Control. 2006:673–8. source

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Interpretationreasoning

    As long as the resource management principle is followed, MOST can be used to make incremental progress in intervention optimization even with limited resources.

    “As long as the resource management principle is followed, MOST can be used to make incremental progress in intervention optimization, even with limited resources.”
    Quote in the paperNot a substantial claim

  • Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

    Interpretationnone given

    Careful planning, well-trained staff, and creative use of computers and the Internet can greatly increase the feasibility of implementing a large number of experimental conditions in field settings.

    “Careful planning, well-trained staff, and creative use of computers and the Internet can greatly increase the feasibility of implementing a large number of experimental conditions in field settings.”
    Quote in the paperNot a substantial claim

  • Probably not a substantial claim: may not pass S4 (based).

    Interpretationnone given

    In some areas, an RCT will take a long time.

    “In some areas, an RCT will take a long time.”
    Quote in the paperNot a substantial claim

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Interpretationreasoning

    For applications of MOST involving a large factorial experiment, implementing the experiment in the field may be a challenge.

    “For applications of MOST that involve a large factorial experiment, one challenge may be implementing this experiment in the field.”
    Quote in the paperNot a substantial claim

  • Probably not a substantial claim: may not pass S2 (checkable).

    Interpretationreasoning

    The MOST framework offers several benefits over other approaches in common use.

    “We believe that the MOST framework offers several benefits over other approaches in common use.”
    Quote in the paperNot a substantial claim

  • Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

    Interpretationnone given

    The model in our research could easily be transitioned to one in which medical assistants continue to recruit smokers but refer them to health counselors or chronic disease management staff who provide the cessation intervention.

    “This model could easily be transitioned to one in which medical assistants continue to recruit smokers but then refer them to health counselors or chronic disease management staff who then provide the specific cessation intervention.”
    Quote in the paperNot a substantial claim

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisereasoning

    MOST does not require any particular design approach, only that the resource management principle be followed in selecting a design.

    “MOST does not require that any particular design approach be used, only that the resource management principle be followed in selecting a design.”
    Quote in the paperNot a substantial claim

  • Probably not a substantial claim: may not pass S2 (checkable), S4 (based).

    Interpretationnone given

    To a great extent, any intervention research conducted in real-world settings simultaneously tests the interventions and the real-world contexts in which the interventions are embedded.

    “The vital point is that to a great extent, any intervention research conducted in real-world settings simultaneously tests the interventions and the real-world contexts in which the interventions are embedded.”
    Quote in the paperNot a substantial claim

  • Classified as probably not a substantial claim.

    Premisenone given

    The analyses leading up to assembling the beta version are primarily used for making decisions about which components and levels to include.

    “However, the analyses that lead up to assembling the beta version of the intervention are primarily used for making decisions about which components and levels to include in the beta version of the intervention.”
    Quote in the paperSubstantial claim

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Interpretationreasoning

    Sometimes decisions about components and levels may require trade-offs between outcomes.

    “Sometimes these decisions may require trade-offs between outcomes (for example, if a component looks relatively strong in terms of one outcome measure but not in another, then the investigator will be forced to choose which outcome is more important).”
    Quote in the paperNot a substantial claim

  • May combine two claims.

    Interpretationreasoning

    Blurring efficacy and effectiveness research may have costs, such as missing the true optimal effects of intensive and complex assessments and components, with negative theoretical and clinical consequences.

    “The blurring of efficacy and effectiveness research may have some costs. For instance, very intensive and complex assessments and intervention components would not be tested under ideal circumstances, and thus their true optimal effects would be missed. This could have negative theoretical as well as clinical consequences.”
    Quote in the paperSubstantial claim

  • Classified as probably not a substantial claim.

    Interpretationreasoning

    In the confirmation step, the RCT is usually the most efficient and appropriate design.

    “Here the RCT is usually the most efficient and appropriate design.”
    Quote in the paperSubstantial claim

  • Classified as probably not a substantial claim.

    Premisenone given

    In the experimentation step of MOST, research questions concern the effects of individual intervention components.

    “In the experimentation step of MOST (Step 3) the research questions are concerned with the effects of individual intervention components.”
    Quote in the paperSubstantial claim

  • May combine two claims.

    Interpretationreasoning

    When used in concert, various types of experiments can address a comprehensive set of research questions and produce information bearing on increasing public health impact.

    “When used in concert, as they are in MOST, the various types of experiments can address a comprehensive set of research questions and produce information that bears directly on increasing the public health impact of behavioral interventions.”
    Quote in the paperSubstantial claim

  • Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing).

    Premisereasoning

    Research goals may foster a mix of real-world and research features and mechanisms.

    “Research goals may foster a mix of real-world and research features and mechanisms”
    Quote in the paperNot a substantial claim

  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Interpretationreasoning

    MOST can be used to update interventions periodically to incorporate new approaches or innovations while ensuring that the changes made do not erode effectiveness.

    “MOST can also be used to update interventions periodically to incorporate new approaches or innovations while ensuring that the changes made do not erode effectiveness.”
    Quote in the paperNot a substantial claim

  • Probably not a substantial claim: may not pass S2 (checkable), S4 (based).

    Interpretationnone given

    The resource management principle, when properly and consistently applied, can increase the yield of scientific information from research and thereby hasten the progress of knowledge acquisition.

    “The resource management principle, when properly and consistently applied, can increase the yield of scientific information from research and thereby hasten the progress of knowledge acquisition.”
    Quote in the paperNot a substantial claim

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisenone given

    In the confirmation step of MOST, the primary research question concerns evaluating the effectiveness of the beta version of the intervention compared to a control group.

    “By contrast, in the confirmation step of MOST (Step 5) the primary research question concerns evaluating the effectiveness of the beta version of the intervention as compared to a control group.”
    Quote in the paperNot a substantial claim

  • Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing). May combine two claims.

    Interpretationreasoning

    Various contingencies may be listed in an application up to a point, but there may be too many alternatives to include them all within a reasonable page limit.

    “Various contingencies may be listed in an application up to a point, but there may be too many alternatives to include them all within a reasonable page limit.”
    Quote in the paperNot a substantial claim

  • Probably not a substantial claim: may not pass S2 (checkable). May combine two claims.

    Interpretationcitation

    Functions such as smoker identification, tracking, intervention delivery, and appraisals of outcomes must be translatable.

    “That is, functions such as smoker identification, tracking, intervention delivery, appraisals of outcomes, and so on, must be translatable”
    Quote in the paperNot a substantial claim

  • Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing). May combine two claims.

    Interpretationreasoning

    There remains a role for efficacy research where the theoretical value of an experiment is high or where the intervention is not intended for widespread dissemination.

    “Thus, there remains a role for efficacy research in those cases where the theoretical value of an experiment is high, or where the intervention is not intended for widespread dissemination.”
    Quote in the paperNot a substantial claim

  • Probably not a substantial claim: may not pass S4 (based).

    Premisenone given

    Often decisions concerning components and levels must be made based on multiple outcome variables.

    “Often decisions concerning components and levels must be made based on multiple outcome variables.”
    Quote in the paperNot a substantial claim

  • Classified as probably not a substantial claim.

    Interpretationreasoning

    The system features in which research is embedded are major determinants of the likely translation potential of the research.

    “In other words, the system features in which the research is embedded are major determinants of the likely translation potential of the research.”
    Quote in the paperSubstantial claim

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Interpretationreasoning

    Whether a full cycle of MOST can be completed within five years depends on factors such as investigator experience, recruitment and retention speed, and expected experimentation duration.

    “This depends on many factors, such as how experienced the investigators are with the MOST approach; how quickly study participants can be recruited and how well they can be retained; and how long the experimentation is expected to take.”
    Quote in the paperNot a substantial claim

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisereasoning

    Because MOST often requires sequential decision making, the details of the approach in one step may depend on outcomes of previous steps.

    “Second, because MOST often requires sequential decision making, the details of the approach to be used in one step may be dependent on the outcomes of previous steps.”
    Quote in the paperNot a substantial claim

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    The three features described do not exhaust all the steps needed to effect Type II translation.

    “The three features described above certainly do not exhaust all the steps needed to effect Type II translation.”
    Quote in the paperNot a substantial claim

  • May combine two claims.

    Interpretationreasoning

    The approach proposed in this paper will not only improve clinical smoking cessation treatment, but will further the understanding of its underlying mechanisms.

    “Thus the approach proposed in this paper will not only improve clinical smoking cessation treatment, but will further the understanding of its underlying mechanisms.”
    Quote in the paperSubstantial claim

  • May combine two claims.

    Study design and conductnone given

    The fractional factorial design selected has the same statistical power as the corresponding complete factorial design while requiring half the experimental conditions.

    “The fractional factorial design we selected has the same statistical power as the corresponding complete factorial design, while requiring only half the experimental conditions.”
    Quote in the paperNot a substantial claim

  • Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing), S4 (based).

    Interpretationnone given

    These approaches fit well within the MOST framework.

    “These approaches fit well within the MOST framework.”
    Quote in the paperNot a substantial claim

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Interpretationreasoning

    Obtaining research funding to implement MOST can be challenging.

    “Still, obtaining research funding to implement MOST can be challenging.”
    Quote in the paperNot a substantial claim

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Interpretationreasoning

    In most cases, it is impossible to examine every potential intervention component in a single MOST cycle.

    “In most cases, it will be impossible to examine every potential component in a single cycle of MOST.”
    Quote in the paperNot a substantial claim

  • Probably not a substantial claim: may not pass S4 (based).

    Premisenone given

    The choice of experimental design is a major determinant of what can be accomplished with a given level of resources.

    “The choice of experimental design is critical, because it is a major determinant of what can be accomplished with a given level of resources.”
    Quote in the paperNot a substantial claim

  • Probably not a substantial claim: may not pass S4 (based).

    Study design and conductnone given

    To maintain fidelity to the design, it is critical that each participant receives the intervention components included in his or her assigned experimental condition, and only those components.

    “To maintain fidelity to the design it is critical to ensure that each participant receives the intervention components included in his or her assigned experimental condition, and only those components.”
    Quote in the paperNot a substantial claim

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Interpretationnone given

    Depending on available resources, it may not be possible to implement 32 experimental conditions.

    “However, depending on available resources, it may not be possible to implement 32 experimental conditions.”
    Quote in the paperNot a substantial claim

  • Classified as probably not a substantial claim.

    Premisereasoning

    Behavioral interventions in some areas of tobacco control may have a primary outcome variable much more temporally distal than six-month point prevalence abstinence.

    “Behavioral interventions in some areas of tobacco control may have a primary outcome variable that is much more temporally distal than six-month point prevalence abstinence.”
    Quote in the paperSubstantial claim

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    There are viable models ranging from clinic staff merely referring to a state quitline or an eHealth intervention, to a chronic care model approach to disease management.

    “The possibilities are legion with viable models ranging from clinic staff merely referring to a state quitline or an eHealth intervention (54, 55), to a chronic care model approach to disease management in which staff take primary responsibility for assessment, intervening, and patient tracking (7).”
    Quote in the paperNot a substantial claim0 of 3 sources checked
    • cites [54] Japuntich SJ, Zehner ME, Smith SS, et al. Smoking cessation via the internet: A randomized clinical trial of an internet intervention as adjuvant treatment in a smoking cessation intervention. Nicotine Tob Res. 2006;8 Suppl 1:S59–67. source

      Not checked in the free run.

    • cites [55] Strecher VJ, McClure J, Alexander G, et al. Web-based smoking cessation components and tailoring depth: Results of a randomized trial. Am J Prev Med. 2008;34:373–81. source

      Not checked in the free run.

    • cites [7] Hung DY, Shelley DR. Multilevel analysis of the Chronic Care Model and 5A services for treating tobacco use in urban primary care clinics. Health Serv Res. 2008;44:103–27. source

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisereasoning

    MOST provides a natural method of including cost information in decision making.

    “Third, MOST provides a natural method of including cost information in decision making.”
    Quote in the paperNot a substantial claim

  • May combine two claims.

    Interpretationreasoning

    A factorial experiment would in most cases be much less efficient and may not contain the necessary experimental conditions for the confirmation step's primary research question.

    “A factorial experiment would in most cases be much less efficient and may not even contain the experimental conditions necessary for addressing the primary research question.”
    Quote in the paperSubstantial claim

  • Probably not a substantial claim: may not pass S2 (checkable), S4 (based). May combine two claims.

    Interpretationnone given

    The strategy proposed will speed the identification of effective tobacco interventions and their translation into real-world use.

    “We believe that the strategy we propose will speed the identification of effective tobacco interventions and their translation into real-world use.”
    Quote in the paperNot a substantial claim

  • Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing), S4 (based).

    Interpretationnone given

    This strategy may have wide applicability to the development of behavioral interventions for other chronic health challenges.

    “This strategy may have wide applicability to the development of behavioral interventions for other chronic health challenges.”
    Quote in the paperNot a substantial claim
96 of 96

  • The paper relies on this without support.

    The development of new cessation interventions with demonstrated effectiveness and cost-effectiveness has been relatively slow.

    “Despite the need for tobacco cessation approaches that work, the development of novel cessation interventions of demonstrated effectiveness and cost-effectiveness has been relatively slow.”

  • The paper relies on this without support.

    If all tobacco users received evidence-based treatments that substantially raised their chances of becoming tobacco-free, morbidity and mortality would fall and health-related costs would be saved.

    “If all tobacco users could be provided with evidence-based treatments that substantially increased their chances of becoming tobacco-free, not only would morbidity and mortality be reduced, but millions of dollars in health-related costs could be saved.”

  • The paper relies on this without support.

    Prior research does not directly provide estimates of individual component effects in a real-world effectiveness setting.

    “Prior research does not directly supply this information.”

  • The paper relies on this without support.

    The traditional approach to choosing intervention components and levels relies solely on clinical experience, informal hypotheses, and post-hoc nonexperimental analyses.

    “The traditional approach of choosing intervention components and levels is based solely on information such as clinical experience, informal hypotheses, and post-hoc nonexperimental analyses.”

  • The paper relies on this without support.

    Most behavioral interventions with statistically significant program effects could be modified to increase their public health impact appreciably.

    “In our view, it is likely that the vast majority of behavioral interventions that achieve statistically significant program effects could readily be modified to increase their public health impact appreciably.”

  • The paper relies on this without support.

    Type II translation is important in tobacco control.

    “We are particularly interested in Type II translation because of its importance in tobacco control.”

  • The paper relies on this without support.

    Translating cessation intervention research into healthcare and other real-world settings is crucial because those settings can deliver cessation treatments to large numbers of smokers.

    “Translating cessation intervention research into healthcare settings and other real-world health care contexts (e.g., quit lines) is crucial because such settings offer unparalleled opportunities to deliver cessation treatments to large numbers of smokers.”

  • The authors state this as an assumption.

    Using fractional factorial designs requires assuming that most higher-order interactions (three or more factors) are in Category B (likely negligible).

    “In general, using fractional factorial designs requires making the assumption that most higher-order interactions (i.e., interactions that involve three or more factors) are in Category B.”

  • The paper relies on this without support.

    The five two-way interactions and one three-way interaction selected as targets are likely to have the largest impact on decisions about which components and levels to include.

    “We selected these target effects because we believe that they are likely to have the largest impact on our decisions about which components and levels of components to include in the intervention.”

  • The paper relies on this without support.

    The remaining three-way interactions and all interactions involving four or more factors are likely negligible.

    “The remaining three-way interactions and all interactions involving four or more factors were placed in Category B.”

  • The paper relies on this without support.

    Short-term outcomes are more sensitive to the performance of intervention components than long-term outcomes.

    “We decided to use short-term outcomes to select components and component levels because we believe short-term outcomes will be more sensitive to the performance of the intervention components.”

  • The paper relies on this without support.

    Using short-term outcomes will help keep the overall study on a reasonable timeline.

    “In addition, using short-term outcomes will help to keep the overall study on a reasonable timeline.”

  • The paper relies on this without support.

    The five-year funding cycle has no intrinsic scientific meaning or merit.

    “The five year funding cycle is merely an administrative necessity. It has no intrinsic scientific meaning or merit and was never meant to be a scientific imperative.”

  • The paper relies on this without support.

    MOST rests on the conviction that useful information can be gained by examining the effects of individual intervention components, provided that experimental designs are chosen prudently.

    “First, MOST rests on the conviction that useful information can be gained by examining the effects of individual intervention components, provided that experimental designs are chosen prudently.”
14 of 14

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • The literature contains far less work on how evidence-based interventions are adopted and spread at population scale.

    “Much less research exists on the process of how EBIs are adopted and disseminated on a wide-scale, population level (Collins et al. 2011).”

    From Translational research in South Africa: evaluating implementation quality using a factorial design (2012) · cites this paper as Collins et al. 2011

  • Factorial experiments enable analyses of the effects of each independent variable on specific mediators.

    “Fifth, the factorial experiment enables analyses that address hypotheses about the effects of each of the three independent variables on specific mediating variables (Collins et al. 2011).”

    From Translational research in South Africa: evaluating implementation quality using a factorial design (2012) · cites this paper as Collins et al. 2011

  • Factorial designs may serve as an appealing substitute for observational studies or RCTs when the aim is to estimate separate effects of multiple intervention components.

    “Recently, behavioral scientists have noticed that a factorial experiment can be an attractive alternative to an observational study or an RCT (e.g., Collins et al. 2011; Strecher et al. 2008), when the objective is to estimate the individual effects of several different aspects of an intervention.”

    From Translational research in South Africa: evaluating implementation quality using a factorial design (2012) · cites this paper as Collins et al. 2011

  • The interventions reported across the review varied widely and included a few targeting behavioural change at the individual patient level, such as weight reduction and smoking cessation programs, or at the level of healthcare professionals, such as interventions targeting general practitioners to reduce inappropriate prescribing behaviours.

    “The interventions reported across the review varied widely and included a few targeting behavioural change at the individual patient level, such as weight reduction [27] and smoking cessation programs [10, 44, 49], or at the level of healthcare professionals, such as interventions targeting general practitioners to reduce inappropriate prescribing behaviours [26, 45, 46, 48].”

    From Optimisation of complex health interventions prior to a randomised controlled trial: a scoping review of strategies used (2016) · cites this paper as [44]

  • Two included studies applied the MOST framework.

    “and two applied the MOST framework [10, 44].”

    From Optimisation of complex health interventions prior to a randomised controlled trial: a scoping review of strategies used (2016) · cites this paper as [44]

Cites

Flagged first, then by citations

Research works printed but not linked: 10

  1. Fiore MC, Bailey WC, Cohen SJ. Treating tobacco use and dependence: Clinical practice guideline. Rockville: U.S. Department of Health and Human Services, U.S. Public Health Service; 2000.
  2. Fiore MC, Jaen CR, Baker TB, et al. Treating tobacco use and dependence: 2008 update. Rockville: U.S. Department of Health and Human Services, U.S. Public Health Service; 2008.
  3. Box GEP, Hunter, W.G., & Hunter, J.S. Statistics for experimenters: An introduction to design, data analysis, and model building. New York: Wiley; 1978.
  4. Wu CF, Hamada M. Experiments: Planning, analysis, and parameter design optimization. New York: Wiley; 2000.
  5. Shadish WR, Cook TD, Campbell DT. Experimental and quasi-experimental designs for generalized causal inference. Boston: Houghton-Mifflin; 2002.
  6. Fisher RA. The arrangement of field experiments. Journal of the Ministry of Agriculture of Great Britain. 1926;33:505–13.
  7. Chakraborty H. The design and analysis aspects of cluster randomized trials. In: Biswas A, Datta S, Fine JP, Segal MR, eds. Statistical Advances in the Biomedical Sciences. Hoboken: Wiley; 2008:67–80.
  8. SAS Institute. SAS/STAT 9.1 User's Guide. Cary: SAS Institute; 2004.
  9. SAS Institute. SAS/QC9.1 User's Guide. Cary: SAS Institute; 2004.
  10. Fiore MC, Bailey WC, Cohen SJ. Smoking cessation: Clinical practice guideline no. 18. Rockville: U.S. Department of Health and Human Services, Public Health Service, Agency for Health Care Policy and Research; 1996.

Cited by

Sorted by citations

Authors
Collins, L. M., Baker, T. B., Mermelstein, R. J., Piper, M. E., Jorenby, D. E., Smith, S. S., Christiansen, B. A., Schlam, T. R., Cook, J. W., & Fiore, M. C.
Affiliations
  • Pennsylvania State University (US)
  • University of Wisconsin–Madison (US)
  • University of Illinois Chicago (US)
Corresponding author
Piper, Megan E.
ORCID
Venue
Annals of Behavioral Medicine
Publisher
Oxford University Press (OUP)
Published
2010-12-04
Volume
41
Issue
2
Pages
208-226
ISSN
  • 0742-5554 (ISSN-L)
  • 0883-6612
  • 1532-4796
DOI
10.1007/s12160-010-9253-x
PMC
PMC3053423
OpenAlex
W2116440749
Semantic Scholar
38fac411fa58c71a3130f46b734de3a8ef7ff13d
Cited by
300
References
50
Citations by year
2026: 5 · 2025: 17 · 2024: 23 · 2023: 21 · 2022: 24 · 2021: 23 · 2020: 25 · 2019: 21 · 2018: 21 · 2017: 21 · 2016: 19 · 2015: 19 · 2014: 24 · 2013: 18 · 2012: 14
FWCI
8.02
Type
journal article
Language
en
Open access
Locations
  • Annals of Behavioral Medicine (publishedVersion)
  • PubMed (publishedVersion)
  • Europe PMC (PubMed Central) (acceptedVersion)
  • PubMed Central (acceptedVersion)
Funders
  • Pfizer
  • Sanofi
  • Georgia Clinical and Translational Science Alliance (1UL1RR025011)
  • National Institutes of Health (5k05ca139871-05, 1K05CA139871)
  • National Institute on Drug Abuse (R21DA024266, P50-DA-10075, K08DA021311, P50DA010075)
  • National Cancer Institute (K05 CA-139871, 1K05CA139871, P50CA143188)
  • National Center for Research Resources (UL1RR025011)
Topics
  • Health Sciences › Medicine › Physiology › Smoking Behavior and Cessation
  • Health Sciences › Health Professions › General Health Professions › Health Policy Implementation Science
  • Social Sciences › Psychology › Applied Psychology › Behavioral Health and Interventions
Keywords
multiphase optimization strategy, multicomponent intervention, tobacco use intervention, smoking cessation, intervention development, intervention evaluation, research translation, intervention efficacy, cost-effectiveness, behavioral interventions
MeSH terms
Behavior Therapy, Cost-Benefit Analysis, Engineering, Humans, Models, Theoretical, Research Design, Tobacco Use Disorder, Program Evaluation, Smoking Cessation, Program Development, Outcome Assessment, Health Care, Translational Research, Biomedical

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Claims read by deepseek-v4.1-flash under definition version 3 (extract-v3) on 2026-10-06.

Classified by jev-1.13-20260917 (gold-guideline-v0.2) on 2026-10-06.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review