CoChat
Sign Up
Cited by 872Health Policy Implementation ScienceHealth and Medical Research ImpactsInterdisciplinary Research and Collaboration

Reenvisioning Clinical Science: Unifying the Discipline to Improve the Public Health

Open access
Onken, Lisa S., Carroll, Kathleen M., Shoham, Varda, Cuthbert, Bruce N., Riddle, Melissa·2014·Clinical Psychological Science
DOI 10.1177/2167702613497932PMC PMC4374633
Open this paper in CoChat — free account

Abstract

We present a vision of clinical science, based on a conceptual framework of intervention development endorsed by the Delaware Project. This framework is grounded in an updated stage model that incorporates basic science questions of mechanisms into every stage of clinical science research. The vision presented is intended to unify various aspects of clinical science toward the common goal of developing maximally potent and implementable interventions, while unveiling new avenues of science in which basic and applied goals are of equally high importance. Training in this integrated, translational model may help students learn how to conduct research in every domain of clinical science and at each stage of intervention development. This vision aims to propel the field to fulfill the public health goal of producing implementable and effective treatment and prevention interventions.

Integrity signals

Registry

Crossref · 10.1177/2167702613497932

Cites

86 of 86 references verified0 citation errors · 0 not checkable

Statistics

Nothing to recompute.

Claims the paper makes

0 of 41 cited sources checked · 0 supported · 0 flagged

  • Premisecitation

    Multiple factors converge to create the science-to-service gap, also called the implementation cliff.

    “Several factors converge to create this widely acknowledged science-to-service gap, or what Weisz et al. (Weisz, Jensen-Doss, & Hawley, 2006; Weisz, Ng, & Bearman, 2014) call the implementation cliff.”
    Quote in the paperSubstantial claim0 of 2 sources checked
    • cites Weisz, Jensen-Doss, & Hawley, 2006

      Not checked in the free run.

    • cites Weisz, Ng, & Bearman, 2014

      Not checked in the free run.

  • Interpretationreasoning

    Without a better understanding of how interventions work, adapting interventions, such as reducing dose, may remove their original efficacy.

    “In the absence of better understanding of how interventions work, efforts to adapt interventions (e.g., dose reduction), a common practice in community settings, may render the interventions devoid of their original efficacy.”
    Quote in the paperSubstantial claim
  • Premisecitation

    A computerized attention modification program directly targets cognitive biases operating in the most prevalent mood disorders.

    “Another example is the computerized attention modification program that directly targets cognitive biases operating in the most prevalent mood disorders (Amir & Taylor, 2012).”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Amir & Taylor, 2012

      Not checked in the free run.

  • Premisecitation

    A positive efficacy study does not automatically or usually lead to a positive effectiveness study.

    “It is not reasonable to expect that a positive efficacy study will automatically or even usually lead to a positive effectiveness study (Flay, 1986).”
    • Also stated in: § Concluding Remarks · hedged
      “They need to expect that successful research setting–based efficacy trials are not likely to directly result in successful effectiveness trials”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites Flay, 1986

      Not checked in the free run.

  • Interpretationreasoning

    For an intervention to be tested for efficacy in a community setting with community providers, it will likely need further development or adaptation.

    “For such testing to occur, the intervention will likely need to be further developed or “adapted” for community providers.”
    Quote in the paperSubstantial claim
  • May combine two claims. 24
  • Classified as probably not a substantial claim. 36

  • May combine two claims.

    Premisecitation

    Efficacious behavioral treatments exist for many mental disorders, but patients seeking treatment in community settings rarely receive them.

    “Although efficacious behavioral treatments for many mental disorders exist, patients who seek treatment in community settings rarely receive them (Institute of Medicine, 2006).”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites Institute of Medicine, 2006

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S4 (based).

    Premisenone given

    Many clinical scientists are not yet taking the approach of studying change mechanisms in intervention development research.

    “Despite these frequent calls for studying change mechanisms in intervention development research, many clinical scientists are not yet taking this approach.”
    Quote in the paperNot a substantial claim

  • May combine two claims.

    Premisenone given

    Research therapists tend to be committed to the therapy they administer and to the research process, and they are directly incentivized to implement treatments with skill and fidelity.

    “Research therapists tend to be committed to the therapy they are administering and to the research process, and they are directly incentivized to implement treatments with skill and fidelity.”
    Quote in the paperNot a substantial claim

  • May combine two claims.

    Premisecitation

    In a study of clinical psychologists treating posttraumatic stress disorder, 17% reported using exposure therapy and 72% reported discomfort with it.

    “For example, in a study of clinical psychologists’ use of exposure therapy for posttraumatic stress disorder, only 17% of therapists reported using the evidence-based treatment, and 72% reported a lack of comfort with exposure therapy (Becker, Zayfert, & Anderson, 2004).”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites Becker, Zayfert, & Anderson, 2004

      Not checked in the free run.

  • May combine two claims.

    Interpretationreasoning

    No party takes charge of ensuring implementability, so the cycle continues.

    “As it turns out, nobody takes charge, and the cycle continues.”
    Quote in the paperSubstantial claim

  • May combine two claims.

    Premisecitation

    Empirically supported therapies are not always preferentially reimbursed, while some ineffective or harmful interventions continue to be reimbursed.

    “Another particularly unfortunate barrier is that empirically supported therapies are not always preferentially reimbursed, whereas some interventions that have been shown to be ineffective or worse (e.g., repeated inpatient detoxification without aftercare) continue to be reimbursed (Humphreys & McLellan, 2012).”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites Humphreys & McLellan, 2012

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S2 (checkable), S4 (based). May combine two claims.

    Interpretationreasoning

    The development of potent and implementable behavioral interventions could be revolutionized if the field unified around fundamental mechanisms of behavior change and all clinical scientists were trained to address mechanisms at every stage of intervention development.

    “We suggest that the development of potent and implementable behavioral interventions could be revolutionized if the field were unified around fundamental mechanisms of behavior change and if all types of clinical scientists were trained to address mechanism of action of behavioral interventions at every stage of the intervention development process.”
    Quote in the paperNot a substantial claim

  • May combine two claims.

    Premisecitation

    Implementing such treatments may require fundamental changes in training and supervision of community clinicians, smaller patient loads, and more time per patient.

    “For example, implementation of such treatments may require fundamental changes in the training and ongoing supervision of community-based clinicians (Carroll & Rounsaville, 2007), smaller numbers of patients assigned to each clinician, and increased time allotted per patient.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Carroll & Rounsaville, 2007

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S4 (based).

    Interpretationreasoning

    When clinical scientists uncover essential mechanisms of action, they may be able to package an intervention in a highly implementable way.

    “On the other hand, when clinical scientists uncover essential mechanisms of action, they may be able to package the intervention in a way that is highly implementable.”
    Quote in the paperNot a substantial claim

  • May combine two claims.

    Premisecitation

    Direct supervision of community clinicians' fidelity and skill in delivering evidence-based practice is rarely provided and is not reimbursed or incentivized.

    “Direct supervision, via review of clinicians’ levels of fidelity and skill in delivering evidence-based practice, is rarely provided in community-based settings and is also not reimbursed or otherwise incentivized (Olmstead et al., 2012; Schoenwald, Mehta, Frazier, & Shernoff, 2013).”
    Quote in the paperSubstantial claim0 of 2 sources checked
    • cites Olmstead et al., 2012

      Not checked in the free run.

    • cites Schoenwald, Mehta, Frazier, & Shernoff, 2013

      Not checked in the free run.

  • May combine two claims.

    Premisecitation

    Such modifications typically involve fewer sessions, group rather than individual format, and other shortcuts that could reduce potency.

    “Such alterations typically involve delivering the intervention in far fewer sessions, in group versus individual format, and other shortcuts that could diminish potency.”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites Stewart, Stirman, & Chambless, 2012

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S2 (checkable), S4 (based). May combine two claims.

    Interpretationnone given

    Students need an integrative vision of the field, to see themselves as part of it, and to know how to interact with scientists in other parts of clinical science for the field to flourish long term and achieve its potential for public health impact.

    “However, the need for students to acquire a more integrative vision of the entire field, to see themselves as part of it, and to understand how to interact with scientists in other parts of the clinical science system is critical for clinical science to flourish in the long term, and to achieve its rich potential for exerting a positive impact on public health.”
    Quote in the paperNot a substantial claim
    • Rests on an assumption: Most clinical researchers were not trained in an integrative outlook and are too embedded in current clinical research pressures to change quickly.

  • May combine two claims.

    Premisenone given

    Efficacy research values internal validity, while effectiveness research prioritizes external validity at the expense of internal validity, producing a disconnect.

    “There is a clear disconnect between efficacy research that values internal validity and effectiveness research that prioritizes external validity at the expense of internal validity.”
    Quote in the paperSubstantial claim

  • Classified as probably not a substantial claim.

    Premisecitation

    A need has been identified for research that falls between traditional efficacy and effectiveness research.

    “a need has been identified for research between traditional efficacy and effectiveness research (Carroll & Rounsaville, 2007; Weisz et al., 2013).”
    Quote in the paperSubstantial claim0 of 2 sources checked
    • cites Carroll & Rounsaville, 2007

      Not checked in the free run.

    • cites Weisz et al., 2013

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S2 (checkable), S4 (based). May combine two claims.

    Interpretationreasoning

    Researchers across the spectrum from basic clinical science to applied intervention development can help each other and themselves by opening new research avenues and asking new questions while fostering public health.

    “Researchers from the most basic realm of clinical science to the most applied realm of intervention development not only can help each other, but also can help themselves by opening up new avenues of research pursuits, and asking and answering new research questions—all while fostering the public health.”
    Quote in the paperNot a substantial claim

  • May combine two claims.

    Interpretationreasoning

    A successful Stage III trial demonstrates that an intervention can be delivered faithfully in the community and that it retains efficacy.

    “A successful Stage III trial shows that it is possible to deliver faithfully an intervention in the community, and that the intervention retains efficacy.”
    Quote in the paperSubstantial claim

  • May combine two claims.

    Interpretationreasoning

    Understanding mechanisms could clarify scientifically based principles of interventions, and imparting these principles may help practitioners deliver with higher fidelity than strict manual adherence.

    “Understanding mechanism could help to clarify scientifically based principles of interventions, and imparting these principles may help practitioners deliver interventions with a higher level of fidelity than requiring a strict adherence to intervention manuals.”
    Quote in the paperSubstantial claim

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisenone given

    Numerous calls have been made for research on mechanisms of change.

    “There have been numerous calls for research on mechanisms of change.”
    Quote in the paperNot a substantial claim

  • Probably not a substantial claim: may not pass S2 (checkable), S4 (based).

    Interpretationnone given

    A major reason for the relative lack of attention to mechanisms in prior research may be that areas of clinical science are largely disconnected.

    “We suggest that a major reason for the relative lack of attention to mechanisms in prior research may be an unfortunate consequence of largely disconnected areas of clinical science.”
    Quote in the paperNot a substantial claim

  • Probably not a substantial claim: may not pass S2 (checkable).

    Interpretationreasoning

    Basic science questions and research paradigms are integral to the entire behavioral intervention development process, not limited to research before intervention development.

    “Hence, basic science questions and relevant research paradigms should not be limited to research that occurs prior to intervention development; they are integral to the entire behavioral intervention development process.”
    Quote in the paperNot a substantial claim

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisereasoning

    Not all dissemination and implementation research examines the intervention itself, except as something to be adopted by the system.

    “Although relevant to intervention development, not all D&I research looks at the intervention per se, except as something to be adopted by the system.”
    Quote in the paperNot a substantial claim

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    A recent announcement called for research on putative mechanisms of action of behavioral interventions with the ultimate goal of simplifying and creating more implementable interventions.

    “Indeed, one recent announcement, “Use-Oriented Basic Research: Change Mechanisms of Behavioral Social Interventions” (http://grants.nih.gov/grants/guide/pa-files/PA-12-119.html), called for research to study putative mechanisms of action of behavioral, with the ultimate goal of simplifying and creating more implementable interventions.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites http://grants.nih.gov/grants/guide/pa-files/PA-12-119.html

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

    Premisenone given

    Dissemination and implementation research focuses at least as much, if not more, on the service delivery system as on the intervention itself.

    “Generally speaking, dissemination and implementation (D&I) research focuses at least as much if not more on the service delivery system as opposed to the intervention itself.”
    Quote in the paperNot a substantial claim

  • May combine two claims.

    Premisenone given

    Clinical scientists usually do not convey modifications to interventions and often lack tools to retain effective ingredients while guiding adaptation.

    “Unfortunately, clinical scientists are not usually the conveyers of such modifications, nor do they always have the tools necessary to retain effective intervention ingredients while guiding adaptation efforts.”
    Quote in the paperSubstantial claim

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Interpretationreasoning

    Simplifying interventions could help with training, cost, and transportability.

    “Simplification of interventions could help with training, cost, and transportability.”
    Quote in the paperNot a substantial claim

  • Probably not a substantial claim: may not pass S2 (checkable).

    Interpretationnone given

    The implementation problems fall between scientific cracks at a meta-level.

    “A meta-level problem is that these problems fall between scientific cracks.”
    Quote in the paperNot a substantial claim

  • Probably not a substantial claim: may not pass S2 (checkable), S4 (based).

    Interpretationnone given

    Questions about mechanisms of disorders and mechanisms of change are conceptually similar to questions in basic behavioral science.

    “Questions regarding mechanisms of disorders and mechanisms of change are conceptually similar to questions asked within basic behavioral science.”
    Quote in the paperNot a substantial claim

  • Classified as probably not a substantial claim. May combine two claims.

    Interpretationreasoning

    Interventions at Stage V are not exempt from the requirement to study mechanisms; understanding how implementation strategies work is important.

    “This does not imply, however, that interventions at this stage are exempt from the desiderata regarding mechanism that are discussed in previous sections: It is important to understand how implementation strategies work.”
    Quote in the paperSubstantial claim

  • Probably not a substantial claim: may not pass S2 (checkable), S4 (based). May combine two claims.

    Interpretationnone given

    A common language fosters a progressive discipline and creates the groundwork to solve public health problems.

    “A common language fosters a progressive discipline, creating the groundwork to solve public health problems.”
    Quote in the paperNot a substantial claim

  • Probably not a substantial claim: may not pass S2 (checkable). May combine two claims.

    Interpretationreasoning

    This common language facilitates research grant proposal writing and review, leading to a more coherent, efficient, and progressive science.

    “This common language facilitates research grant proposal writing and review, ultimately leading to a more coherent, efficient, and progressive science.”
    Quote in the paperNot a substantial claim

  • Probably not a substantial claim: may not pass S2 (checkable), S4 (based).

    Interpretationreasoning

    Training students to use the stage model as a heuristic can help achieve the goals of underscoring interconnectedness, awareness of mechanisms, defining essential aspects, promoting a common language, and emphasizing full development of potent interventions through implementation.

    “Training students to use the stage model as a heuristic can help to foster all of these goals.”
    Quote in the paperNot a substantial claim

  • Probably not a substantial claim: may not pass S2 (checkable).

    Interpretationreasoning

    The vision requires clinical scientists and their students to understand that intervention development is far from complete when an intervention shows efficacy in Stage II.

    “The vision presented here demands that clinical scientists understand and train their students to understand that intervention development is far from complete when an intervention shows efficacy in Stage II.”
    Quote in the paperNot a substantial claim
    • Rests on an assumption: Complex treatments delivered with high fidelity in research settings by research therapists tend to lose strength when delivered in community settings by community providers.

  • Probably not a substantial claim: may not pass S2 (checkable).

    Interpretationreasoning

    A new vision for clinical science is equivalent to a new vision for intervention development because both ultimately aim at interventions that promote physical and mental health.

    “A new vision for clinical science is, in a sense, equivalent to a new vision for intervention development, in that the ultimate goal of both is interventions that promote the physical and mental health of individuals.”
    Quote in the paperNot a substantial claim

  • Probably not a substantial claim: may not pass S2 (checkable). May combine two claims.

    Interpretationreasoning

    Defining a stage between efficacy and effectiveness draws attention to the importance of that stage and clarifies the use of the terms efficacy and effectiveness.

    “Moreover, defining a stage in between efficacy and effectiveness, where interventions can be tested with high internal validity, with research therapists in research settings, draws attention to the importance of this stage of intervention development, and also provides more clarity when the words efficacy and effectiveness are used.”
    Quote in the paperNot a substantial claim

  • Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing).

    Premisereasoning

    Defining treatment generation and refinement helped legitimize this necessary part of behavioral treatment research.

    “For example, defining treatment generation and refinement helped to legitimize this necessary part of behavioral treatment research.”
    Quote in the paperNot a substantial claim

  • Probably not a substantial claim: may not pass S2 (checkable), S4 (based).

    Interpretationreasoning

    Basic science is an integral part of the goal of interventions that promote health because basic and all types of applied clinical scientists are necessary to fully achieve it.

    “Although the ultimate goal may be applied, basic science is an integral part of that goal because basic and all types of applied clinical scientists are necessary to fully achieve it.”
    Quote in the paperNot a substantial claim

  • Probably not a substantial claim: may not pass S4 (based).

    Premisenone given

    Basic science can precede and provide the basis for generating a new intervention or modifying an existing one.

    “Stage 0 can precede and provide the basis for the generation of a new intervention, or the modification of an existing one.”
    Quote in the paperNot a substantial claim
    • Rests on an assumption: Basic science plays a major role in intervention development.

  • Probably not a substantial claim: may not pass S2 (checkable), S4 (based).

    Interpretationreasoning

    With a common language, a defined Stage III, and a mind-set that values basic science and implementability, the field can replace unproductive cycles of efficacy and effectiveness trials with a path toward implementing effective interventions.

    “With a common language, the (oftentimes) missing link of Stage III defined, and a mind-set that includes an appreciation of basic science and implementability within intervention development, we expect to replace the merry-go-round of efficacy and effectiveness trials that go nowhere with a map that leads toward implementation of effective interventions.”
    Quote in the paperNot a substantial claim

  • Probably not a substantial claim: may not pass S2 (checkable). May combine two claims.

    Interpretationreasoning

    If basic science can inform and be informed by applied clinical science, the field can expand, help solve public health problems, and gain recognition for doing so.

    “Basic science divorced from applied science can yield fascinating findings, but if basic science can inform and be informed by applied clinical science, the field can expand and can help solve public health problems, and be noticed for doing so.”
    Quote in the paperNot a substantial claim

  • Probably not a substantial claim: may not pass S2 (checkable), S4 (based).

    Interpretationnone given

    Training the next generation of clinical scientists to embrace this new vision could lead to a new generation of powerful and implementable interventions for public health.

    “Training the next generation of clinical scientists to embrace this new vision could mean a new generation of powerful and implementable interventions for the public health.”
    Quote in the paperNot a substantial claim

  • May combine two claims.

    Interpretationcitation

    Incorporating basic science into Stage IV may be more complex than into Stages I to III, but methods may exist for doing so.

    “It may be more complex to incorporate Stage 0 (basic science) into Stage IV than into Stages I to III, but there may be methods for doing so (Collins, Dziak, & Li, 2009; Doss & Atkins, 2006).”
    Quote in the paperNot a substantial claim0 of 2 sources checked
    • cites Collins, Dziak, & Li, 2009

      Not checked in the free run.

    • cites Doss & Atkins, 2006

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S2 (checkable), S4 (based). May combine two claims.

    Interpretationnone given

    Understanding the basic principles of behavior change for an intervention will fuel every stage of intervention development and help create more potent and implementable interventions.

    “As discussed earlier, we believe that understanding the basic principles of behavior change for an intervention will fuel every stage of intervention development and will facilitate the creation of ever more potent and implementable interventions.”
    Quote in the paperNot a substantial claim
    • Rests on an assumption: Basic science plays a major role in intervention development.

  • Probably not a substantial claim: may not pass S2 (checkable). May combine two claims.

    Interpretationreasoning

    Questions will still arise if the field is integrated, but the science will be better positioned to progress coherently.

    “Questions will still arise if the field is integrated, but the science will be better positioned to coherently progress.”
    Quote in the paperNot a substantial claim

  • Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing), S4 (based).

    Interpretationreasoning

    A Stage II study can provide an ideal opportunity to experimentally manipulate and test mechanisms.

    “Indeed, a Stage II study can provide an ideal opportunity to experimentally manipulate and test mechanisms.”
    Quote in the paperNot a substantial claim

  • Probably not a substantial claim: may not pass S2 (checkable).

    Interpretationreasoning

    Defining the stages creates a common language for discussing behavioral intervention development across clinical, academic, and research settings.

    “Finally, defining the stages creates a common language through which behavioral intervention development can be discussed across clinical, academic, and research settings.”
    Quote in the paperNot a substantial claim

  • Probably not a substantial claim: may not pass S2 (checkable).

    Interpretationreasoning

    Without understanding mechanisms, many questions can arise when clinical trials fail and even when they succeed.

    “On the other hand, without an understanding of mechanisms, endless questions can arise when clinical trials fail (e.g., questions about appropriateness of design, delivery, fidelity, population, providers, etc.) and even when they succeed”
    Quote in the paperNot a substantial claim

  • Probably not a substantial claim: may not pass S2 (checkable).

    Interpretationreasoning

    Defining stages of behavioral intervention development highlights the value and frequent necessity of a particular type of research endeavor.

    “defining stages of behavioral intervention development highlights the value and frequent necessity of a particular type of research endeavor.”
    Quote in the paperNot a substantial claim

  • Probably not a substantial claim: may not pass S2 (checkable), S4 (based).

    Interpretationnone given

    If an intervention is not implementable in the community, more work is needed, even if that work shows there is currently no way to make it more implementable.

    “If an intervention is not implementable in the community, there is more work to be done—even if that work ends up showing that there is no conceivable way currently to change the intervention into a more implementable form.”
    Quote in the paperNot a substantial claim
    • Rests on an assumption: Complex treatments delivered with high fidelity in research settings by research therapists tend to lose strength when delivered in community settings by community providers.

  • Probably not a substantial claim: may not pass S2 (checkable). May combine two claims.

    Interpretationreasoning

    Even though stages do not always occur in a prescribed order and it is not always necessary to progress through every stage, defining the stages facilitates communication and clarifies research activities and next steps.

    “So even though the stages of behavioral intervention development do not always—or even usually—occur in a prescribed order, and even though it is not always—or even usually—necessary to progress through every stage, it facilitates communication and helps clarify research activities and necessary next steps when the stages of intervention development research are defined.”
    Quote in the paperNot a substantial claim
49 of 49

  • The paper relies on this without support.

    Complex treatments delivered with high fidelity in research settings by research therapists tend to lose strength when delivered in community settings by community providers.

    “Complex treatments administered with a high degree of fidelity in research settings with research therapists seem destined to weaken when implemented in community settings with community providers.”

  • The paper relies on this without support.

    Most clinical researchers were not trained in an integrative outlook and are too embedded in current clinical research pressures to change quickly.

    “Realistically, the large majority of clinical researchers, sympathetic as they may be to this sort of integrative vision, were not trained in this kind of outlook and are far too ensconced in the intense pressure of contemporary clinical research to change rapidly.”

  • The paper relies on this without support.

    Clinical science training currently produces excellent basic scientists, intervention developers and testers, effectiveness researchers, and implementation scientists.

    “Moreover, clinical science training now produces excellent basic scientists, intervention generators and testers, effectiveness researchers, and implementation scientists.”

  • The paper relies on this without support.

    It is generally considered necessary to demonstrate that an intervention is effective before moving to implementation and dissemination in real-world settings.

    “It is generally considered necessary to show that an intervention is effective before proceeding to implementation and dissemination in the real world.”

  • The paper relies on this without support.

    Basic science plays a major role in intervention development.

    “Basic science, considered to be Stage 0, plays a major role in intervention development.”
5 of 5

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

Each contradiction between two passages listed here was confirmed by an independent check.

  • The proposed intermediate stage is assigned incompatible settings and providers

    Minor

    One passage describes the stage between efficacy and effectiveness as using research therapists in research settings. The Stage III definition instead places that intermediate stage with community therapists in a community setting.

1 of 1

Cites

Flagged first, then by citations

1 of the 87 references couldn’t be matched to a known paper.

Research works printed but not linked: 3

  1. Institute of Medicine, 2006, Improving the quality of health care for mental and substance-use conditions: Quality chasm series
  2. Kringlen E., 1970, Seminars in Psychiatry, 2, 403
  3. McFall R. M., 2007, Psychological clinical science: Recent advances in theory and practice. Integrative perspectives in honor of Richard M. McFall, 363

Cited by

Sorted by citations

Related

Authors
Onken, L. S., Carroll, K. M., Shoham, V., Cuthbert, B. N., & Riddle, M.
Affiliations
  • National Institute on Drug Abuse (US)
  • Yale University (US)
  • National Institute of Mental Health (US)
  • National Institute of Dental and Craniofacial Research (US)
Corresponding author
Onken, Lisa S.
ORCID
Venue
Clinical Psychological Science
Publisher
SAGE Publications
Published
2013-12-11
Volume
2
Issue
1
Pages
22-34
ISSN
  • 2167-7026 (ISSN-L)
  • 2167-7034
DOI
10.1177/2167702613497932
PMC
PMC4374633
OpenAlex
W2013335489
Cited by
872
References
87
Citations by year
2026: 93 · 2025: 123 · 2024: 107 · 2023: 117 · 2022: 90 · 2021: 101 · 2020: 70 · 2019: 58 · 2018: 35 · 2017: 40 · 2016: 18 · 2015: 12 · 2014: 6 · 2013: 2
FWCI
22.82
Type
journal article
Language
en
Open access
Licence
journals.sagepub.com/page/policies/text-and-data-mining-license (tdm)
Locations
  • Clinical Psychological Science (publishedVersion)
  • PubMed (publishedVersion)
  • Europe PMC (PubMed Central) (acceptedVersion)
  • PubMed Central (acceptedVersion)
Funders
  • National Institutes of Health (Z99 DA999999)
  • National Institute on Drug Abuse (P50DA009241, U10DA015831, R01DA015969)
Topics
  • Health Sciences › Health Professions › General Health Professions › Health Policy Implementation Science
  • Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Health and Medical Research Impacts
  • Social Sciences › Decision Sciences › Information Systems and Management › Interdisciplinary Research and Collaboration
Keywords
clinical science, intervention development, stage model, intervention mechanisms, translational research, research training, implementation, prevention interventions, therapeutic interventions

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Claims read under definition version 3 (extract-v3) on 2026-09-28.

Classified by jev-1.13-20260917 (gold-guideline-v0.2) on 2026-09-28.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review