CoChat
Sign Up
Cited by 478Health Policy Implementation ScienceUsability and User Interface DesignDigital Mental Health Interventions

User‐centered design for psychosocial intervention development and implementation.

Open access
Lyon, Aaron R., Koerner, Kelly·2016·Clinical Psychology: Science and Practice
DOI 10.1111/cpsp.12154PMC PMC5812700
Open this paper in CoChat — free account

Abstract

The current paper articulates how common difficulties encountered when attempting to implement or scale-up evidence-based treatments are exacerbated by fundamental design problems, which may be addressed by a set of principles and methods drawn from the contemporary field of user-centered design. User-centered design is an approach to product development that grounds the process in information collected about the individuals and settings where products will ultimately be used. To demonstrate the utility of this perspective, we present four design concepts and methods: (a) clear identification of end users and their needs, (b) prototyping/rapid iteration, (c) simplifying existing intervention parameters/procedures, and (d) exploiting natural constraints. We conclude with a brief design-focused research agenda for the developers and implementers of evidence-based treatments.

AI snapshot

Written from the paper’s full text.

TL;DR

This conceptual paper argues that common failures in implementing and scaling evidence-based psychosocial treatments stem partly from design flaws and can be addressed by user-centered design principles. It proposes four design concepts—identifying users and needs, prototyping/rapid iteration, simplification, and exploiting natural constraints—and outlines a design-focused research agenda.

Key findings

  • The paper contends that evidence-based treatments are often disseminated as static, complex protocols, creating mismatches with community users and implementation contexts; it proposes user-centered design as a way to improve acceptability, feasibility, appropriateness, and long-term effectiveness.
  • It identifies four transferable design concepts: clearly specifying primary, secondary, and negative users; using prototyping and rapid iteration; simplifying intervention parameters and materials; and treating contextual barriers as design constraints rather than obstacles to overcome.
  • It cites examples and figures from other work, including that the 10-item System Usability Scale yields scores from 0–100 with scores above 70 considered acceptable for digital technologies, that software updates may be pushed out roughly every 6 weeks, and that school-based service windows may be about 3–4 sessions.
  • It recommends a research agenda that includes usability assessment protocols, adapting measures such as the System Usability Scale to evidence-based treatments, using adherence data as a usability signal, and testing intervention configurations through routine outcome monitoring.

Methods

  • Design: conceptual/theoretical paper, not an empirical study; it synthesizes user-centered design literature and applies it to psychosocial intervention development, packaging, and implementation.
  • Data or sample: no study sample or dataset is analyzed; examples are drawn from prior literature and existing intervention efforts.
  • Main analysis: narrative argument and framework development, organized around four design concepts with definitions, techniques, and applications to evidence-based treatments.

Limitations

  • The authors state that the paper remains largely theoretical and that research is needed to test the applicability of user-centered design principles and evaluate system-, provider-, and client-level outcomes.
  • The authors note that few studies have examined evidence-based treatment design features such as simplicity and usability in relation to implementation outcomes, and that no specific funding mechanisms currently support comparable rapid work in behavioral health.
  • Evident from the text: there is no empirical evaluation, sample, or quantitative result reported here, so the proposed benefits and applications are not directly tested in this paper.

Model-written summary. Check it against the paper before relying on it.

Integrity signals

Registry

Crossref · 10.1111/cpsp.12154

Cites

133 of 134 references verified0 citation errors · 1 not checkable

Statistics

Nothing to recompute.

Claims the paper makes

0 of 121 cited sources checked · 0 supported · 0 flagged

  • Premisecitation

    Implementation and widespread reach of EBT in service systems are influenced by factors across multiple system levels.

    “the implementation and widespread reach of EBT in service systems are known to be influenced by a range of factors operating across multiple system levels (Aarons, Hurlburt, & Horwitz, 2011)”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Aarons, Hurlburt, & Horwitz, 2011 source

      Not checked in the free run.

  • Premisecitation

    Intervention characteristics are commonly included in leading implementation frameworks.

    “intervention characteristics are commonly included in leading implementation frameworks (e.g., Damschroder et al., 2009; Rogers, 2003)”
    Quote in the paperNot a substantial claim0 of 2 sources checked
    • cites Damschroder et al., 2009 source

      Not checked in the free run.

    • cites Rogers, 2003

      Not checked in the free run.

  • Interpretationreasoning

    Many concerns about EBT are exacerbated by EBT design or structure, user responses to those designs, and interactions between EBT design and implementation processes.

    “many are exacerbated by the design or structure of EBT, user responses to those designs, and the ways that elements of EBT design interact with implementation processes”
    Quote in the paperSubstantial claim
  • Premisecitation

    Manualized EBT protocols remain the primary medium through which research evidence is packaged and disseminated for use.

    “manualized EBT protocols remain the primary medium through which research evidence is packaged and disseminated for use (Garland, Hawley, Brookman-Frazee, & Hurlburt, 2008)”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites Garland, Hawley, Brookman-Frazee, & Hurlburt, 2008

      Not checked in the free run.

  • Premisecitation

    Numerous concerns about EBT contribute to their low level of use by community practitioners.

    “numerous concerns about EBT appear to contribute to their low level of use by community practitioners (Chambless & Ollendick, 2001; Kazdin, 2008)”
    Quote in the paperSubstantial claim0 of 2 sources checked
    • cites Chambless & Ollendick, 2001 source

      Not checked in the free run.

    • cites Kazdin, 2008 source

      Not checked in the free run.

  • Classified as probably not a substantial claim. 48
  • May combine two claims. 19

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    Implementation science emerged to improve the use of well-researched interventions in everyday service settings.

    “the field of implementation science has emerged, explicitly tasked with improving the use of well-researched interventions in everyday service settings (Eccles & Mittman, 2006)”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Eccles & Mittman, 2006 source

      Not checked in the free run.

  • Classified as probably not a substantial claim.

    Premisecitation

    There is ongoing debate about the extent to which EBT balance structure and flexibility for community service providers.

    “there is ongoing debate surrounding the extent to which EBT are able to effectively balance structure and flexibility when introduced to service providers working in community contexts (Chambless & Ollendick, 2001; Hill & Owens, 2013; Lieb, Mayfield, Miller, & Pennucci, 2004)”
    Quote in the paperSubstantial claim0 of 3 sources checked
    • cites Chambless & Ollendick, 2001 source

      Not checked in the free run.

    • cites Hill & Owens, 2013

      Not checked in the free run.

    • cites Lieb, Mayfield, Miller, & Pennucci, 2004

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    Wu et al. discussed the relevance of engineering to implementation and mental health services.

    “Wu et al. (2014) have discussed the relevance of the related discipline of engineering to implementation and mental health services”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Wu et al., 2014

      Not checked in the free run.

  • Classified as probably not a substantial claim. May combine two claims.

    Premisecitation

    Usable systems result in increased productivity, a reduction of errors, require fewer resources for training and support, are more acceptable to users, and enjoy enhanced reputations within the user market.

    “Maguire (2001) has identified that usable systems result in increased productivity, a reduction of errors, require fewer resources for training and support, are more acceptable to users, and enjoy enhanced reputations within the user market.”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites Maguire, 2001 source

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    UCD places strong emphasis on explicitly identifying primary, secondary, and sometimes tertiary users to ensure products meet their needs.

    “The UCD field places strong emphasis on explicitly identifying primary, secondary, and sometimes tertiary users in order to ensure that new products effectively meet their needs (Cooper, Reimann, & Cronin, 2007; Grudin & Pruitt, 2002).”
    Quote in the paperNot a substantial claim0 of 2 sources checked
    • cites Cooper, Reimann, & Cronin, 2007

      Not checked in the free run.

    • cites Grudin & Pruitt, 2002

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    Usability has been conceptualized as a combination of learnability, efficiency, memorability, error frequency or severity, and satisfaction.

    “Usability has been conceptualized as a combination of constructs including (a) learnability, (b) efficiency, (c) memorability, (d) error frequency/severity, and (e) satisfaction (Nielsen, 1994).”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Nielsen, 1994

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    The lead user method improves the efficiency of the product design process.

    “Although this method has been found to improve the efficiency of the product design process (Olson & Bakke, 2001)”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Olson & Bakke, 2001

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    Others have advocated for usability testing and iterative design in health information technologies to support clinical decision-making.

    “others have advocated for usability testing and iterative design in the context of health information technologies to support clinical decision-making (e.g., Bickman, Kelley, & Anthay, 2012; Lyon et al., in press-b)”
    Quote in the paperNot a substantial claim0 of 2 sources checked
    • cites Bickman, Kelley, & Anthay, 2012

      Not checked in the free run.

    • cites Lyon et al., in press-b

      Not checked in the free run.

  • May combine two claims.

    Premisecitation

    Careful identification of representative user needs can correct developers' bias and enhance product quality.

    “but careful identification of representative user needs can correct this bias and enhance product quality (Kujala & Kauppinen, 2004)”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites Kujala & Kauppinen, 2004

      Not checked in the free run.

  • May combine two claims.

    Interpretationcitation

    Failure of most implementation processes to incorporate ongoing iterative intervention development increases the risk that local users will find new technologies low on acceptability, feasibility, and appropriateness and may limit effectiveness.

    “the failure of most implementation processes to incorporate ongoing, iterative intervention development increases the risk that local users will find new technologies to be low on key implementation outcomes such as acceptability, feasibility, and appropriateness (Proctor et al., 2011) and may limit effectiveness (Chambers et al., 2013)”
    Quote in the paperSubstantial claim0 of 2 sources checked
    • cites Proctor et al., 2011 source

      Not checked in the free run.

    • cites Chambers et al., 2013 source

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    The lead user approach collects experiences of advanced users to uncover system problems and solutions.

    “One parsimonious model for user identification is the lead user approach, wherein the experiences of particularly advanced users are collected to uncover system problems and solutions (which lead users often identify on their own) (von Hippel, 1989).”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites von Hippel, 1989 source

      Not checked in the free run.

  • Classified as probably not a substantial claim. May combine two claims.

    Interpretationreasoning

    EBT have historically focused primarily on robust, often complicated solutions for highly specified problems, overemphasizing engineering to the detriment of design.

    “Because EBT have historically focused primarily on the identification of robust, often complicated, solutions for highly specified problems (i.e., diagnosable clinical disorders), it could be said that they have overemphasized engineering to the detriment of design.”
    Quote in the paperSubstantial claim

  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Premisecitation

    Additional criteria for usable products include functional minimalism, low cognitive load, clear feedback to users, and exploitation of natural constraints in an environment.

    “Other authors have included additional criteria for usable products such as functional minimalism (i.e., too many features, functions, or components will reduce usability), low cognitive load (i.e., minimize the amount of thinking required to complete a task), clear feedback to users (e.g., about product status, success or failure), and exploitation of the natural constraints present in an environ”
    Quote in the paperNot a substantial claim0 of 2 sources checked
    • cites Norman, 1988

      Not checked in the free run.

    • cites Tognazzini, 2014

      Not checked in the free run.

  • May combine two claims.

    Premisecitation

    Most psychosocial interventions are complex and carry numerous decision points during use.

    “most psychosocial interventions are complex, and carry numerous decision points during the course of their use (Chorpita, Bernstein, & Daleiden, 2008)”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites Chorpita, Bernstein, & Daleiden, 2008

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    Flexibility via allowable adaptations is appealing for individualized or locally relevant services.

    “Flexibility (e.g., via allowable adaptations) is inherently appealing when working to deliver individualized or locally-relevant services (Lyon, Lau, McCauley, Vander Stoep, & Chorpita, 2014)”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Lyon, Lau, McCauley, Vander Stoep, & Chorpita, 2014

      Not checked in the free run.

  • May combine two claims.

    Premisecitation

    Trends suggest increasing complexity as EBT developers pursue wider populations, but added complexity often carries little additional benefit.

    “trends suggest increasing complexity as EBT developers pursue applications to wider populations, but this added complexity often carries little additional benefit (e.g., Chaffin et al., 2004)”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Chaffin et al., 2004 source

      Not checked in the free run.

  • Classified as probably not a substantial claim.

    Premisecitation

    Chorpita and Daleiden distinguished design time control from run time control.

    “Chorpita and Daleiden (2014) recently distinguished this dominant emphasis on “design time” control (i.e., determining features in advance) from “run time” control, which they defined as configuration based on how a product interacts with its environment.”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites Chorpita & Daleiden, 2014

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    Use of diverse user groups is important when designing products for organizations.

    “Use of diverse user groups is important when designing products for organizations, which inevitably contain individuals representing different user types (Kujala & Kauppinen, 2004).”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Kujala & Kauppinen, 2004

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S2 (checkable), S4 (based).

    Interpretationreasoning

    A reconceptualization of how intervention technologies are developed, prepared for dissemination, and implemented may help increase intervention appropriateness and effectiveness over time.

    “A reconceptualization of how intervention technologies are initially developed, prepared for dissemination, and then ultimately implemented may help to capitalize on opportunities to increase intervention appropriateness and effectiveness over time.”
    Quote in the paperNot a substantial claim

  • Probably not a substantial claim: may not pass S4 (based).

    Interpretationreasoning

    EBT can be intentionally designed using methods that ensure target users' needs are incorporated into the development process.

    “Just like other consumer products, EBT can be intentionally designed using methods that ensure the needs of target users are incorporated into the development process.”
    Quote in the paperNot a substantial claim

  • May combine two claims.

    Interpretationreasoning

    Changes in staff needs may include increases in individual expertise or decreases in a system's collective expertise due to staff turnover.

    “These changes may include increases in individual staff expertise due to experience (e.g., new therapists becoming increasingly comfortable in clinical interactions) or specific development of specific new competencies, but may also include decreases in a system’s collective expertise due to staff turnover.”
    Quote in the paperSubstantial claim

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Interpretationreasoning

    Off-protocol deviations represent the EBT equivalent of software workarounds.

    “Deviations such as these represent the EBT equivalent of a software “workarounds,” in which temporary fixes are used to bypass identified system usability problems.”
    Quote in the paperNot a substantial claim

  • May combine two claims.

    Premisecitation

    Therapists sometimes question the relevance or effectiveness of EBT for their specific populations or struggle to deliver them with engagement difficulties, crises, or comorbidities.

    “therapists sometimes question the relevance or effectiveness of EBT for their specific populations or struggle to deliver them when presented with engagement difficulties, crises, or comorbidities (Chandler, Peters, Field, & Juliano-bult, 2004; Kazdin, 2008; Whaley & Davis, 2007)”
    Quote in the paperSubstantial claim0 of 3 sources checked
    • cites Chandler, Peters, Field, & Juliano-bult, 2004 source

      Not checked in the free run.

    • cites Kazdin, 2008 source

      Not checked in the free run.

    • cites Whaley & Davis, 2007

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    A large body of implementation-focused research has documented the impact of organizational processes on successful implementation, including leadership buy-in and administrative support.

    “a large body of implementation-focused research has documented the impact of organizational processes to successful implementation – including leadership buy-in and administrative support (Beidas & Kendall, 2010)”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Beidas & Kendall, 2010

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S2 (checkable).

    Interpretationreasoning

    Mechanisms that allow service systems to update components of EBT to meet changing needs are vital.

    “mechanisms that allow service systems to update components of EBT to meet these changing needs are vital”
    Quote in the paperNot a substantial claim

  • May combine two claims.

    Interpretationreasoning

    Satisfaction is only one of many indicators of a usable and effective product and may be particularly subject to bias when a user has no experience with a comparable product.

    “satisfaction is only one of many indicators of a usable and effective product, and one that may be particularly subject to bias – and therefore less informative – when a user has no experience with a comparable product to which to compare a new innovation.”
    Quote in the paperSubstantial claim

  • May combine two claims.

    Interpretationnone given

    Workarounds can be effective short-term problem-solving strategies but likely decrease usability and product functioning if unaddressed.

    “Although workarounds can often be effective problem-solving strategies in the short term, they are likely to decrease usability and product functioning if unaddressed.”
    Quote in the paperSubstantial claim

  • Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing).

    Interpretationreasoning

    Revising an existing EBT to apply to a new class of service providers may be an appropriate impetus for system redesign.

    “Revising an existing EBT to be applicable to a new class of service providers (e.g., paraprofessionals) may be an appropriate impetus for system redesign.”
    Quote in the paperNot a substantial claim

  • Classified as probably not a substantial claim.

    Premisecitation

    Chorpita and colleagues pointed out that these situations often require therapists to go off protocol.

    “Chorpita and colleagues (2014) have pointed out that these situations often require therapists to go “off protocol,” changing their intervention plans in unexpected ways that are inconsistent with the intended treatment.”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites Chorpita et al., 2014

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S2 (checkable).

    Interpretationcitation

    EBT design processes may be most effective if they incorporate a developmental perspective and attend to how individual service provider and service system needs change over time.

    “EBT design processes may be most effective if they incorporate a developmental perspective and attend to how individual service provider and service system needs change over time (Chorpita & Daleiden, 2014)”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Chorpita & Daleiden, 2014

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Interpretationreasoning

    Increasing capacity may also identify and address problems in less severe populations of service users.

    “In both cases, increasing capacity may also have the effect of identifying and addressing problems in less severe populations of service users.”
    Quote in the paperNot a substantial claim

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Interpretationreasoning

    Newer transdiagnostic or modular approaches may be more likely to be responsive to consumer needs due to built-in flexibility.

    “due to their built-in flexibility, newer transdiagnostic or modular approaches to service delivery (described above) may be more likely to be responsive in these ways.”
    Quote in the paperNot a substantial claim

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    Hackos and Redish proposed a process for incorporating a broader variety of users into the design process.

    “Hackos and Redish (1998) proposed a process for incorporating a broader variety of users into the design process that includes: (a) brainstorming a preliminary list of users, (b) articulating user characteristics, (c) describing and prioritizing main user groups, (d) selecting typical and representative users from those groups, and (e) gathering information from users to inform the redesign of the”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Hackos & Redish, 1998

      Not checked in the free run.

  • May combine two claims.

    Premisecitation

    In the Improving Access to Psychological Therapies project, cognitive-behavioral approaches were packaged as low intensity versus high intensity to expand workforce capability and ensure that people with less severe problems could receive care from less intensively trained practitioners.

    “in the Improving Access to Psychological Therapies project, cognitive-behavioral approaches were explicitly packaged as low intensity versus high intensity to efficiently expand workforce capability and ensure that people with less severe problems could receive care from psychological wellbeing practitioners with less intensive training (Clark et al., 2009; Glover, Webb, & Evison, 2010)”
    Quote in the paperNot a substantial claim0 of 2 sources checked
    • cites Clark et al., 2009 source

      Not checked in the free run.

    • cites Glover, Webb, & Evison, 2010

      Not checked in the free run.

  • May combine two claims.

    Premisecitation

    Holmqvist and Walsh found that web- and telehealth-based CBT for insomnia were equally effective, but service recipients favored web-based delivery.

    “Holmqvist and Walsh (2014) found that although web- and telehealth-based CBT for insomnia were equally effective, service recipients favored web-based delivery.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Holmqvist & Walsh, 2014

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S2 (checkable).

    Interpretationreasoning

    Well-designed EBT should be similarly responsive to changes in staff needs.

    “Well-designed EBT should be similarly responsive to changes in staff needs.”
    Quote in the paperNot a substantial claim

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Interpretationreasoning

    Reconsideration of primary EBT users and service delivery models opens the door to task-shifting strategies.

    “Reconsideration of primary EBT users and service delivery models also opens the door to task-shifting strategies”
    Quote in the paperNot a substantial claim

  • Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing).

    Interpretationcitation

    It may be equally important for intervention developers to explicitly articulate the characteristics of negative users who are not intended targets for an intervention.

    “it may be equally important for intervention developers to explicitly articulate the characteristics of negative users who are not intended targets for an intervention”
    Quote in the paperNot a substantial claim

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    Software updates are pushed out to users with regularity, for example every 6 weeks.

    “software updates are pushed out to users with astonishing regularity (e.g., every 6 weeks; Khomh, Dhaliwal, Zou, & Adams, 2012)”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Khomh, Dhaliwal, Zou, & Adams, 2012

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S4 (based).

    Interpretationnone given

    Evidence-based treatment protocols have historically been available only to highly trained and often highly motivated mental health providers.

    “so too EBT protocols have historically only been available to highly trained (and often highly motivated) mental health providers.”
    Quote in the paperNot a substantial claim

  • May combine two claims.

    Premisecitation

    Routine monitoring of psychotherapy client outcomes with data-driven feedback to therapists can lower premature dropout and improve outcomes regardless of the intervention approach used.

    “increasing evidence has emerged that routinely monitoring psychotherapy client outcomes and providing data-driven feedback to therapists can reduce premature dropout and improve outcomes irrespective of the particular intervention approach used by the therapist (Bickman, Kelley, Breda, de Andrade, & Reimer, 2011; Lambert et al., 2003).”
    Quote in the paperSubstantial claim0 of 2 sources checked
    • cites Bickman, Kelley, Breda, de Andrade, & Reimer, 2011

      Not checked in the free run.

    • cites Lambert et al., 2003 source

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    Product design is largely determined by environmental constraints.

    “Product design depends largely on this type of constraint, which may include limitations on or requirements for a product’s form, function, budget, operating conditions, or time to completion, among others (Moggridge, 2007).”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Moggridge, 2007

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    Prototyping and rapid iterations based on evaluation of each successive prototype is an excellent example of the overarching design process of collecting data and feedback at all stages of a product development cycle.

    “Prototyping, and rapid iterations based on evaluation of each successive prototype, is an excellent example of the overarching design process of collecting data and feedback at all stages of a product development cycle (Maguire, 2001).”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Maguire, 2001 source

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    Design simplification has been a central feature of user-centered design for a long time.

    “With the goals of increasing learnability and decreasing the cognitive load required as users interact with a product, design simplification has long been a hallmark of UCD (Norman, 1988).”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Norman, 1988

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S2 (checkable). May combine two claims.

    Interpretationnone given

    Design thinking is promising for rethinking evidence-based treatment users, enabling faster innovation and testing, simplifying standard designs, and incorporating barriers and natural constraints.

    ““Design thinking” holds promise in the extent to which it can drive a reconceptualization of EBT users, support more rapid innovation and testing of novel approaches, simplify standard EBT designs, and incorporate – rather than struggle to overcome – barriers and other natural constraints for new and existing interventions.”
    Quote in the paperNot a substantial claim

  • Classified as probably not a substantial claim.

    Premisecitation

    A growing consensus holds that implementation science should move beyond identifying barriers to developing explicit strategies that support evidence-based treatment use and client improvement.

    “there is now growing consensus that the time has come to move implementation science beyond the identification of barriers toward the development of explicit strategies that facilitate EBT use and client improvement (Proctor, Powell, Baumann, Hamilton, & Santens, 2012).”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites Proctor, Powell, Baumann, Hamilton, & Santens, 2012

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    As evidence-based treatments are scaled up across large service systems, aligning multiple interventions within organizations is becoming a priority.

    “As EBT are increasingly scaled up across large service systems, alignment of multiple interventions within organizations is quickly becoming a priority (Chorpita et al., 2011).”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Chorpita et al., 2011 source

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    Presenting visual information clearly is necessary for any product to function, enabling users to understand a system's state, available actions, and how to perform them.

    “clear presentation of visual information is essential to the functioning of any product to allow users to understand the state of a system, what actions are possible, and how they should be completed (Norman, 1988).”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Norman, 1988

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    There is now broad recognition that nearly ubiquitous digital tools must work together and share information in ways that increase convenience and value for users.

    “there is now widespread acknowledgment that nearly ubiquitous digital tools need to be able to work together and share information in a way that enhances convenience and value for the user (Fontaine, Ross, Zink, & Schilling, 2010).”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Fontaine, Ross, Zink, & Schilling, 2010 source

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Premisecitation

    Affordances depend heavily on human perception and do not exist independently of both the individual and the environment.

    “affordances rely heavily on human perception and have no existence independent of a joint consideration of the individual and environment (Zaff, 1995).”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Zaff, 1995

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    The 10-item System Usability Scale is generally regarded as one of the most sensitive, robust, and widely used scales of its kind.

    “The 10-item System Usability Scale (SUS; Brooke, 1996), for instance, is generally considered to be among the most sensitive, robust, and widely used scales of its type (Sauro, 2011; Tullis & Stetson, 2004).”
    Quote in the paperNot a substantial claim0 of 2 sources checked
    • cites Sauro, 2011

      Not checked in the free run.

    • cites Tullis & Stetson, 2004

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Interpretationreasoning

    Using prototyping early in the design process allows inexpensive exploration of novel ideas and solutions before more costly production.

    “Using this technique early in the design process allows for the inexpensive exploration of novel ideas and solutions prior to more costly production.”
    Quote in the paperNot a substantial claim

  • Probably not a substantial claim: may not pass S2 (checkable), S4 (based).

    Interpretationreasoning

    The shift to more rapid approaches is likely to yield important benefits for scientific discovery and for the widespread use of well-designed, contextually appropriate, empirically based interventions.

    “The transition to more rapid approaches may be uncomfortable for some researchers accustomed to the traditionally slow scientific slog down a single investigative pathway, but is likely to pay important dividends related to scientific discovery and the widespread use of well-designed, contextually appropriate, and empirically-based interventions.”
    Quote in the paperNot a substantial claim

  • Classified as probably not a substantial claim.

    Premisecitation

    Explicit co-design processes have been proposed as a way to develop complex, contextually appropriate practices in education and mental health.

    “Explicit co-design processes – in which EBT developers specify major core components and an overarching structure, but allow service providers and recipients opportunities to determine more specific aspects of the intervention in real time – have been proposed as a method for the development of complex, contextually-appropriate practices in fields such as education (Penuel, Roschelle, & Shechtman,”
    Quote in the paperSubstantial claim0 of 2 sources checked
    • cites Penuel, Roschelle, & Shechtman, 2007

      Not checked in the free run.

    • cites Chorpita, Bernstein, & Daleiden, 2011

      Not checked in the free run.

  • Classified as probably not a substantial claim.

    Interpretationreasoning

    Not explicitly considering a product's design inevitably leads to problematic design.

    “Failure to explicitly consider a product’s design is a guaranteed pathway to problematic design.”
    Quote in the paperSubstantial claim

  • May combine two claims.

    Premisecitation

    Applying simplification carefully reduces complexity while improving user experiences and making products more scalable.

    “Vigilant application of the principle of simplification works to contain this complexity while enhancing user experiences and facilitating the scalability of products (Rogers, 2003; Yamey, 2011).”
    Quote in the paperSubstantial claim0 of 2 sources checked
    • cites Rogers, 2003

      Not checked in the free run.

    • cites Yamey, 2011 source

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    All human-made products are designed.

    “From a UCD perspective, all human-made products are designed and “the alternative to good design is bad design, not no design at all” (Martin, 1990, p.12).”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Martin, 1990

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    Norman has described cultural constraints as a kind of affordance that shapes user expectations and perceptions and affects design choices.

    “Norman (2004) has discussed cultural constraints, or learned conventions shared by a group, as a type of affordance that influences user expectations and perceptions and, in doing so, impacts design decisions.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Norman, 2004

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S2 (checkable), S4 (based).

    Interpretationnone given

    A user-centered design approach is a promising set of methods and a way forward for researchers and practitioners supporting the dissemination and implementation of psychosocial interventions.

    “It is our perspective that a UCD approach represents a promising collection of methods and a way forward for researchers and practitioners interested in supporting the dissemination and implementation of psychosocial interventions.”
    Quote in the paperNot a substantial claim

  • Probably not a substantial claim: may not pass S2 (checkable). May combine two claims.

    Interpretationreasoning

    Such constraints are unavoidable in real-world work and must be addressed during design or redesign for a product to work well in its destination context.

    “Constraints of this type are unavoidable when working in the real world and must be considered during the design or redesign process if a new product is to function well in a destination context.”
    Quote in the paperNot a substantial claim

  • May combine two claims.

    Premisecitation

    Prototyping has been shown to improve how well a product matches its users and how easy it is to use.

    “Robust evidence supports the use of prototyping to improve a product’s match with users and overall “ease of use” (Gordon & Bieman, 1997).”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Gordon & Bieman, 1997

      Not checked in the free run.

61 of 61

  • The paper relies on this without support.

    Existing implementation frameworks provide almost no guidance on specific methods for ensuring that EBT successfully meet user needs.

    “existing frameworks provide almost no guidance surrounding specific methods for ensuring that EBT successfully meet user needs”

  • The paper relies on this without support.

    High complexity can interfere with the extent to which EBT are readily accessible to providers or organizations interested in adopting them.

    “High complexity can interfere with the extent to which EBT are readily accessible to providers or organizations interested in adopting them to improve their practice.”

  • The paper relies on this without support.

    EBT are exceedingly difficult to train and learn.

    “As a partial function of their complexity, EBT are exceedingly difficult to train and learn.”

  • The paper relies on this without support.

    High-quality EBT training is expensive and elusive for many practitioners.

    “As a result of the effort required, high-quality EBT training is expensive and elusive for many practitioners.”

  • The paper relies on this without support.

    There are currently few clear principles or procedures available to guide ongoing adjustment and evaluation of EBT effectively.

    “However, there are currently few clear principles or procedures available to guide this work effectively.”

  • The paper relies on this without support.

    A university-based research team traditionally develops and tests an intervention extensively before it is disseminated as a fully-formed, static intervention protocol.

    “a university-based research team most traditionally develops and tests an intervention extensively, articulating its key functions and structure, before it is disseminated more broadly as a fully-formed, static intervention protocol.”

  • The paper relies on this without support.

    A UCD approach has not yet been applied to the development or implementation of EBT themselves.

    “Nevertheless, a UCD approach has not yet been applied to the development or implementation of EBT themselves.”

  • The paper relies on this without support.

    EBT development processes tend to emphasize the needs and perspectives of intervention developers over those of well-defined user groups.

    “EBT development processes tend to emphasize the needs and perspectives of intervention developers over those of well-defined user groups.”

  • The paper relies on this without support.

    Little research has focused on designing EBT to be responsive to the needs of decision makers while keeping intervention effectiveness intact or on systematically planning evaluations of the modifications needed to better fit setting constraints.

    “little research has focused on ways to design EBT to be responsive to the needs of these decision makers while keeping intervention effectiveness intact or to systematically plan evaluations of the modifications needed to better fit setting constraints”

  • The paper relies on this without support.

    No specific funding mechanisms currently exist to support comparable, rapid work in behavioral health.

    “but no specific funding mechanisms currently exist to support comparable, rapid work in behavioral health.”
10 of 10

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • iNNOVBC was developed using a user-centered design approach involving its primary and secondary end users, that is, BCSs and mental health professionals.

    “iNNOVBC was developed using a user-centered design approach involving its primary and secondary end users, that is, BCSs (11/24, 46%) and mental health professionals (13/24, 54%).”

    From Development and Evaluation of the Usefulness, Usability, and Feasibility of iNNOV Breast Cancer: Mixed Methods Study (2022) · cites this paper as [37]

    The “Identifying Users and User Needs” section describes user-centered design as identifying primary and secondary users and incorporating their perspectives during intervention development (page unavailable). It does not discuss iNNOVBC, breast cancer survivors, or the reported participant counts, so it supports the design approach but not its application to this intervention. (LLM, conf=0.85)

    Experimental — accuracy not yet measured

  • Interventions' design processes are rarely reported, and the absence of evidence-based reasoning behind their development contributes to a research-practice gap in the internet interventions domain, wherein evidence-based treatments struggle to be adopted in routine care.

    “Moreover, interventions’ design processes are rarely reported, and the absence of evidence-based reasoning behind its development [36] contributes to a research-practice gap in the internet interventions domain, wherein evidenced-based treatments struggle to be adopted in routine care [37].”

    From Development and Evaluation of the Usefulness, Usability, and Feasibility of iNNOV Breast Cancer: Mixed Methods Study (2022) · cites this paper as [37]

    Split into 2 atoms — 0 confirmed, 1 partially supported, 0 disputed, 0 misattributed, 1 unverifiable. Expand the claim to see per-atom verdicts.

    Experimental — accuracy not yet measured

  • Intervention programs are frequently planned by neglecting end users' perspective (eg, individual's goals, needs, skills, and contexts) and researchers often fail to involve end users in the development process.

    “Intervention programs are frequently planned by neglecting end users’ perspective (eg, individual’s goals, needs, skills, and contexts) and researchers often fail to involve end users in the development process [37,38].”

    From Development and Evaluation of the Usefulness, Usability, and Feasibility of iNNOV Breast Cancer: Mixed Methods Study (2022) · cites this paper as [37]

  • iNNOVBC was developed with a user-centered design approach and explored for usefulness, usability, and feasibility.

    “In this study, iNNOVBC—a guided, internet-delivered, individually tailored, ACT-influenced CBT intervention aiming at treating mild to moderate anxiety and depression as well as improving fatigue, insomnia, sexual dysfunction, and HRQoL in BCSs—was developed with a user-centered design approach [37] and explored concerning its usefulness, usability, and feasibility.”

    From Development and Evaluation of the Usefulness, Usability, and Feasibility of iNNOV Breast Cancer: Mixed Methods Study (2022) · cites this paper as [37]

Cites

Flagged first, then by citations

Research works printed but not linked: 10

  1. Aarons, 2013, Scaling-up evidence-based practices in child welfare services systems, CYF News
  2. Balas, 2000, Yearbook of medical informatics 2000: Patient-centered systems, 65
  3. Cooper, 2007, About face 3: The essentials of interaction design
  4. Grudin, 2002, PDC 2002 Proceedings of the Participatory Design Conference, Sweden, 144
  5. International Standards Organization, 1998, Ergonomic requirements for office work with visual display terminals (VDTs) - Part 11: Guidance on usability
  6. Martin, 1990, Book design: A practical introduction
  7. Rogers, 2003, Diffusions of innovations
  8. Salvo, 2007, A case of exhaustive documentation: Re-centering system-oriented organizations around user need, Technical Communication, 54, 46
  9. Sauro, 2011, A practical guide to the System Usability Scale: Background, benchmarks & best practices
  10. Weisz, 2011, Child and adolescent therapy: Cognitive-behavioral procedures, 379

Cited by

Sorted by citations

Related

Authors
Lyon, A. R., & Koerner, K.
Affiliations
University of Washington (US)
ORCID
Venue
Clinical Psychology: Science and Practice
Publisher
American Psychological Association (APA)
Published
2016-06
Volume
23
Issue
2
Pages
180-200
ISSN
  • 0969-5893 (ISSN-L)
  • 1468-2850
DOI
10.1111/cpsp.12154
PMC
PMC5812700
OpenAlex
W2443106973
Cited by
478
References
132
Citations by year
2026: 29 · 2025: 55 · 2024: 96 · 2023: 55 · 2022: 64 · 2021: 91 · 2020: 37 · 2019: 24 · 2018: 16 · 2017: 8 · 2016: 2 · 2015: 1
FWCI
31.05
Type
journal article
Language
en
Open access
Licence
doi.wiley.com/10.1002/tdm_license_1.1 (tdm)
Locations
  • Clinical Psychology Science and Practice (publishedVersion)
  • PubMed (publishedVersion)
  • PubMed Central (acceptedVersion)
Funders
  • National Institute of Mental Health (K08 MH095939, R25 MH080916)
  • US Department of Veterans Affairs
Topics
  • Health Sciences › Health Professions › General Health Professions › Health Policy Implementation Science
  • Physical Sciences › Computer Science › Human-Computer Interaction › Usability and User Interface Design
  • Social Sciences › Psychology › Applied Psychology › Digital Mental Health Interventions
Keywords
user-centered design, psychosocial interventions, evidence-based practice implementation, scale-up, end-user needs, rapid prototyping, natural constraints, design principles

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Claims read under definition version 3 (extract-v3) on 2026-09-28.

Classified by jev-1.13-20260917 (gold-guideline-v0.2) on 2026-09-28.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review