The DOI matches its Crossref record; 133 of the 134 references it cites were found in a registry or an index; none of the 121 sources its claims cite is checked for support yet.
User‐centered design for psychosocial intervention development and implementation.
Open accessAbstract
The current paper articulates how common difficulties encountered when attempting to implement or scale-up evidence-based treatments are exacerbated by fundamental design problems, which may be addressed by a set of principles and methods drawn from the contemporary field of user-centered design. User-centered design is an approach to product development that grounds the process in information collected about the individuals and settings where products will ultimately be used. To demonstrate the utility of this perspective, we present four design concepts and methods: (a) clear identification of end users and their needs, (b) prototyping/rapid iteration, (c) simplifying existing intervention parameters/procedures, and (d) exploiting natural constraints. We conclude with a brief design-focused research agenda for the developers and implementers of evidence-based treatments.
Overview
AI snapshot
Written from the paper’s full text.
TL;DR
This conceptual paper argues that common failures in implementing and scaling evidence-based psychosocial treatments stem partly from design flaws and can be addressed by user-centered design principles. It proposes four design concepts—identifying users and needs, prototyping/rapid iteration, simplification, and exploiting natural constraints—and outlines a design-focused research agenda.
Key findings
- The paper contends that evidence-based treatments are often disseminated as static, complex protocols, creating mismatches with community users and implementation contexts; it proposes user-centered design as a way to improve acceptability, feasibility, appropriateness, and long-term effectiveness.
- It identifies four transferable design concepts: clearly specifying primary, secondary, and negative users; using prototyping and rapid iteration; simplifying intervention parameters and materials; and treating contextual barriers as design constraints rather than obstacles to overcome.
- It cites examples and figures from other work, including that the 10-item System Usability Scale yields scores from 0–100 with scores above 70 considered acceptable for digital technologies, that software updates may be pushed out roughly every 6 weeks, and that school-based service windows may be about 3–4 sessions.
- It recommends a research agenda that includes usability assessment protocols, adapting measures such as the System Usability Scale to evidence-based treatments, using adherence data as a usability signal, and testing intervention configurations through routine outcome monitoring.
Methods
- Design: conceptual/theoretical paper, not an empirical study; it synthesizes user-centered design literature and applies it to psychosocial intervention development, packaging, and implementation.
- Data or sample: no study sample or dataset is analyzed; examples are drawn from prior literature and existing intervention efforts.
- Main analysis: narrative argument and framework development, organized around four design concepts with definitions, techniques, and applications to evidence-based treatments.
Limitations
- The authors state that the paper remains largely theoretical and that research is needed to test the applicability of user-centered design principles and evaluate system-, provider-, and client-level outcomes.
- The authors note that few studies have examined evidence-based treatment design features such as simplicity and usability in relation to implementation outcomes, and that no specific funding mechanisms currently support comparable rapid work in behavioral health.
- Evident from the text: there is no empirical evaluation, sample, or quantitative result reported here, so the proposed benefits and applications are not directly tested in this paper.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
0 of 121 cited sources checked · 0 supported · 0 flagged
In the paper
“the implementation and widespread reach of EBT in service systems are known to be influenced by a range of factors operating across multiple system levels (Aarons, Hurlburt, & Horwitz, 2011)”
§ User-Centered Design for Psychosocial Intervention Development and Implementation > Gaps in EBT Design, Implementation, and Effectiveness
What the sources say
- Not checked yetcites Aarons, Hurlburt, & Horwitz, 2011 source
Strength:boosted· not yet calibratedCausal:correlational· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes? Load-bearing: unclear✓ Based: passesNone of the sources cited for this claim have been checked yet.
In the paper
“intervention characteristics are commonly included in leading implementation frameworks (e.g., Damschroder et al., 2009; Rogers, 2003)”
§ User-Centered Design for Psychosocial Intervention Development and Implementation > Gaps in EBT Design, Implementation, and Effectiveness
What the sources say
- Not checked yetcites Damschroder et al., 2009 source
- Not checked yetcites Rogers, 2003
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes? Load-bearing: unclear✓ Based: passesA conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“many are exacerbated by the design or structure of EBT, user responses to those designs, and the ways that elements of EBT design interact with implementation processes”
§ User-Centered Design for Psychosocial Intervention Development and Implementation > Gaps in EBT Design, Implementation, and Effectiveness
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIn the paper
“manualized EBT protocols remain the primary medium through which research evidence is packaged and disseminated for use (Garland, Hawley, Brookman-Frazee, & Hurlburt, 2008)”
§ User-Centered Design for Psychosocial Intervention Development and Implementation > Gaps in EBT Design, Implementation, and Effectiveness
What the sources say
- Not checked yetcites Garland, Hawley, Brookman-Frazee, & Hurlburt, 2008
Load-bearingStrength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesNone of the sources cited for this claim have been checked yet.
In the paper
“numerous concerns about EBT appear to contribute to their low level of use by community practitioners (Chambless & Ollendick, 2001; Kazdin, 2008)”
§ User-Centered Design for Psychosocial Intervention Development and Implementation > Gaps in EBT Design, Implementation, and Effectiveness
What the sources say
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesNone of the sources cited for this claim have been checked yet.
In the paper
“are not routinely employed in service delivery (Kazdin, 2008; McHugh & Barlow, 2010).”
§ User-Centered Design for Psychosocial Intervention Development and Implementation > Abstract
What the sources say
Load-bearingStrength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesA conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“we articulate in this paper how many of the contemporary difficulties encountered during EBT implementation are exacerbated by fundamental design problems – embedded in both EBT themselves and typical EBT implementation processes”
§ User-Centered Design for Psychosocial Intervention Development and Implementation > Abstract
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes? Based: unclearIn the paper
“Product developers tend to underestimate user diversity in their design processes”
§ User-Centered Design for Psychosocial Intervention Development and Implementation > User-Centered Design to Improve EBT Development, Packaging, and Implementation Usability and User-Centered Design > Identifying Users and User Needs
What the sources say
- Not checked yetcites Kujala & Kauppinen, 2004
Load-bearingStrength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesNone of the sources cited for this claim have been checked yet.
In the paper
“ongoing adjustment and evaluation of EBT to ensure that a program is response to the local context provides an opportunity to increase intervention effectiveness over time (Aarons et al., 2012; Chambers et al., 2013)”
§ User-Centered Design for Psychosocial Intervention Development and Implementation > Gaps in EBT Design, Implementation, and Effectiveness
What the sources say
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesNone of the sources cited for this claim have been checked yet.
In the paper
“even intensive “train and hope” approaches are unlikely to result in meaningful practitioner behavior change without ongoing consultation or coaching (Beidas & Kendall, 2010; Fixsen et al., 2005; Lyon, Stirman, Kerns, & Bruns, 2011)”
§ User-Centered Design for Psychosocial Intervention Development and Implementation > Gaps in EBT Design, Implementation, and Effectiveness
What the sources say
- Not checked yetcites Beidas & Kendall, 2010
- Not checked yetcites Fixsen et al., 2005
- Not checked yetcites Lyon, Stirman, Kerns, & Bruns, 2011 source
Load-bearingStrength:hedged· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIn the paper
“successful implementation occurs as a function of both the intervention itself and the destination context (Rogers, 2003)”
§ User-Centered Design for Psychosocial Intervention Development and Implementation > Gaps in EBT Design, Implementation, and Effectiveness
What the sources say
- Not checked yetcites Rogers, 2003
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesA conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“which leads to (a) design decisions that are not necessarily applicable to the constraints of the contexts in which they will ultimately be used”
§ User-Centered Design for Psychosocial Intervention Development and Implementation > Gaps in EBT Design, Implementation, and Effectiveness
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIn the paper
“some lead user needs may be too advanced to be relevant to less experienced users (Kujala & Kauppinen, 2002)”
§ User-Centered Design for Psychosocial Intervention Development and Implementation > User-Centered Design to Improve EBT Development, Packaging, and Implementation Usability and User-Centered Design > Identifying Users and User Needs
What the sources say
- Not checked yetcites Kujala & Kauppinen, 2002
Strength:hedged· not yet calibratedCausal:conditional· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes? Load-bearing: unclear✓ Based: passesIn the paper
“and may lead to lower clinician performance (e.g., Jewell, Handwerk, Almquist, & Lucas, 2004)”
§ User-Centered Design for Psychosocial Intervention Development and Implementation > Gaps in EBT Design, Implementation, and Effectiveness
What the sources say
- Not checked yetcites Jewell, Handwerk, Almquist, & Lucas, 2004
Strength:hedged· not yet calibratedCausal:conditional· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes? Load-bearing: unclear✓ Based: passesA conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“and (b) implementation processes that devote excessive resources to adhering to design time specifications that may be inappropriate (e.g., strict emphases on intervention integrity)”
§ User-Centered Design for Psychosocial Intervention Development and Implementation > Gaps in EBT Design, Implementation, and Effectiveness
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesA conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Seen this way, EBT suffer from a disconnect between the design context and implementation context”
§ User-Centered Design for Psychosocial Intervention Development and Implementation > Gaps in EBT Design, Implementation, and Effectiveness
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIn the paper
“Authors have also begun to explore the relevance of these ideas to mental and behavioral health interventions (most notably Chorpita & Daleiden, 2013), although not within an explicit UCD framework.”
§ User-Centered Design for Psychosocial Intervention Development and Implementation > User-Centered Design to Improve EBT Development, Packaging, and Implementation Usability and User-Centered Design
What the sources say
- Not checked yetcites Chorpita & Daleiden, 2013
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesNone of the sources cited for this claim have been checked yet.
In the paper
“problematic system design can easily undermine otherwise appealing and effective products (Littlejohns, Wyatt, & Garvican, 2003; Karsh, 2004)”
§ User-Centered Design for Psychosocial Intervention Development and Implementation > User-Centered Design to Improve EBT Development, Packaging, and Implementation Usability and User-Centered Design
What the sources say
- Not checked yetcites Littlejohns, Wyatt, & Garvican, 2003
- Not checked yetcites Karsh, 2004 source
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesA conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“all of the concerns described above are perpetuated by existing divisions between intervention design (e.g., development and testing) and intervention implementation processes (e.g., training, scale-up, sustainment)”
§ User-Centered Design for Psychosocial Intervention Development and Implementation > Gaps in EBT Design, Implementation, and Effectiveness
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesA conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Findings such as these threaten to undermine the legitimacy of EBT and the basic arguments on which their implementation is based.”
§ User-Centered Design for Psychosocial Intervention Development and Implementation > Gaps in EBT Design, Implementation, and Effectiveness
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesNone of the sources cited for this claim have been checked yet.
In the paper
“In the absence of this information, developers are likely to base designs on people similar to themselves (Cooper, 1999; Kujala & Mäntylä, 2000).”
§ User-Centered Design for Psychosocial Intervention Development and Implementation > User-Centered Design to Improve EBT Development, Packaging, and Implementation Usability and User-Centered Design > Identifying Users and User Needs
What the sources say
- Not checked yetcites Cooper, 1999 source
- Not checked yetcites Kujala & Mäntylä, 2000
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesNone of the sources cited for this claim have been checked yet.
In the paper
“UCD principles can be applied not only to the creation and improvement of software and physical products, but also to design of effective social phenomena, such as service design (Goldstein, Johnston, Duffy, & Rao, 2002; Zomerdijk & Voss, 2010) or instructional design (Gagne, Wagner, Golas, Keller, & Russell, 2004; Van Merriënboer, Kirschner, & Kester, 2003).”
§ User-Centered Design for Psychosocial Intervention Development and Implementation > User-Centered Design to Improve EBT Development, Packaging, and Implementation Usability and User-Centered Design
What the sources say
- Not checked yetcites Goldstein, Johnston, Duffy, & Rao, 2002
- Not checked yetcites Zomerdijk & Voss, 2010 source
- Not checked yetcites Gagne, Wagner, Golas, Keller, & Russell, 2004
Load-bearingStrength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIn the paper
“emerging implementation strategies (Powell et al., 2015) have typically been used to implement relatively static EBT in a unidirectional fashion, emphasizing design time control”
§ User-Centered Design for Psychosocial Intervention Development and Implementation > Gaps in EBT Design, Implementation, and Effectiveness
What the sources say
- Not checked yetcites Powell et al., 2015 source
Load-bearingStrength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIn the paper
“EBT are typically disseminated as static tools to be used only as directed by developers, rather than products to be improved over time (Chambers, Glasgow, & Stange, 2013)”
§ User-Centered Design for Psychosocial Intervention Development and Implementation > Gaps in EBT Design, Implementation, and Effectiveness
What the sources say
- Not checked yetcites Chambers, Glasgow, & Stange, 2013 source
Load-bearingStrength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIn the paper
“some limited work has applied design principles to topics such as the instructional design of clinician training programs (Weingardt, 2004)”
§ User-Centered Design for Psychosocial Intervention Development and Implementation > User-Centered Design to Improve EBT Development, Packaging, and Implementation Usability and User-Centered Design
What the sources say
- Not checked yetcites Weingardt, 2004 source
Strength:hedged· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes? Load-bearing: unclear✓ Based: passesIn the paper
“but is accompanied by increased uncertainty (Chorpita & Daleiden, 2014)”
§ User-Centered Design for Psychosocial Intervention Development and Implementation > Gaps in EBT Design, Implementation, and Effectiveness
What the sources say
- Not checked yetcites Chorpita & Daleiden, 2014
Strength:plain· not yet calibratedCausal:correlational· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes? Load-bearing: unclear✓ Based: passesNone of the sources cited for this claim have been checked yet.
In the paper
“some recent research has raised questions about their actual superiority (e.g., Spielmans, Gatlin, & McFall, 2010; Weisz et al., 2012; Weisz et al., 2013)”
§ User-Centered Design for Psychosocial Intervention Development and Implementation > Gaps in EBT Design, Implementation, and Effectiveness
What the sources say
Load-bearingStrength:hedged· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIn the paper
“Some evidence exists to suggest the utility of this process in producing more usable systems (Kujala & Kauppinen, 2004).”
§ User-Centered Design for Psychosocial Intervention Development and Implementation > User-Centered Design to Improve EBT Development, Packaging, and Implementation Usability and User-Centered Design > Identifying Users and User Needs
What the sources say
- Not checked yetcites Kujala & Kauppinen, 2004
Strength:hedged· not yet calibratedCausal:conditional· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes? Load-bearing: unclear✓ Based: passesIn the paper
“or, if they do, are struggling to use them routinely and successfully (Becker, Smith, & Jensen-Doss, 2013)”
§ User-Centered Design for Psychosocial Intervention Development and Implementation > User-Centered Design to Improve EBT Development, Packaging, and Implementation Usability and User-Centered Design > Identifying Users and User Needs
What the sources say
- Not checked yetcites Becker, Smith, & Jensen-Doss, 2013
Load-bearingStrength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesA conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“but their needs extend well beyond this construct”
§ User-Centered Design for Psychosocial Intervention Development and Implementation > User-Centered Design to Improve EBT Development, Packaging, and Implementation Usability and User-Centered Design > Identifying Users and User Needs
Load-bearingStrength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIn the paper
“service recipients generally report favorable experiences receiving EBT (Hodgetts & Wright, 2007)”
§ User-Centered Design for Psychosocial Intervention Development and Implementation > User-Centered Design to Improve EBT Development, Packaging, and Implementation Usability and User-Centered Design > Identifying Users and User Needs
What the sources say
- Not checked yetcites Hodgetts & Wright, 2007
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes? Load-bearing: unclear✓ Based: passesThe paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“Both of these types of EBT are intended to allow for more flexibility in addressing client problems identified across different stages of treatment.”
§ User-Centered Design for Psychosocial Intervention Development and Implementation > User-Centered Design to Improve EBT Development, Packaging, and Implementation Usability and User-Centered Design > Identifying Users and User Needs
Strength:plain· not yet calibratedCausal:direct· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes? Load-bearing: unclear✓ Based: passesIn the paper
“findings indicating that incomplete penetration and sustainment are the norm (Stirman et al., 2012)”
§ User-Centered Design for Psychosocial Intervention Development and Implementation > User-Centered Design to Improve EBT Development, Packaging, and Implementation Usability and User-Centered Design > Identifying Users and User Needs
What the sources say
- Not checked yetcites Stirman et al., 2012 source
Load-bearingStrength:hedged· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIn the paper
“UCD methods that evaluate (e.g., via contextual inquiry or other participatory approaches; Holtzblatt, Wendell, & Wood, 2004) and address these types of concerns directly have the potential to increase the “patient-centeredness” of interventions by incorporating consumer preferences and ensuring responsivity to consumer needs”
§ User-Centered Design for Psychosocial Intervention Development and Implementation > User-Centered Design to Improve EBT Development, Packaging, and Implementation Usability and User-Centered Design > Identifying Users and User Needs
What the sources say
- Not checked yetcites Holtzblatt, Wendell, & Wood, 2004
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIn the paper
“Because Masters-level therapists provide the bulk of mental health services in community settings (Hyde, 2013)”
§ User-Centered Design for Psychosocial Intervention Development and Implementation > User-Centered Design to Improve EBT Development, Packaging, and Implementation Usability and User-Centered Design > Identifying Users and User Needs
What the sources say
- Not checked yetcites Hyde, 2013
Load-bearingStrength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesA conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“A UCD perspective may also allow EBT to be designed to address complex or changing client problems”
§ User-Centered Design for Psychosocial Intervention Development and Implementation > User-Centered Design to Improve EBT Development, Packaging, and Implementation Usability and User-Centered Design > Identifying Users and User Needs
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIn the paper
“one promising approach to better include consumer needs is through direct user participation in the initial development, redesign, or evaluation of interventions themselves (Boote, Baird, & Beecroft, 2010)”
§ User-Centered Design for Psychosocial Intervention Development and Implementation > User-Centered Design to Improve EBT Development, Packaging, and Implementation Usability and User-Centered Design > Identifying Users and User Needs
What the sources say
- Not checked yetcites Boote, Baird, & Beecroft, 2010 source
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIn the paper
“consumers of mental health services are a frequently ignored, but essential, primary EBT user type (Sanders & Kirby, 2014)”
§ User-Centered Design for Psychosocial Intervention Development and Implementation > User-Centered Design to Improve EBT Development, Packaging, and Implementation Usability and User-Centered Design > Identifying Users and User Needs
What the sources say
- Not checked yetcites Sanders & Kirby, 2014
Load-bearingStrength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIn the paper
“consumer perspectives are most commonly captured in surveys of mental healthcare satisfaction (e.g., Solberg, Larsson, & Jozefiak, 2014)”
§ User-Centered Design for Psychosocial Intervention Development and Implementation > User-Centered Design to Improve EBT Development, Packaging, and Implementation Usability and User-Centered Design > Identifying Users and User Needs
What the sources say
- Not checked yetcites Solberg, Larsson, & Jozefiak, 2014
Strength:plain· not yet calibratedCausal:correlational· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes? Load-bearing: unclear✓ Based: passesIn the paper
“available evidence suggests that EBT are not particularly well aligned with the needs of this group (Addis, Wade, & Hatgis, 1999)”
§ User-Centered Design for Psychosocial Intervention Development and Implementation > User-Centered Design to Improve EBT Development, Packaging, and Implementation Usability and User-Centered Design > Identifying Users and User Needs
What the sources say
- Not checked yetcites Addis, Wade, & Hatgis, 1999 source
Load-bearingStrength:hedged· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesNone of the sources cited for this claim have been checked yet.
In the paper
“Examples of interventions designed to address these issues come from contemporary work on “transdiagnostic” and “modularized” approaches to intervention (Barlow, Allen, & Choate, 2004; Chorpita, Daleiden, & Weisz, 2005b; Roy-Byrne et al., 2010; Weisz et al., 2012) as well as more principle-driven (rather than traditionally manualized) interventions (Koerner, 2013).”
§ User-Centered Design for Psychosocial Intervention Development and Implementation > User-Centered Design to Improve EBT Development, Packaging, and Implementation Usability and User-Centered Design > Identifying Users and User Needs
What the sources say
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes? Load-bearing: unclear✓ Based: passesA conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“this group is an important set of primary users”
§ User-Centered Design for Psychosocial Intervention Development and Implementation > User-Centered Design to Improve EBT Development, Packaging, and Implementation Usability and User-Centered Design > Identifying Users and User Needs
Load-bearingStrength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIn the paper
“many of these intended EBT users do not view EBT as necessary or relevant to their work (Nakamura, Higa-McMillan, Okamura, & Shimabukuro, 2011)”
§ User-Centered Design for Psychosocial Intervention Development and Implementation > User-Centered Design to Improve EBT Development, Packaging, and Implementation Usability and User-Centered Design > Identifying Users and User Needs
What the sources say
- Not checked yetcites Nakamura, Higa-McMillan, Okamura, & Shimabukuro, 2011
Load-bearingStrength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesNone of the sources cited for this claim have been checked yet.
In the paper
“given perpetual workforce shortages and rising populations of individuals in need of mental health services (U.S. DHHS, 2013; Kakuma et al., 2011), it may be the case that, in some situations, traditional mental health therapists are not the optimal “intervention pilots” or front-line service deliverers.”
§ User-Centered Design for Psychosocial Intervention Development and Implementation > User-Centered Design to Improve EBT Development, Packaging, and Implementation Usability and User-Centered Design > Identifying Users and User Needs
What the sources say
- Not checked yetcites U.S. DHHS, 2013
- Not checked yetcites Kakuma et al., 2011 source
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesA conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Redefined roles of this type may also help to make room for the development and use of simplified “disruptive innovations” within the EBT domain”
§ User-Centered Design for Psychosocial Intervention Development and Implementation > User-Centered Design to Improve EBT Development, Packaging, and Implementation Usability and User-Centered Design > Identifying Users and User Needs
Strength:hedged· not yet calibratedCausal:conditional· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes? Load-bearing: unclear✓ Based: passesNone of the sources cited for this claim have been checked yet.
In the paper
“research has documented that EBT consumers may also experience a number of barriers to successfully engaging in, and benefitting from, those interventions. These include questions about their accessibility, perceived flexibility and cultural relevance, among others (Becker, Spririto, & Vanmali, in press; Hodgetts & Wright, 2007).”
§ User-Centered Design for Psychosocial Intervention Development and Implementation > User-Centered Design to Improve EBT Development, Packaging, and Implementation Usability and User-Centered Design > Identifying Users and User Needs
What the sources say
- Not checked yetcites Becker, Spririto, & Vanmali, in press
- Not checked yetcites Hodgetts & Wright, 2007
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesA conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“In that scenario, use of a web-based platform is likely to increase the user- and patient-centeredness of the intervention.”
§ User-Centered Design for Psychosocial Intervention Development and Implementation > User-Centered Design to Improve EBT Development, Packaging, and Implementation Usability and User-Centered Design > Identifying Users and User Needs
Strength:hedged· not yet calibratedCausal:conditional· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes? Load-bearing: unclear✓ Based: passesA conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Well-designed systems reduce the need for such workarounds.”
§ User-Centered Design for Psychosocial Intervention Development and Implementation > User-Centered Design to Improve EBT Development, Packaging, and Implementation Usability and User-Centered Design > Identifying Users and User Needs
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIn the paper
“substantial disconnects have been identified between developers, who are typically doctoral-level researchers or trainees working in academic settings, and public-sector mental health therapists, who are likely to be among the end users of the protocol (Weisz et al., 2006)”
§ User-Centered Design for Psychosocial Intervention Development and Implementation > User-Centered Design to Improve EBT Development, Packaging, and Implementation Usability and User-Centered Design > Identifying Users and User Needs
What the sources say
- Not checked yetcites Weisz et al., 2006 source
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesA conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“rather than using analogue conditions (e.g., vignettes [Wright, Weinman, & Marteau, 2003]; participants that approximate clinical populations [Barlow, Agras, Leitenberg, & Weincze, 1970]) to represent the phenomena of interest, microtrial studies are more likely to reflect real-world conditions (e.g., real service recipients and clinical interactions).”
§ User-Centered Design for Psychosocial Intervention Development and Implementation > User-Centered Design to Improve EBT Development, Packaging, and Implementation Usability and User-Centered Design > Prototyping and Rapid Iteration
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIn the paper
“within an existing network, the less change required, the more implementation may occur.”
§ User-Centered Design for Psychosocial Intervention Development and Implementation > User-Centered Design to Improve EBT Development, Packaging, and Implementation Usability and User-Centered Design > Design Simplification
What the sources say
- Not checked yetcites Aarons & Chaffin, 2013
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIn the paper
“emerging evidence indicates that it is possible to reduce complexity without deleterious consequences (e.g., Rahman, Malik, Sikander, Roberts, & Creed, 2008).”
§ User-Centered Design for Psychosocial Intervention Development and Implementation > User-Centered Design to Improve EBT Development, Packaging, and Implementation Usability and User-Centered Design > Design Simplification
What the sources say
- Not checked yetcites Rahman, Malik, Sikander, Roberts, & Creed, 2008 source
Load-bearingStrength:hedged· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIn the paper
“Emerging evidence suggests that the ICT process can facilitate the alignment of the structure of evidence-based practices with local contextual variations (Hurlburt et al., 2014).”
§ User-Centered Design for Psychosocial Intervention Development and Implementation > User-Centered Design to Improve EBT Development, Packaging, and Implementation Usability and User-Centered Design > Exploit Natural Constraints
What the sources say
- Not checked yetcites Hurlburt et al., 2014 source
Strength:hedged· not yet calibratedCausal:conditional· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes? Load-bearing: unclear✓ Based: passesNone of the sources cited for this claim have been checked yet.
In the paper
“Constraints may include practitioner caseload size, the regularity or duration with which clients attend sessions, practitioner time for training, and organizational or individual priorities (Lyon et al., 2014c; Southam-Gerow, Rodriguez, Chorpita, & Daleiden, 2012).”
§ User-Centered Design for Psychosocial Intervention Development and Implementation > User-Centered Design to Improve EBT Development, Packaging, and Implementation Usability and User-Centered Design > Exploit Natural Constraints
What the sources say
- Not checked yetcites Lyon et al., 2014c
- Not checked yetcites Southam-Gerow, Rodriguez, Chorpita, & Daleiden, 2012
Strength:hedged· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes? Load-bearing: unclear✓ Based: passesA conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Because it opens the door to a greater number of variants and decreases the costs associated with testing new alternatives, rapid prototyping may be more likely to result in new EBT protocol innovations than current models.”
§ User-Centered Design for Psychosocial Intervention Development and Implementation > User-Centered Design to Improve EBT Development, Packaging, and Implementation Usability and User-Centered Design > Prototyping and Rapid Iteration
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesNone of the sources cited for this claim have been checked yet.
In the paper
“In the context of EBT, natural constraints are frequently conceptualized as barriers to implementation, represented as antagonistic to the internal validity of the EBT and as factors that must be overcome if program adoption and sustainment are to occur.”
§ User-Centered Design for Psychosocial Intervention Development and Implementation > User-Centered Design to Improve EBT Development, Packaging, and Implementation Usability and User-Centered Design > Exploit Natural Constraints
What the sources say
- Not checked yetcites Lyon et al., 2014c
- Not checked yetcites Southam-Gerow, Rodriguez, Chorpita, & Daleiden, 2012
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesNone of the sources cited for this claim have been checked yet.
In the paper
“Frazier and colleagues (2012), engaged in an elaborate process to redesign an existing EBT – the Summer Treatment Program (STP) for disruptive behavior problems (Pelham et al., 1997) – for use in a low-income, urban after-school environment that paid explicit attention to a natural constraints.”
§ User-Centered Design for Psychosocial Intervention Development and Implementation > User-Centered Design to Improve EBT Development, Packaging, and Implementation Usability and User-Centered Design > Exploit Natural Constraints
What the sources say
- Not checked yetcites Frazier et al., 2012
- Not checked yetcites Pelham et al., 1997 source
Load-bearingStrength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIn the paper
“The concept of microtrials (Howe, Beach, & Brody, 2010), represents a feasible approach to engaging in rapid, small-scale prototyping to develop and evaluate components of psychosocial interventions.”
§ User-Centered Design for Psychosocial Intervention Development and Implementation > User-Centered Design to Improve EBT Development, Packaging, and Implementation Usability and User-Centered Design > Prototyping and Rapid Iteration
What the sources say
- Not checked yetcites Howe, Beach, & Brody, 2010
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesA conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“In this way, rapid prototyping may systematize the processes through which practitioners tend to apply EBT in the real world”
§ User-Centered Design for Psychosocial Intervention Development and Implementation > User-Centered Design to Improve EBT Development, Packaging, and Implementation Usability and User-Centered Design > Prototyping and Rapid Iteration
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIn the paper
“Notably, the overarching goal of this project was not the implementation of the STP, but the identification of a set of practices that could best support the existing mission of the destination context (i.e., a design solution that highlighted environmental constraints).”
§ User-Centered Design for Psychosocial Intervention Development and Implementation > User-Centered Design to Improve EBT Development, Packaging, and Implementation Usability and User-Centered Design > Exploit Natural Constraints
What the sources say
- Not checked yetcites Frazier et al., 2012
Load-bearingStrength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesA conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Considering the complexity of contemporary EBT, deliberate simplification may enhance the potential of effective programs to spread within service systems.”
§ User-Centered Design for Psychosocial Intervention Development and Implementation > User-Centered Design to Improve EBT Development, Packaging, and Implementation Usability and User-Centered Design > Design Simplification
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesA conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Such approaches have considerable potential to account for natural constraints because local providers are given license to address them as they arise.”
§ User-Centered Design for Psychosocial Intervention Development and Implementation > User-Centered Design to Improve EBT Development, Packaging, and Implementation Usability and User-Centered Design > Exploit Natural Constraints
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIn the paper
“which commonly involve a series of non-systematic adaptations (Stirman, Miller, Toder, & Calloway, 2013).”
§ User-Centered Design for Psychosocial Intervention Development and Implementation > User-Centered Design to Improve EBT Development, Packaging, and Implementation Usability and User-Centered Design > Prototyping and Rapid Iteration
What the sources say
- Not checked yetcites Stirman, Miller, Toder, & Calloway, 2013 source
Load-bearingStrength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesNone of the sources cited for this claim have been checked yet.
In the paper
“there has been little research focused explicitly on procedures for realizing this goal (Aarons et al., 2012; Lyon et al., 2014c).”
§ User-Centered Design for Psychosocial Intervention Development and Implementation > User-Centered Design to Improve EBT Development, Packaging, and Implementation Usability and User-Centered Design > Exploit Natural Constraints
What the sources say
- Not checked yetcites Aarons et al., 2012 source
- Not checked yetcites Lyon et al., 2014c
Load-bearingStrength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIn the paper
“Recently, microtrials have been identified as a feasible method for testing individual parenting techniques (e.g., praise) to determine their discrete merit and ultimately drive more individualized, tailored service delivery (Leijten, Dishion, Thomaes, Raaijmakers, & Matthys, 2015).”
§ User-Centered Design for Psychosocial Intervention Development and Implementation > User-Centered Design to Improve EBT Development, Packaging, and Implementation Usability and User-Centered Design > Prototyping and Rapid Iteration
What the sources say
- Not checked yetcites Leijten, Dishion, Thomaes, Raaijmakers, & Matthys, 2015
Strength:plain· not yet calibratedCausal:direct· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes? Load-bearing: unclear✓ Based: passesIn the paper
“studies that have examined aspects of EBT design (e.g., simplicity, usability) and their connections to identified implementation outcomes (Proctor et al., 2011) are almost nonexistent.”
§ User-Centered Design for Psychosocial Intervention Development and Implementation > Discussion and Future Directions > A Design-Based Research Agenda
What the sources say
- Not checked yetcites Proctor et al., 2011 source
Load-bearingStrength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIn the paper
“Considered from this perspective, routine outcome monitoring may represent a potential minimum intervention necessary for change when working to enhance the quality of community-based services (Scott & Lewis, 2014).”
§ User-Centered Design for Psychosocial Intervention Development and Implementation > User-Centered Design to Improve EBT Development, Packaging, and Implementation Usability and User-Centered Design > Design Simplification
What the sources say
- Not checked yetcites Scott & Lewis, 2014 source
Strength:hedged· not yet calibratedCausal:conditional· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes? Load-bearing: unclear✓ Based: passes
- Probably not a substantial claim. 48
- It may state two separate claims as one. 19
In the paper
“the field of implementation science has emerged, explicitly tasked with improving the use of well-researched interventions in everyday service settings (Eccles & Mittman, 2006)”
§ User-Centered Design for Psychosocial Intervention Development and Implementation > Abstract
What the sources say
- Not checked yetcites Eccles & Mittman, 2006 source
Strength:plain· not yet calibratedCausal:direct· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it.
None of the sources cited for this claim have been checked yet.
In the paper
“there is ongoing debate surrounding the extent to which EBT are able to effectively balance structure and flexibility when introduced to service providers working in community contexts (Chambless & Ollendick, 2001; Hill & Owens, 2013; Lieb, Mayfield, Miller, & Pennucci, 2004)”
§ User-Centered Design for Psychosocial Intervention Development and Implementation > Gaps in EBT Design, Implementation, and Effectiveness
What the sources say
- Not checked yetcites Chambless & Ollendick, 2001 source
- Not checked yetcites Hill & Owens, 2013
- Not checked yetcites Lieb, Mayfield, Miller, & Pennucci, 2004
Load-bearingStrength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesProbably not a substantial claim.
In the paper
“Wu et al. (2014) have discussed the relevance of the related discipline of engineering to implementation and mental health services”
§ User-Centered Design for Psychosocial Intervention Development and Implementation > User-Centered Design to Improve EBT Development, Packaging, and Implementation Usability and User-Centered Design
What the sources say
- Not checked yetcites Wu et al., 2014
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it.
In the paper
“Maguire (2001) has identified that usable systems result in increased productivity, a reduction of errors, require fewer resources for training and support, are more acceptable to users, and enjoy enhanced reputations within the user market.”
§ User-Centered Design for Psychosocial Intervention Development and Implementation > User-Centered Design to Improve EBT Development, Packaging, and Implementation Usability and User-Centered Design
What the sources say
- Not checked yetcites Maguire, 2001 source
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesProbably not a substantial claim. It may state two separate claims as one.
None of the sources cited for this claim have been checked yet.
In the paper
“The UCD field places strong emphasis on explicitly identifying primary, secondary, and sometimes tertiary users in order to ensure that new products effectively meet their needs (Cooper, Reimann, & Cronin, 2007; Grudin & Pruitt, 2002).”
§ User-Centered Design for Psychosocial Intervention Development and Implementation > User-Centered Design to Improve EBT Development, Packaging, and Implementation Usability and User-Centered Design > Identifying Users and User Needs
What the sources say
- Not checked yetcites Cooper, Reimann, & Cronin, 2007
- Not checked yetcites Grudin & Pruitt, 2002
Strength:boosted· not yet calibratedCausal:direct· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it.
In the paper
“Usability has been conceptualized as a combination of constructs including (a) learnability, (b) efficiency, (c) memorability, (d) error frequency/severity, and (e) satisfaction (Nielsen, 1994).”
§ User-Centered Design for Psychosocial Intervention Development and Implementation > User-Centered Design to Improve EBT Development, Packaging, and Implementation Usability and User-Centered Design
What the sources say
- Not checked yetcites Nielsen, 1994
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it.
In the paper
“Although this method has been found to improve the efficiency of the product design process (Olson & Bakke, 2001)”
§ User-Centered Design for Psychosocial Intervention Development and Implementation > User-Centered Design to Improve EBT Development, Packaging, and Implementation Usability and User-Centered Design > Identifying Users and User Needs
What the sources say
- Not checked yetcites Olson & Bakke, 2001
Strength:plain· not yet calibratedCausal:direct· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it.
None of the sources cited for this claim have been checked yet.
In the paper
“others have advocated for usability testing and iterative design in the context of health information technologies to support clinical decision-making (e.g., Bickman, Kelley, & Anthay, 2012; Lyon et al., in press-b)”
§ User-Centered Design for Psychosocial Intervention Development and Implementation > User-Centered Design to Improve EBT Development, Packaging, and Implementation Usability and User-Centered Design
What the sources say
- Not checked yetcites Bickman, Kelley, & Anthay, 2012
- Not checked yetcites Lyon et al., in press-b
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it.
In the paper
“but careful identification of representative user needs can correct this bias and enhance product quality (Kujala & Kauppinen, 2004)”
§ User-Centered Design for Psychosocial Intervention Development and Implementation > User-Centered Design to Improve EBT Development, Packaging, and Implementation Usability and User-Centered Design > Identifying Users and User Needs
What the sources say
- Not checked yetcites Kujala & Kauppinen, 2004
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIt may state two separate claims as one.
None of the sources cited for this claim have been checked yet.
In the paper
“the failure of most implementation processes to incorporate ongoing, iterative intervention development increases the risk that local users will find new technologies to be low on key implementation outcomes such as acceptability, feasibility, and appropriateness (Proctor et al., 2011) and may limit effectiveness (Chambers et al., 2013)”
§ User-Centered Design for Psychosocial Intervention Development and Implementation > Gaps in EBT Design, Implementation, and Effectiveness
What the sources say
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIt may state two separate claims as one.
In the paper
“One parsimonious model for user identification is the lead user approach, wherein the experiences of particularly advanced users are collected to uncover system problems and solutions (which lead users often identify on their own) (von Hippel, 1989).”
§ User-Centered Design for Psychosocial Intervention Development and Implementation > User-Centered Design to Improve EBT Development, Packaging, and Implementation Usability and User-Centered Design > Identifying Users and User Needs
What the sources say
- Not checked yetcites von Hippel, 1989 source
Strength:plain· not yet calibratedCausal:direct· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Because EBT have historically focused primarily on the identification of robust, often complicated, solutions for highly specified problems (i.e., diagnosable clinical disorders), it could be said that they have overemphasized engineering to the detriment of design.”
§ User-Centered Design for Psychosocial Intervention Development and Implementation > User-Centered Design to Improve EBT Development, Packaging, and Implementation Usability and User-Centered Design
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesProbably not a substantial claim. It may state two separate claims as one.
None of the sources cited for this claim have been checked yet.
In the paper
“Other authors have included additional criteria for usable products such as functional minimalism (i.e., too many features, functions, or components will reduce usability), low cognitive load (i.e., minimize the amount of thinking required to complete a task), clear feedback to users (e.g., about product status, success or failure), and exploitation of the natural constraints present in an environ”
§ User-Centered Design for Psychosocial Intervention Development and Implementation > User-Centered Design to Improve EBT Development, Packaging, and Implementation Usability and User-Centered Design
What the sources say
- Not checked yetcites Norman, 1988
- Not checked yetcites Tognazzini, 2014
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
In the paper
“most psychosocial interventions are complex, and carry numerous decision points during the course of their use (Chorpita, Bernstein, & Daleiden, 2008)”
§ User-Centered Design for Psychosocial Intervention Development and Implementation > Gaps in EBT Design, Implementation, and Effectiveness
What the sources say
- Not checked yetcites Chorpita, Bernstein, & Daleiden, 2008
Load-bearingStrength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIt may state two separate claims as one.
In the paper
“Flexibility (e.g., via allowable adaptations) is inherently appealing when working to deliver individualized or locally-relevant services (Lyon, Lau, McCauley, Vander Stoep, & Chorpita, 2014)”
§ User-Centered Design for Psychosocial Intervention Development and Implementation > Gaps in EBT Design, Implementation, and Effectiveness
What the sources say
- Not checked yetcites Lyon, Lau, McCauley, Vander Stoep, & Chorpita, 2014
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it.
In the paper
“trends suggest increasing complexity as EBT developers pursue applications to wider populations, but this added complexity often carries little additional benefit (e.g., Chaffin et al., 2004)”
§ User-Centered Design for Psychosocial Intervention Development and Implementation > Gaps in EBT Design, Implementation, and Effectiveness
What the sources say
- Not checked yetcites Chaffin et al., 2004 source
Strength:hedged· not yet calibratedCausal:correlational· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes? Load-bearing: unclear✓ Based: passesIt may state two separate claims as one.
In the paper
“Chorpita and Daleiden (2014) recently distinguished this dominant emphasis on “design time” control (i.e., determining features in advance) from “run time” control, which they defined as configuration based on how a product interacts with its environment.”
§ User-Centered Design for Psychosocial Intervention Development and Implementation > Gaps in EBT Design, Implementation, and Effectiveness
What the sources say
- Not checked yetcites Chorpita & Daleiden, 2014
Load-bearingStrength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesProbably not a substantial claim.
In the paper
“Use of diverse user groups is important when designing products for organizations, which inevitably contain individuals representing different user types (Kujala & Kauppinen, 2004).”
§ User-Centered Design for Psychosocial Intervention Development and Implementation > User-Centered Design to Improve EBT Development, Packaging, and Implementation Usability and User-Centered Design > Identifying Users and User Needs
What the sources say
- Not checked yetcites Kujala & Kauppinen, 2004
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“A reconceptualization of how intervention technologies are initially developed, prepared for dissemination, and then ultimately implemented may help to capitalize on opportunities to increase intervention appropriateness and effectiveness over time.”
§ User-Centered Design for Psychosocial Intervention Development and Implementation > Gaps in EBT Design, Implementation, and Effectiveness
Tests✓ Asserted: passes✗ Checkable: fails✓ Load-bearing: passes✗ Based: failsProbably not a substantial claim. It may be too vague to check against evidence. The paper may give no reason why it holds.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Just like other consumer products, EBT can be intentionally designed using methods that ensure the needs of target users are incorporated into the development process.”
§ User-Centered Design for Psychosocial Intervention Development and Implementation > Gaps in EBT Design, Implementation, and Effectiveness
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✗ Based: failsProbably not a substantial claim. The paper may give no reason why it holds.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“These changes may include increases in individual staff expertise due to experience (e.g., new therapists becoming increasingly comfortable in clinical interactions) or specific development of specific new competencies, but may also include decreases in a system’s collective expertise due to staff turnover.”
§ User-Centered Design for Psychosocial Intervention Development and Implementation > User-Centered Design to Improve EBT Development, Packaging, and Implementation Usability and User-Centered Design > Identifying Users and User Needs
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIt may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Deviations such as these represent the EBT equivalent of a software “workarounds,” in which temporary fixes are used to bypass identified system usability problems.”
§ User-Centered Design for Psychosocial Intervention Development and Implementation > User-Centered Design to Improve EBT Development, Packaging, and Implementation Usability and User-Centered Design > Identifying Users and User Needs
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it.
None of the sources cited for this claim have been checked yet.
In the paper
“therapists sometimes question the relevance or effectiveness of EBT for their specific populations or struggle to deliver them when presented with engagement difficulties, crises, or comorbidities (Chandler, Peters, Field, & Juliano-bult, 2004; Kazdin, 2008; Whaley & Davis, 2007)”
§ User-Centered Design for Psychosocial Intervention Development and Implementation > User-Centered Design to Improve EBT Development, Packaging, and Implementation Usability and User-Centered Design > Identifying Users and User Needs
What the sources say
Load-bearingStrength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIt may state two separate claims as one.
In the paper
“a large body of implementation-focused research has documented the impact of organizational processes to successful implementation – including leadership buy-in and administrative support (Beidas & Kendall, 2010)”
§ User-Centered Design for Psychosocial Intervention Development and Implementation > User-Centered Design to Improve EBT Development, Packaging, and Implementation Usability and User-Centered Design > Identifying Users and User Needs
What the sources say
- Not checked yetcites Beidas & Kendall, 2010
Strength:boosted· not yet calibratedCausal:direct· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“mechanisms that allow service systems to update components of EBT to meet these changing needs are vital”
§ User-Centered Design for Psychosocial Intervention Development and Implementation > User-Centered Design to Improve EBT Development, Packaging, and Implementation Usability and User-Centered Design > Identifying Users and User Needs
Load-bearingStrength:plain· not yet calibratedTests✓ Asserted: passes✗ Checkable: fails✓ Load-bearing: passes✓ Based: passesProbably not a substantial claim. It may be too vague to check against evidence.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“satisfaction is only one of many indicators of a usable and effective product, and one that may be particularly subject to bias – and therefore less informative – when a user has no experience with a comparable product to which to compare a new innovation.”
§ User-Centered Design for Psychosocial Intervention Development and Implementation > User-Centered Design to Improve EBT Development, Packaging, and Implementation Usability and User-Centered Design > Identifying Users and User Needs
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIt may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Although workarounds can often be effective problem-solving strategies in the short term, they are likely to decrease usability and product functioning if unaddressed.”
§ User-Centered Design for Psychosocial Intervention Development and Implementation > User-Centered Design to Improve EBT Development, Packaging, and Implementation Usability and User-Centered Design > Identifying Users and User Needs
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIt may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Revising an existing EBT to be applicable to a new class of service providers (e.g., paraprofessionals) may be an appropriate impetus for system redesign.”
§ User-Centered Design for Psychosocial Intervention Development and Implementation > User-Centered Design to Improve EBT Development, Packaging, and Implementation Usability and User-Centered Design > Identifying Users and User Needs
Strength:hedged· not yet calibratedCausal:conditional· not yet calibratedTests✓ Asserted: passes✗ Checkable: fails✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. It may be too vague to check against evidence. The paper’s conclusions may not depend on it.
In the paper
“Chorpita and colleagues (2014) have pointed out that these situations often require therapists to go “off protocol,” changing their intervention plans in unexpected ways that are inconsistent with the intended treatment.”
§ User-Centered Design for Psychosocial Intervention Development and Implementation > User-Centered Design to Improve EBT Development, Packaging, and Implementation Usability and User-Centered Design > Identifying Users and User Needs
What the sources say
- Not checked yetcites Chorpita et al., 2014
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesProbably not a substantial claim.
In the paper
“EBT design processes may be most effective if they incorporate a developmental perspective and attend to how individual service provider and service system needs change over time (Chorpita & Daleiden, 2014)”
§ User-Centered Design for Psychosocial Intervention Development and Implementation > User-Centered Design to Improve EBT Development, Packaging, and Implementation Usability and User-Centered Design > Identifying Users and User Needs
What the sources say
- Not checked yetcites Chorpita & Daleiden, 2014
Tests✓ Asserted: passes✗ Checkable: fails✓ Load-bearing: passes✓ Based: passesProbably not a substantial claim. It may be too vague to check against evidence.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“In both cases, increasing capacity may also have the effect of identifying and addressing problems in less severe populations of service users.”
§ User-Centered Design for Psychosocial Intervention Development and Implementation > User-Centered Design to Improve EBT Development, Packaging, and Implementation Usability and User-Centered Design > Identifying Users and User Needs
Strength:hedged· not yet calibratedCausal:conditional· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“due to their built-in flexibility, newer transdiagnostic or modular approaches to service delivery (described above) may be more likely to be responsive in these ways.”
§ User-Centered Design for Psychosocial Intervention Development and Implementation > User-Centered Design to Improve EBT Development, Packaging, and Implementation Usability and User-Centered Design > Identifying Users and User Needs
Strength:hedged· not yet calibratedCausal:conditional· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it.
In the paper
“Hackos and Redish (1998) proposed a process for incorporating a broader variety of users into the design process that includes: (a) brainstorming a preliminary list of users, (b) articulating user characteristics, (c) describing and prioritizing main user groups, (d) selecting typical and representative users from those groups, and (e) gathering information from users to inform the redesign of the”
§ User-Centered Design for Psychosocial Intervention Development and Implementation > User-Centered Design to Improve EBT Development, Packaging, and Implementation Usability and User-Centered Design > Identifying Users and User Needs
What the sources say
- Not checked yetcites Hackos & Redish, 1998
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it.
None of the sources cited for this claim have been checked yet.
In the paper
“in the Improving Access to Psychological Therapies project, cognitive-behavioral approaches were explicitly packaged as low intensity versus high intensity to efficiently expand workforce capability and ensure that people with less severe problems could receive care from psychological wellbeing practitioners with less intensive training (Clark et al., 2009; Glover, Webb, & Evison, 2010)”
§ User-Centered Design for Psychosocial Intervention Development and Implementation > User-Centered Design to Improve EBT Development, Packaging, and Implementation Usability and User-Centered Design > Identifying Users and User Needs
What the sources say
- Not checked yetcites Clark et al., 2009 source
- Not checked yetcites Glover, Webb, & Evison, 2010
Strength:plain· not yet calibratedCausal:direct· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes? Load-bearing: unclear✓ Based: passesIt may state two separate claims as one.
In the paper
“Holmqvist and Walsh (2014) found that although web- and telehealth-based CBT for insomnia were equally effective, service recipients favored web-based delivery.”
§ User-Centered Design for Psychosocial Intervention Development and Implementation > User-Centered Design to Improve EBT Development, Packaging, and Implementation Usability and User-Centered Design > Identifying Users and User Needs
What the sources say
- Not checked yetcites Holmqvist & Walsh, 2014
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes? Load-bearing: unclear✓ Based: passesIt may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Well-designed EBT should be similarly responsive to changes in staff needs.”
§ User-Centered Design for Psychosocial Intervention Development and Implementation > User-Centered Design to Improve EBT Development, Packaging, and Implementation Usability and User-Centered Design > Identifying Users and User Needs
Load-bearingStrength:plain· not yet calibratedTests✓ Asserted: passes✗ Checkable: fails✓ Load-bearing: passes✓ Based: passesProbably not a substantial claim. It may be too vague to check against evidence.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Reconsideration of primary EBT users and service delivery models also opens the door to task-shifting strategies”
§ User-Centered Design for Psychosocial Intervention Development and Implementation > User-Centered Design to Improve EBT Development, Packaging, and Implementation Usability and User-Centered Design > Identifying Users and User Needs
Strength:plain· not yet calibratedCausal:direct· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“it may be equally important for intervention developers to explicitly articulate the characteristics of negative users who are not intended targets for an intervention”
§ User-Centered Design for Psychosocial Intervention Development and Implementation > User-Centered Design to Improve EBT Development, Packaging, and Implementation Usability and User-Centered Design > Identifying Users and User Needs
Strength:hedged· not yet calibratedTests✓ Asserted: passes✗ Checkable: fails✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. It may be too vague to check against evidence. The paper’s conclusions may not depend on it.
In the paper
“software updates are pushed out to users with astonishing regularity (e.g., every 6 weeks; Khomh, Dhaliwal, Zou, & Adams, 2012)”
§ User-Centered Design for Psychosocial Intervention Development and Implementation > User-Centered Design to Improve EBT Development, Packaging, and Implementation Usability and User-Centered Design > Identifying Users and User Needs
What the sources say
- Not checked yetcites Khomh, Dhaliwal, Zou, & Adams, 2012
Strength:boosted· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“so too EBT protocols have historically only been available to highly trained (and often highly motivated) mental health providers.”
§ User-Centered Design for Psychosocial Intervention Development and Implementation > Conclusion
Load-bearingStrength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✗ Based: failsProbably not a substantial claim. The paper may give no reason why it holds.
None of the sources cited for this claim have been checked yet.
In the paper
“increasing evidence has emerged that routinely monitoring psychotherapy client outcomes and providing data-driven feedback to therapists can reduce premature dropout and improve outcomes irrespective of the particular intervention approach used by the therapist (Bickman, Kelley, Breda, de Andrade, & Reimer, 2011; Lambert et al., 2003).”
§ User-Centered Design for Psychosocial Intervention Development and Implementation > User-Centered Design to Improve EBT Development, Packaging, and Implementation Usability and User-Centered Design > Design Simplification
What the sources say
- Not checked yetcites Bickman, Kelley, Breda, de Andrade, & Reimer, 2011
- Not checked yetcites Lambert et al., 2003 source
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIt may state two separate claims as one.
In the paper
“Product design depends largely on this type of constraint, which may include limitations on or requirements for a product’s form, function, budget, operating conditions, or time to completion, among others (Moggridge, 2007).”
§ User-Centered Design for Psychosocial Intervention Development and Implementation > User-Centered Design to Improve EBT Development, Packaging, and Implementation Usability and User-Centered Design > Exploit Natural Constraints
What the sources say
- Not checked yetcites Moggridge, 2007
Strength:plain· not yet calibratedCausal:direct· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it.
In the paper
“Prototyping, and rapid iterations based on evaluation of each successive prototype, is an excellent example of the overarching design process of collecting data and feedback at all stages of a product development cycle (Maguire, 2001).”
§ User-Centered Design for Psychosocial Intervention Development and Implementation > User-Centered Design to Improve EBT Development, Packaging, and Implementation Usability and User-Centered Design > Prototyping and Rapid Iteration
What the sources say
- Not checked yetcites Maguire, 2001 source
Strength:boosted· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it.
In the paper
“With the goals of increasing learnability and decreasing the cognitive load required as users interact with a product, design simplification has long been a hallmark of UCD (Norman, 1988).”
§ User-Centered Design for Psychosocial Intervention Development and Implementation > User-Centered Design to Improve EBT Development, Packaging, and Implementation Usability and User-Centered Design > Design Simplification
What the sources say
- Not checked yetcites Norman, 1988
Strength:boosted· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
““Design thinking” holds promise in the extent to which it can drive a reconceptualization of EBT users, support more rapid innovation and testing of novel approaches, simplify standard EBT designs, and incorporate – rather than struggle to overcome – barriers and other natural constraints for new and existing interventions.”
§ User-Centered Design for Psychosocial Intervention Development and Implementation > Discussion and Future Directions
Tests✓ Asserted: passes✗ Checkable: fails✓ Load-bearing: passes✓ Based: passesProbably not a substantial claim. It may be too vague to check against evidence. It may state two separate claims as one.
In the paper
“there is now growing consensus that the time has come to move implementation science beyond the identification of barriers toward the development of explicit strategies that facilitate EBT use and client improvement (Proctor, Powell, Baumann, Hamilton, & Santens, 2012).”
§ User-Centered Design for Psychosocial Intervention Development and Implementation > User-Centered Design to Improve EBT Development, Packaging, and Implementation Usability and User-Centered Design > Exploit Natural Constraints
What the sources say
- Not checked yetcites Proctor, Powell, Baumann, Hamilton, & Santens, 2012
Load-bearingStrength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesProbably not a substantial claim.
In the paper
“As EBT are increasingly scaled up across large service systems, alignment of multiple interventions within organizations is quickly becoming a priority (Chorpita et al., 2011).”
§ User-Centered Design for Psychosocial Intervention Development and Implementation > Discussion and Future Directions > A Design-Based Research Agenda
What the sources say
- Not checked yetcites Chorpita et al., 2011 source
Strength:plain· not yet calibratedCausal:direct· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it.
In the paper
“clear presentation of visual information is essential to the functioning of any product to allow users to understand the state of a system, what actions are possible, and how they should be completed (Norman, 1988).”
§ User-Centered Design for Psychosocial Intervention Development and Implementation > User-Centered Design to Improve EBT Development, Packaging, and Implementation Usability and User-Centered Design > Design Simplification
What the sources say
- Not checked yetcites Norman, 1988
Strength:plain· not yet calibratedCausal:direct· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it.
In the paper
“there is now widespread acknowledgment that nearly ubiquitous digital tools need to be able to work together and share information in a way that enhances convenience and value for the user (Fontaine, Ross, Zink, & Schilling, 2010).”
§ User-Centered Design for Psychosocial Intervention Development and Implementation > Discussion and Future Directions > A Design-Based Research Agenda
What the sources say
- Not checked yetcites Fontaine, Ross, Zink, & Schilling, 2010 source
Strength:boosted· not yet calibratedCausal:direct· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it.
In the paper
“affordances rely heavily on human perception and have no existence independent of a joint consideration of the individual and environment (Zaff, 1995).”
§ User-Centered Design for Psychosocial Intervention Development and Implementation > User-Centered Design to Improve EBT Development, Packaging, and Implementation Usability and User-Centered Design > Exploit Natural Constraints
What the sources say
- Not checked yetcites Zaff, 1995
Strength:plain· not yet calibratedCausal:direct· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
None of the sources cited for this claim have been checked yet.
In the paper
“The 10-item System Usability Scale (SUS; Brooke, 1996), for instance, is generally considered to be among the most sensitive, robust, and widely used scales of its type (Sauro, 2011; Tullis & Stetson, 2004).”
§ User-Centered Design for Psychosocial Intervention Development and Implementation > Discussion and Future Directions > A Design-Based Research Agenda
What the sources say
- Not checked yetcites Sauro, 2011
- Not checked yetcites Tullis & Stetson, 2004
Strength:hedged· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Using this technique early in the design process allows for the inexpensive exploration of novel ideas and solutions prior to more costly production.”
§ User-Centered Design for Psychosocial Intervention Development and Implementation > User-Centered Design to Improve EBT Development, Packaging, and Implementation Usability and User-Centered Design > Prototyping and Rapid Iteration
Strength:plain· not yet calibratedCausal:direct· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The transition to more rapid approaches may be uncomfortable for some researchers accustomed to the traditionally slow scientific slog down a single investigative pathway, but is likely to pay important dividends related to scientific discovery and the widespread use of well-designed, contextually appropriate, and empirically-based interventions.”
§ User-Centered Design for Psychosocial Intervention Development and Implementation > Conclusion
Tests✓ Asserted: passes✗ Checkable: fails✓ Load-bearing: passes✗ Based: failsProbably not a substantial claim. It may be too vague to check against evidence. The paper may give no reason why it holds.
None of the sources cited for this claim have been checked yet.
In the paper
“Explicit co-design processes – in which EBT developers specify major core components and an overarching structure, but allow service providers and recipients opportunities to determine more specific aspects of the intervention in real time – have been proposed as a method for the development of complex, contextually-appropriate practices in fields such as education (Penuel, Roschelle, & Shechtman,”
§ User-Centered Design for Psychosocial Intervention Development and Implementation > User-Centered Design to Improve EBT Development, Packaging, and Implementation Usability and User-Centered Design > Exploit Natural Constraints
What the sources say
- Not checked yetcites Penuel, Roschelle, & Shechtman, 2007
- Not checked yetcites Chorpita, Bernstein, & Daleiden, 2011
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesProbably not a substantial claim.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Failure to explicitly consider a product’s design is a guaranteed pathway to problematic design.”
§ User-Centered Design for Psychosocial Intervention Development and Implementation > Discussion and Future Directions
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesProbably not a substantial claim.
None of the sources cited for this claim have been checked yet.
In the paper
“Vigilant application of the principle of simplification works to contain this complexity while enhancing user experiences and facilitating the scalability of products (Rogers, 2003; Yamey, 2011).”
§ User-Centered Design for Psychosocial Intervention Development and Implementation > User-Centered Design to Improve EBT Development, Packaging, and Implementation Usability and User-Centered Design > Design Simplification
What the sources say
- Not checked yetcites Rogers, 2003
- Not checked yetcites Yamey, 2011 source
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIt may state two separate claims as one.
In the paper
“From a UCD perspective, all human-made products are designed and “the alternative to good design is bad design, not no design at all” (Martin, 1990, p.12).”
§ User-Centered Design for Psychosocial Intervention Development and Implementation > Discussion and Future Directions
What the sources say
- Not checked yetcites Martin, 1990
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it.
In the paper
“Norman (2004) has discussed cultural constraints, or learned conventions shared by a group, as a type of affordance that influences user expectations and perceptions and, in doing so, impacts design decisions.”
§ User-Centered Design for Psychosocial Intervention Development and Implementation > User-Centered Design to Improve EBT Development, Packaging, and Implementation Usability and User-Centered Design > Exploit Natural Constraints
What the sources say
- Not checked yetcites Norman, 2004
Strength:plain· not yet calibratedCausal:direct· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“It is our perspective that a UCD approach represents a promising collection of methods and a way forward for researchers and practitioners interested in supporting the dissemination and implementation of psychosocial interventions.”
§ User-Centered Design for Psychosocial Intervention Development and Implementation > Conclusion
Load-bearingStrength:hedged· not yet calibratedTests✓ Asserted: passes✗ Checkable: fails✓ Load-bearing: passes✗ Based: failsProbably not a substantial claim. It may be too vague to check against evidence. The paper may give no reason why it holds.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Constraints of this type are unavoidable when working in the real world and must be considered during the design or redesign process if a new product is to function well in a destination context.”
§ User-Centered Design for Psychosocial Intervention Development and Implementation > User-Centered Design to Improve EBT Development, Packaging, and Implementation Usability and User-Centered Design > Exploit Natural Constraints
Tests✓ Asserted: passes✗ Checkable: fails✓ Load-bearing: passes✓ Based: passesProbably not a substantial claim. It may be too vague to check against evidence. It may state two separate claims as one.
In the paper
“Robust evidence supports the use of prototyping to improve a product’s match with users and overall “ease of use” (Gordon & Bieman, 1997).”
§ User-Centered Design for Psychosocial Intervention Development and Implementation > User-Centered Design to Improve EBT Development, Packaging, and Implementation Usability and User-Centered Design > Prototyping and Rapid Iteration
What the sources say
- Not checked yetcites Gordon & Bieman, 1997
Strength:boosted· not yet calibratedCausal:direct· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes? Load-bearing: unclear✓ Based: passesIt may state two separate claims as one.
The paper relies on this without support.
Existing implementation frameworks provide almost no guidance on specific methods for ensuring that EBT successfully meet user needs.
“existing frameworks provide almost no guidance surrounding specific methods for ensuring that EBT successfully meet user needs”
The paper relies on this without support.
High complexity can interfere with the extent to which EBT are readily accessible to providers or organizations interested in adopting them.
“High complexity can interfere with the extent to which EBT are readily accessible to providers or organizations interested in adopting them to improve their practice.”
The paper relies on this without support.
EBT are exceedingly difficult to train and learn.
“As a partial function of their complexity, EBT are exceedingly difficult to train and learn.”
The paper relies on this without support.
High-quality EBT training is expensive and elusive for many practitioners.
“As a result of the effort required, high-quality EBT training is expensive and elusive for many practitioners.”
The paper relies on this without support.
There are currently few clear principles or procedures available to guide ongoing adjustment and evaluation of EBT effectively.
“However, there are currently few clear principles or procedures available to guide this work effectively.”
The paper relies on this without support.
A university-based research team traditionally develops and tests an intervention extensively before it is disseminated as a fully-formed, static intervention protocol.
“a university-based research team most traditionally develops and tests an intervention extensively, articulating its key functions and structure, before it is disseminated more broadly as a fully-formed, static intervention protocol.”
The paper relies on this without support.
A UCD approach has not yet been applied to the development or implementation of EBT themselves.
“Nevertheless, a UCD approach has not yet been applied to the development or implementation of EBT themselves.”
The paper relies on this without support.
EBT development processes tend to emphasize the needs and perspectives of intervention developers over those of well-defined user groups.
“EBT development processes tend to emphasize the needs and perspectives of intervention developers over those of well-defined user groups.”
The paper relies on this without support.
Little research has focused on designing EBT to be responsive to the needs of decision makers while keeping intervention effectiveness intact or on systematically planning evaluations of the modifications needed to better fit setting constraints.
“little research has focused on ways to design EBT to be responsive to the needs of these decision makers while keeping intervention effectiveness intact or to systematically plan evaluations of the modifications needed to better fit setting constraints”
The paper relies on this without support.
No specific funding mechanisms currently exist to support comparable, rapid work in behavioral health.
“but no specific funding mechanisms currently exist to support comparable, rapid work in behavioral health.”
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“iNNOVBC was developed using a user-centered design approach involving its primary and secondary end users, that is, BCSs (11/24, 46%) and mental health professionals (13/24, 54%).”
From Development and Evaluation of the Usefulness, Usability, and Feasibility of iNNOV Breast Cancer: Mixed Methods Study (2022) · cites this paper as [37]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Moreover, interventions’ design processes are rarely reported, and the absence of evidence-based reasoning behind its development [36] contributes to a research-practice gap in the internet interventions domain, wherein evidenced-based treatments struggle to be adopted in routine care [37].”
From Development and Evaluation of the Usefulness, Usability, and Feasibility of iNNOV Breast Cancer: Mixed Methods Study (2022) · cites this paper as [37]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“Intervention programs are frequently planned by neglecting end users’ perspective (eg, individual’s goals, needs, skills, and contexts) and researchers often fail to involve end users in the development process [37,38].”
From Development and Evaluation of the Usefulness, Usability, and Feasibility of iNNOV Breast Cancer: Mixed Methods Study (2022) · cites this paper as [37]
The cited source says what the claim attributes to it.
In the citing paper
“In this study, iNNOVBC—a guided, internet-delivered, individually tailored, ACT-influenced CBT intervention aiming at treating mild to moderate anxiety and depression as well as improving fatigue, insomnia, sexual dysfunction, and HRQoL in BCSs—was developed with a user-centered design approach [37] and explored concerning its usefulness, usability, and feasibility.”
From Development and Evaluation of the Usefulness, Usability, and Feasibility of iNNOV Breast Cancer: Mixed Methods Study (2022) · cites this paper as [37]
Citations
Cites
Damschroder, L. J., Aron, D. C., Keith, R. E., Kirsh, S. R., Alexander, J. A., & Lowery, J. C. (2009) · Implementation Science · doi:10.1186/1748-5908-4-50 · Cited by 14,496
Proctor, E., Silmere, H., Raghavan, R., Hovmand, P., Aarons, G., Bunger, A., Griffey, R., & Hensley, M. (2011) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-010-0319-7 · Cited by 8,721
Norman, D. A. (2016) · Vahlen eBooks · doi:10.15358/9783800648108 · Cited by 6,415
(1993) · Elsevier eBooks · doi:10.1016/c2009-0-21512-1 · Cited by 5,552
The Visual Display of Quantitative Information
Olson, J., & Tufte, E. (1985) · Technometrics · doi:10.1198/tech.2002.s78 · Cited by 5,449
Powell, B. J., Waltz, T. J., Chinman, M. J., Damschroder, L. J., Smith, J. L., Matthieu, M. M., Proctor, E. K., & Kirchner, J. E. (2015) · Implementation Science · doi:10.1186/s13012-015-0209-1 · Cited by 4,963
Principles of Instructional Design
Gagné, R. M., & Briggs, L. J. (1974) · Cited by 4,467
Usability Evaluation In Industry
(1996) · CRC Press eBooks · doi:10.1201/9781498710411 · Cited by 4,445
(2005) · Cited by 3,748
Information Visualization: Perception for Design
Ware, C. (2000) · doi:10.1016/b978-0-12-381464-7.00018-1 · Cited by 3,742
Flagged first, then by citations
Research works printed but not linked: 10
- Aarons, 2013, Scaling-up evidence-based practices in child welfare services systems, CYF News
- Balas, 2000, Yearbook of medical informatics 2000: Patient-centered systems, 65
- Cooper, 2007, About face 3: The essentials of interaction design
- Grudin, 2002, PDC 2002 Proceedings of the Participatory Design Conference, Sweden, 144
- International Standards Organization, 1998, Ergonomic requirements for office work with visual display terminals (VDTs) - Part 11: Guidance on usability
- Martin, 1990, Book design: A practical introduction
- Rogers, 2003, Diffusions of innovations
- Salvo, 2007, A case of exhaustive documentation: Re-centering system-oriented organizations around user need, Technical Communication, 54, 46
- Sauro, 2011, A practical guide to the System Usability Scale: Background, benchmarks & best practices
- Weisz, 2011, Child and adolescent therapy: Cognitive-behavioral procedures, 379
Cited by
Sorted by citations
The Sustainability of Evidence-Based Interventions and Practices in Public Health and Health Care
Shelton, R. C., Cooper, B. R., & Stirman, S. W. (2018) · Annual Review of Public Health · doi:10.1146/annurev-publhealth-040617-014731 · Cited by 806
Design Thinking in Health Care
Altman, M., Huang, T. T. K., & Breland, J. Y. (2018) · Preventing Chronic Disease · doi:10.5888/pcd15.180128 · Cited by 548
Reframing implementation science to address inequities in healthcare delivery
Baumann, A. A., & Cabassa, L. J. (2020) · BMC Health Services Research · doi:10.1186/s12913-020-4975-3 · Cited by 479
Mohr, D. C., Lyon, A. R., Lattie, E. G., Reddy, M., & Schueller, S. M. (2017) · Journal of Medical Internet Research · doi:10.2196/jmir.7725 · Cited by 432
Self-citationA glossary of user-centered design strategies for implementation experts
Dopp, A. R., Parisi, K. E., Munson, S. A., & Lyon, A. R. (2018) · Translational Behavioral Medicine · doi:10.1093/tbm/iby119 · Cited by 301
Self-citation
Metadata
- Authors
- Lyon, A. R., & Koerner, K.
- Affiliations
- University of Washington (US)
- Venue
- Clinical Psychology: Science and Practice
- Published
- 2016-06
- Volume
- 23
- Issue
- 2
- Pages
- 180-200
- ISSN
- 0969-5893 (ISSN-L)
- 1468-2850
- PMC
- PMC5812700
- OpenAlex
- W2443106973
- Cited by
- 478
- References
- 132
- Citations by year
- 2026: 29 · 2025: 55 · 2024: 96 · 2023: 55 · 2022: 64 · 2021: 91 · 2020: 37 · 2019: 24 · 2018: 16 · 2017: 8 · 2016: 2
- FWCI
- 31.05
- Type
- journal article
- Language
- en
- Open access
- green
- www.ncbi.nlm.nih.gov
- Locations
- Clinical Psychology Science and Practice (publishedVersion)
- PubMed (publishedVersion)
- PubMed Central (acceptedVersion)
- Funders
- National Institute of Mental Health (K08 MH095939, R25 MH080916)
- US Department of Veterans Affairs
- Topics
- Health Sciences › Health Professions › General Health Professions › Health Policy Implementation Science
- Physical Sciences › Computer Science › Human-Computer Interaction › Usability and User Interface Design
- Social Sciences › Psychology › Applied Psychology › Digital Mental Health Interventions
- Keywords
- user-centered design, psychosocial interventions, evidence-based practice implementation, scale-up, end-user needs, rapid prototyping, natural constraints, design principles
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
A language model drew the claims from the paper on 2026-09-28, under version 3 of the claim definition (prompt extract-v3).
A second model labelled each claim on 2026-09-28 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
