Needs and Expectations for the myNewWay Blended Digital and Face-to-Face Psychotherapy Model of Care for Depression and Anxiety (Part 1): Participatory Design Study including People with Lived and Living Experience
Open accessPublished version of a preprint
The DOI matches its Crossref record; 63 of the 63 references it cites were found in a registry or an index; 30 of the 116 sources its claims cite were checked for support.
Abstract
BACKGROUND: Digital mental health interventions (DMHIs) are effective in reducing symptoms of depression and anxiety. Low user engagement and uptake of DMHIs observed in previous research may be addressed by involving the intended target audience in the design of the DMHI from the outset. OBJECTIVE: This study is phase 1 of a multiphase project aimed at designing, developing, and evaluating a blended DMHI for depression and anxiety in Australia. Our objective was to partner with adults with lived and living experiences of depression and anxiety on their needs and expectations of a new transdiagnostic DMHI for depression and anxiety. This included identifying strategies that would help increase their engagement with the DMHI and their preferences for integrating the DMHI with psychotherapy. METHODS: A mixed methods participatory design approach was used to collect quantitative and qualitative data via a web-based survey (n=324) and semistructured interviews (n=21). Feedback was collected on participants' needs and expectations for the DMHI, including accessibility, content, features, functionality, format, data sharing, preferred clinical support pathways, and barriers to and facilitators of user engagement. Qualitative interview data were analyzed using reflexive thematic analysis. RESULTS: Most participants (190/257, 73.9%) preferred a DMHI delivered as a smartphone app that could be used at any time of the day. Ease of use and a well-designed interface were important, as was a positive, encouraging, and uplifting DMHI look and feel. Other preferences included symptom tracking, diverse therapeutic content, and features that facilitated social connection and peer support (eg, online community and stories of lived and living experience). Participants also suggested several strategies to enhance engagement with the DMHI, including personalization, reminders, short and achievable activities, and goal setting. Participants reported a strong interest in sharing information from their DMHI with mental health professionals (to facilitate therapy), especially regarding changes to their emotions. CONCLUSIONS: Transdiagnostic DMHIs for depression and anxiety have great potential to improve access to affordable, evidence-based mental health support. Involving people with lived and living experiences of depression and anxiety in the design, development, and conceptualization of DMHIs may improve uptake, acceptance, engagement, usability, and ultimately, treatment outcomes.
Overview
CoChat Summary
## TL;DR
This participatory design study used a survey of 324 adults and interviews with 21 adults with lived and living experience of depression and anxiety to identify what they want from a blended digital and face-to-face psychotherapy model in Australia. Participants favored a smartphone app with easy navigation, personalization, reminders, symptom tracking, social connection features, clinician sharing, and low cost or no cost.
## Key findings
- In the survey, most participants preferred a DMHI delivered as a smartphone app that could be used any time of day: 190/257 (73.9%).
- Engagement strategies endorsed across survey and interviews included personalization, reminders, goal setting, and short/achievable activities; in interviews, participants also wanted short, positive, encouraging messages and a well-designed, simple interface.
- Preferred features included tracking thoughts/feelings/behaviors over time (221/263, 84%), motivational messages (163/263, 62%), reminders (145/263, 55.1%), subtitles (142/263, 54%), and audio voiceover (141/263, 53.6%).
- For blended care, participants were open to sharing information with mental health professionals; 155/241 (64.3%) preferred communicating with professionals via a chat box inside the DMHI, and many wanted to share how they felt over time, mood changes, goals, and completed activities.
## Methods
- Mixed methods participatory design study using a convergent parallel design with adults in Australia who had current or previous experience with depression or anxiety.
- Data came from a web-based survey (n=324) and semistructured interviews (n=21); the survey also used the DASS-21 for depression, anxiety, and stress.
- Quantitative data were summarized with descriptive statistics in SPSS; interview data were analyzed using reflexive thematic analysis.
## Limitations
- The paper states that generalizability is limited because the sample was predominantly female, English-speaking, city-dwelling, and previously treated, with relatively high digital literacy and substantial prior DMHI use.
- The paper states that recruitment occurred during the COVID-19 pandemic, so whether findings generalize to post-pandemic mental health care is unknown.
- Evident from the text: the study reflects preferences and expectations, not outcomes of using the DMHI, and the interview sample was small (21 participants), so the qualitative findings are in-depth but limited in breadth.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Figures


Verification
Claims the paper makes
19 Valid · 0 Not valid · 38 Not checked · 100 Own results and interpretations
Every source the paper cites for this claim was checked and supports it.
In the paper
“For anxiety, a recent meta-analysis [16] reported that compared to inactive controls, guided and self-guided DMHIs significantly reduced anxiety symptoms across 47 studies, with a large pooled effect size (Hedges g=0.80; 95% CI 0.68-0.93).”
§ Needs and Expectations for the myNewWay Blended Digital and Face-to-Face Psychotherapy Model of Care for Depression and Anxiety (Part 1): Participatory Design Study including People with Lived and Living Experience > Introduction > Digital Mental Health Treatment Digital mental health interventions (DMHIs), such as smartphone apps or online programs, address many of the barriers to face-to-face mental health care. DMHIs allow people to access psychotherapy skills and content in their own time and empower them to self-manage their symptoms [7-11]. Due to these advantages and the need to minimize face-to-face contact during the COVID-19 pandemic, many DMHIs have been developed and implemented quickly in recent years [12]. DMHIs can be used in a self-guided format (ie, without human support) [8,9], guided format (ie, with remote support from a health professional or coach), or together with face-to-face therapy sessions in person or with telehealth in a “blended” format (blended care) [12-14]. Evidence supports the efficacy of DMHIs, particularly those based on cognitive behavioral therapy (CBT), in reducing symptoms of depression and anxiety [15,16]. A 2021 meta-analysis [15] found that compared to control conditions, both guided and self-guided DMHIs significantly reduced depressive symptoms across 83 studies, with a medium pooled effect size (Hedges g=0.52; 95% CI 0.43-0.60). For anxiety, a recent meta-analysis [16] reported that compared to inactive controls, guided and self-guided DMHIs significantly reduced anxiety symptoms across 47 studies, with a large pooled effect size (Hedges g=0.80; 95% CI 0.68-0.93). While most studies have evaluated internet-delivered DMHIs (ie, delivered on websites), smartphone apps targeting depressive and anxiety symptoms have also shown positive results, with small to medium pooled effect sizes for anxiety (Hedges g=0.26; 95% CI 0.21-0.31) and depression (Hedges g=0.50; 95% CI 0.40-0.61) [17,18]. Despite this evidence showing that smartphone apps and internet-based interventions are effective in improving symptoms of depression and anxiety, DMHIs are not typically integrated into routine mental health care [19]. There are several reasons for this, including a lack of practitioner confidence and training in integrating these tools into practice, difficulties in personalizing these interventions, and a lack of integration with practice management software and electronic health records [20]. There is promising preliminary research into the combination of DMHIs with face-to-face therapy in blended care for depression and anxiety [14,21,22]. However, research on the efficacy and effectiveness of blended care is limited compared to the evidence base for self-guided and guided DMHIs [8,9,23] and is confined mainly to Europe and North America [14,24]. In practice, many existing DMHIs have high attrition rates and low user engagement, especially when accessed in stand-alone self-guided formats [25,26] and in “real-world” naturalistic settings outside of controlled research studies [27]. For example, a review by Linardon and Fuller-Tyszkiewicz [26] found that the dropout rate of users participating in studies that included smartphone apps for depressive or anxious symptoms was 36% and 21%, respectively. Dropout rates are even higher in naturalistic community settings. For instance, studies have shown that completion rates of DMHIs in naturalistic settings are at best half of what is found in clinical trials of the same intervention [28-30]. Several factors contribute to low DMHI engagement, including technical issues, motivation issues, and a lack of user-driven design [11,25,31,32]. Reviews of the existing literature also show that various features, functionality, and design considerations can promote user engagement with DMHIs. These include the perceived usefulness; positive impact and relevance of DMHIs; content that promotes good mental, physical, and cognitive health [33,34] and social connection [25,31]; design aspects (eg, ease of use and interface); personalized content and choice [35-37]; data security and privacy; and therapist guidance [25].
What the sources say
- Supportedcites [16] source
The Abstract (Results) and the Meta-analysis subsection (Results) both state the overall pooled effect of digital interventions v. inactive controls as g = 0.80 [95% CI: 0.68-0.93], large and significant, with separate guided (g = 0.84) and unguided/self-guided (g = 0.64) effects. The Selection, inclusion and extraction subsection (Results) confirms 47 studies were retained for the meta-analysis. All elements of the claim - inactive comparators, guided and self-guided arms, 47 studies, and the exact magnitude and interval - are stated in our copy. (LLM, conf=0.93)
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Digital mental health interventions (DMHIs) are effective in reducing symptoms of depression and anxiety.”
- Also stated in: § Digital Mental Health Treatment Digital mental health interventions (DMHIs), such as smartphone apps or online programs, address many of the barriers to face-to-face mental health care. DMHIs allow people to access psychotherapy skills and content in their own time and empower them to self-manage their symptoms [7-11]. Due to these advantages and the need to minimize face-to-face contact during the COVID-19 pandemic, many DMHIs have been developed and implemented quickly in recent years [12]. DMHIs can be used in a self-guided format (ie, without human support) [8,9], guided format (ie, with remote support from a health professional or coach), or together with face-to-face therapy sessions in person or with telehealth in a “blended” format (blended care) [12-14]. Evidence supports the efficacy of DMHIs, particularly those based on cognitive behavioral therapy (CBT), in reducing symptoms of depression and anxiety [15,16]. A 2021 meta-analysis [15] found that compared to control conditions, both guided and self-guided DMHIs significantly reduced depressive symptoms across 83 studies, with a medium pooled effect size (Hedges g=0.52; 95% CI 0.43-0.60). For anxiety, a recent meta-analysis [16] reported that compared to inactive controls, guided and self-guided DMHIs significantly reduced anxiety symptoms across 47 studies, with a large pooled effect size (Hedges g=0.80; 95% CI 0.68-0.93). While most studies have evaluated internet-delivered DMHIs (ie, delivered on websites), smartphone apps targeting depressive and anxiety symptoms have also shown positive results, with small to medium pooled effect sizes for anxiety (Hedges g=0.26; 95% CI 0.21-0.31) and depression (Hedges g=0.50; 95% CI 0.40-0.61) [17,18]. Despite this evidence showing that smartphone apps and internet-based interventions are effective in improving symptoms of depression and anxiety, DMHIs are not typically integrated into routine mental health care [19]. There are several reasons for this, including a lack of practitioner confidence and training in integrating these tools into practice, difficulties in personalizing these interventions, and a lack of integration with practice management software and electronic health records [20]. There is promising preliminary research into the combination of DMHIs with face-to-face therapy in blended care for depression and anxiety [14,21,22]. However, research on the efficacy and effectiveness of blended care is limited compared to the evidence base for self-guided and guided DMHIs [8,9,23] and is confined mainly to Europe and North America [14,24]. In practice, many existing DMHIs have high attrition rates and low user engagement, especially when accessed in stand-alone self-guided formats [25,26] and in “real-world” naturalistic settings outside of controlled research studies [27]. For example, a review by Linardon and Fuller-Tyszkiewicz [26] found that the dropout rate of users participating in studies that included smartphone apps for depressive or anxious symptoms was 36% and 21%, respectively. Dropout rates are even higher in naturalistic community settings. For instance, studies have shown that completion rates of DMHIs in naturalistic settings are at best half of what is found in clinical trials of the same intervention [28-30]. Several factors contribute to low DMHI engagement, including technical issues, motivation issues, and a lack of user-driven design [11,25,31,32]. Reviews of the existing literature also show that various features, functionality, and design considerations can promote user engagement with DMHIs. These include the perceived usefulness; positive impact and relevance of DMHIs; content that promotes good mental, physical, and cognitive health [33,34] and social connection [25,31]; design aspects (eg, ease of use and interface); personalized content and choice [35-37]; data security and privacy; and therapist guidance [25]. · boosted
“Evidence supports the efficacy of DMHIs, particularly those based on cognitive behavioral therapy (CBT), in reducing symptoms of depression and anxiety [15,16].”
§ Needs and Expectations for the myNewWay Blended Digital and Face-to-Face Psychotherapy Model of Care for Depression and Anxiety (Part 1): Participatory Design Study including People with Lived and Living Experience > Abstract > Background
What the sources say
- Not checked yetcites [15] source
- Partly supportedcites [16] sourceExperimental — accuracy not yet measured
The Discussion (para. 1) and Results > Meta-analysis report a large significant pooled effect of digital interventions on anxiety symptoms across all anxiety disorders (g = 0.80, 53 comparisons, 4958 participants) plus disorder-specific estimates (GAD g = 0.62, SAD g = 0.76, PD/A g = 1.08), so the anxiety half of the claim is supported. The depression half is not: Methods > Study sources, search and selection restricted inclusion to adults with a clinician-validated primary anxiety disorder (GAD, PD/A, SAD or SP), and Methods > Types of outcome measures defines the primary efficacy outcome as anxiety symptoms only. The paper in fact distinguishes itself from Andrews et al. (2018), which 'included major depression studies for 50% of the comparisons,' stating the present meta-analysis is 'specific to anxiety disorders as currently defined by the DSM-5.' Thus attributing effectiveness for depression symptoms to this source overreaches its stated scope. (LLM, conf=0.85)
boostedstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Also stated in: § Digital Mental Health Treatment Digital mental health interventions (DMHIs), such as smartphone apps or online programs, address many of the barriers to face-to-face mental health care. DMHIs allow people to access psychotherapy skills and content in their own time and empower them to self-manage their symptoms [7-11]. Due to these advantages and the need to minimize face-to-face contact during the COVID-19 pandemic, many DMHIs have been developed and implemented quickly in recent years [12]. DMHIs can be used in a self-guided format (ie, without human support) [8,9], guided format (ie, with remote support from a health professional or coach), or together with face-to-face therapy sessions in person or with telehealth in a “blended” format (blended care) [12-14]. Evidence supports the efficacy of DMHIs, particularly those based on cognitive behavioral therapy (CBT), in reducing symptoms of depression and anxiety [15,16]. A 2021 meta-analysis [15] found that compared to control conditions, both guided and self-guided DMHIs significantly reduced depressive symptoms across 83 studies, with a medium pooled effect size (Hedges g=0.52; 95% CI 0.43-0.60). For anxiety, a recent meta-analysis [16] reported that compared to inactive controls, guided and self-guided DMHIs significantly reduced anxiety symptoms across 47 studies, with a large pooled effect size (Hedges g=0.80; 95% CI 0.68-0.93). While most studies have evaluated internet-delivered DMHIs (ie, delivered on websites), smartphone apps targeting depressive and anxiety symptoms have also shown positive results, with small to medium pooled effect sizes for anxiety (Hedges g=0.26; 95% CI 0.21-0.31) and depression (Hedges g=0.50; 95% CI 0.40-0.61) [17,18]. Despite this evidence showing that smartphone apps and internet-based interventions are effective in improving symptoms of depression and anxiety, DMHIs are not typically integrated into routine mental health care [19]. There are several reasons for this, including a lack of practitioner confidence and training in integrating these tools into practice, difficulties in personalizing these interventions, and a lack of integration with practice management software and electronic health records [20]. There is promising preliminary research into the combination of DMHIs with face-to-face therapy in blended care for depression and anxiety [14,21,22]. However, research on the efficacy and effectiveness of blended care is limited compared to the evidence base for self-guided and guided DMHIs [8,9,23] and is confined mainly to Europe and North America [14,24]. In practice, many existing DMHIs have high attrition rates and low user engagement, especially when accessed in stand-alone self-guided formats [25,26] and in “real-world” naturalistic settings outside of controlled research studies [27]. For example, a review by Linardon and Fuller-Tyszkiewicz [26] found that the dropout rate of users participating in studies that included smartphone apps for depressive or anxious symptoms was 36% and 21%, respectively. Dropout rates are even higher in naturalistic community settings. For instance, studies have shown that completion rates of DMHIs in naturalistic settings are at best half of what is found in clinical trials of the same intervention [28-30]. Several factors contribute to low DMHI engagement, including technical issues, motivation issues, and a lack of user-driven design [11,25,31,32]. Reviews of the existing literature also show that various features, functionality, and design considerations can promote user engagement with DMHIs. These include the perceived usefulness; positive impact and relevance of DMHIs; content that promotes good mental, physical, and cognitive health [33,34] and social connection [25,31]; design aspects (eg, ease of use and interface); personalized content and choice [35-37]; data security and privacy; and therapist guidance [25]. · boosted
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“However, to date, only 1 European study [47] reports the participatory design process during the development of a blended care intervention with people with lived experience of mental illness and psychotherapists.”
§ Needs and Expectations for the myNewWay Blended Digital and Face-to-Face Psychotherapy Model of Care for Depression and Anxiety (Part 1): Participatory Design Study including People with Lived and Living Experience > Introduction > Limitations of DMHIs for Depression and Anxiety These findings provide guidance for improving participant engagement and reducing attrition for DMHIs overall, which is especially relevant given the increased availability of DMHIs following the COVID-19 pandemic. However, an often-overlooked issue is how DMHIs should be integrated into routine clinical care for depression, anxiety, and other mental disorders [9]. Many existing self-guided and guided DMHIs include linear, one-size-fits-all programs for a specific disorder (eg, major depressive disorder) or multiple disorders (eg, transdiagnostic programs for mixed anxiety or anxiety and depression). In this model, programs follow a mostly set structure, delivering a series of modules that are completed in the same order for each person. While this approach has benefits [38], the downside is that the DMHI cannot be individually tailored to suit a person’s goals, needs, symptoms, and problems. This lack of personalization negatively affects user engagement [11,25] and is a barrier for mental health professionals using these programs in practice [39]. Another important clinical consideration is that people experiencing severe depression and anxiety symptoms, and frequent suicidal ideation, use DMHIs once they are released into the community, although the programs are often not designed for these clients (eg, myCompass and THIS WAY UP) [40-42]. The needs, preferences, and expectations of people with varying symptom severity and suicidal risk levels need to be considered at the outset when developing interventions for depression and anxiety. Another factor affecting the inclusion of DMHIs in routine clinical care is that many of these interventions have been designed as “self-help” or “stand-alone” products [8,43,44]. This has contributed to the low uptake of DMHIs in practice and limits their potential use, reach, and benefits for people with depression and anxiety at various stages of care (eg, before, during, and after seeking in-person therapy). Incorporating the needs of the intended target audience directly into DMHI design and development can potentially help address poor user engagement, high attrition, and the lack of integration of DMHIs into clinical practice. Participatory design approaches, such as co-design and co-creation, actively incorporate multiple stakeholders’ perspectives into defining a problem and collaborating with them on potential solutions [45,46]. In digital mental health, participatory design involves partnering with the intended target audience during DMHI design, development, refinement, and evaluation to ensure the product or service reflects their needs. Unfortunately, in DMHI research that uses participatory approaches, these details are often inconsistent, use varied terminology, or are not reported clearly [45,46]. Moreover, the few existing DMHI studies that use co-design principles have been limited to young adult samples (aged 18-34 years) or mental health professionals, with very few in adults aged ≥35 years [45]. Using participatory design and co-design principles to create DMHIs that fit into routine care may help adults with anxiety and depression, along with their mental health professionals, adopt blended care more easily [21]. However, to date, only 1 European study [47] reports the participatory design process during the development of a blended care intervention with people with lived experience of mental illness and psychotherapists. In that study, people with lived experience preferred a DMHI that was gentle and compassionate rather than performance based and they valued having the autonomy to choose modules themselves or have them selected by their therapist. It was also important that the DMHI included crisis support, transparent data security, and confidentiality information. Finally, people with lived experience preferred inclusive, varied, concise content delivered in various formats (eg, text, images, and videos) to ensure the DMHI was accessible to many people.
What the sources say
- Partly supportedcites [47] sourceExperimental — accuracy not yet measured
Our copy confirms the identified study itself: the Abstract (Methods) and Introduction ('Participatory development') describe a participatory, IDEAS-framework development of a transtheoretic/transdiagnostic online module set for blended care with psychotherapists (psychodynamic n=20, systemic n=9, mixed-approach focus groups n=10) and PWLE (focus groups n=10, 12 total), situated in German routine care (Discussion 'Limitations'; Focus groups 'Participants'), so it plainly is a European study reporting its participatory design process. What the source does not state is the citing sentence's exclusivity: the only comparable claim in our copy is the hedged, differently-scoped statement in Discussion 'Principal results' that, 'to our knowledge, this is the first study to analyze the requirements of PWLE as well as psychotherapists of cognitive-behavioral, systemic, and psychodynamic approaches alike' — a first-of-its-kind claim about analysing requirements across three approaches, not a factual count that it is the single European study reporting participatory development of a blended care intervention with PWLE and psychotherapists. The 'only 1 European study' tally therefore rests with the citing authors' own literature search, and the source's hedge is presented as fact. (LLM, conf=0.72)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
The sources with a verdict support this claim; the rest weren’t checked yet, have no full text we could read, or their verdicts aren’t rated yet.
In the paper
“Blending digital and face-to-face therapy is a promising approach for integrating DMHIs into routine mental health care [14,21,22,24].”
§ Needs and Expectations for the myNewWay Blended Digital and Face-to-Face Psychotherapy Model of Care for Depression and Anxiety (Part 1): Participatory Design Study including People with Lived and Living Experience > Introduction > Rationale, Objectives, and Aims Blending digital and face-to-face therapy is a promising approach for integrating DMHIs into routine mental health care [14,21,22,24]. However, to date, only 1 study has used participatory design to incorporate the needs of people with lived experience of mental illness into the design of a blended care intervention [47]. Blended care interventions can address the limitations of DMHIs, especially stand-alone options; hence, there is a need to further investigate the utility of the blended care approach. For depression and anxiety, the option of mental health professional involvement would add an extra layer of clinical safety and permit better tailoring of DMHI use for people experiencing depression and anxiety. This study is part of a larger Australian research project that aims to design, develop, and evaluate a new transdiagnostic DMHI for adults with depression and/or anxiety (ie, myNewWay) [48]. The intervention is intended to address limitations of existing DMHIs and be suitable for use as part of blended care. Australian research on blended care is limited; however, preliminary results align with studies in other countries [14,21,22,24] and indicate that blending digital and face-to-face therapy may improve symptoms of depression [49-51] and anxiety [51]. To the best of our knowledge, there are also currently no transdiagnostic blended care models in Australia designed with target audience input and tailored to the specific needs and preferences of adults with depression and anxiety. This study is 1 of 2 related participatory design studies in which we partnered with people with lived and living experiences of depression and anxiety and mental health professionals in the design of the new blended care DMHI. This paper reports on the findings of people with lived and living experience. Findings from mental health professionals are reported separately in part 2 of this manuscript series [52]. The DMHI will be transdiagnostic rather than diagnosis specific, as transdiagnostic approaches are acceptable, feasible, efficient, and effective for treating multiple symptoms and diagnoses within 1 treatment program [5,40]. We will use findings of this study to co-design and then develop a program that will be engaging, safe, and effective for people with varying severity levels, including those experiencing suicidal ideation. The program could be personalized to individual goals and needs and integrated into face-to-face or telehealth mental health care. We also wanted to ensure that the DMHI met the needs of adults with lived and living experience by including relevant therapeutic content and sustaining their interest with appealing design features and functionality, especially given that user engagement is associated with better treatment outcomes [15,53] and more cost-effective treatment [54,55]. Conducting participatory design within an Australian context is important to ensure that the new blended care model aligns with the needs and expectations of adults living with anxiety and depression. In Australia, adults with depression and anxiety are treated in the private mental health system and can access up to 10 psychotherapy sessions per calendar year with partial government rebates [56]. Blending DMHIs with this existing treatment pathway could increase the quality of care, and, thereby, enhance recovery by providing access to evidence-based resources for depression and anxiety before, during, and after psychotherapy. Given that most blended care research has been conducted in Europe and North America [14,24], conducting research outside these cultural contexts also helps to show which elements of blended care may be universal and which elements are not. The first aim of this study was to examine the needs and expectations of participants regarding the content, features, functionality, and look and feel of the DMHI. This also includes how people with depression and anxiety want to access the DMHI, their preferences for content delivery, and the overall blended model of care. With respect to the blended care model, we asked about the types of therapeutic guidance and human-based support they would like to receive while using a DMHI that blends with psychotherapy, as well as their preferences for sharing data from the DMHI with health professionals. Understanding participants’ preferences for including guided components within a DMHI will ensure that it meets their needs and leverages the potential benefits of guided DMHIs for depression and anxiety [15]. Our second aim was to identify factors that would affect engagement with the new blended DMHI, which could be addressed in the design of the interface, functionality, or content of the intervention to maximize sustained engagement with the DMHI.
What the sources say
- Supportedcites [14] source
The Discussion’s Principal Findings describe early results for blended Internet and face-to-face therapy as encouraging, while noting that results are mixed and more research is needed. The Results > Outcome section reports that using blended interventions to improve delivery of evidence-based treatment in primary care was successful in acceptability and symptom reduction. Together, these support the claim’s cautious description of blending as promising for integration into care. (LLM, conf=0.91)
- Not checked yetcites [21] source
- Supportedcites [22] source
The Introduction describes blended care as combining face-to-face CBT with internet-based CBT to draw on the benefits of both. The Discussion reports that blended CBT can be effective in a real-world setting and describes its potential to scale mental health treatment. Together, these passages support the claim's qualified description of blending as a promising approach. (LLM, conf=0.91)
- Supportedcites [24] source
The Introduction defines blended psychotherapy as combining face-to-face therapy with digital components and says this integration aims to improve mental health care. The Discussion (Principal Findings) concludes that the approach appears promising, while emphasizing the need for further research in people with severe mental illness. (LLM, conf=0.88)
plainstates a possible cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
The sources with a verdict support this claim; the rest weren’t checked yet, have no full text we could read, or their verdicts aren’t rated yet.
In the paper
“In practice, many existing DMHIs have high attrition rates and low user engagement, especially when accessed in stand-alone self-guided formats [25,26] and in “real-world” naturalistic settings outside of controlled research studies [27].”
§ Needs and Expectations for the myNewWay Blended Digital and Face-to-Face Psychotherapy Model of Care for Depression and Anxiety (Part 1): Participatory Design Study including People with Lived and Living Experience > Introduction > Digital Mental Health Treatment Digital mental health interventions (DMHIs), such as smartphone apps or online programs, address many of the barriers to face-to-face mental health care. DMHIs allow people to access psychotherapy skills and content in their own time and empower them to self-manage their symptoms [7-11]. Due to these advantages and the need to minimize face-to-face contact during the COVID-19 pandemic, many DMHIs have been developed and implemented quickly in recent years [12]. DMHIs can be used in a self-guided format (ie, without human support) [8,9], guided format (ie, with remote support from a health professional or coach), or together with face-to-face therapy sessions in person or with telehealth in a “blended” format (blended care) [12-14]. Evidence supports the efficacy of DMHIs, particularly those based on cognitive behavioral therapy (CBT), in reducing symptoms of depression and anxiety [15,16]. A 2021 meta-analysis [15] found that compared to control conditions, both guided and self-guided DMHIs significantly reduced depressive symptoms across 83 studies, with a medium pooled effect size (Hedges g=0.52; 95% CI 0.43-0.60). For anxiety, a recent meta-analysis [16] reported that compared to inactive controls, guided and self-guided DMHIs significantly reduced anxiety symptoms across 47 studies, with a large pooled effect size (Hedges g=0.80; 95% CI 0.68-0.93). While most studies have evaluated internet-delivered DMHIs (ie, delivered on websites), smartphone apps targeting depressive and anxiety symptoms have also shown positive results, with small to medium pooled effect sizes for anxiety (Hedges g=0.26; 95% CI 0.21-0.31) and depression (Hedges g=0.50; 95% CI 0.40-0.61) [17,18]. Despite this evidence showing that smartphone apps and internet-based interventions are effective in improving symptoms of depression and anxiety, DMHIs are not typically integrated into routine mental health care [19]. There are several reasons for this, including a lack of practitioner confidence and training in integrating these tools into practice, difficulties in personalizing these interventions, and a lack of integration with practice management software and electronic health records [20]. There is promising preliminary research into the combination of DMHIs with face-to-face therapy in blended care for depression and anxiety [14,21,22]. However, research on the efficacy and effectiveness of blended care is limited compared to the evidence base for self-guided and guided DMHIs [8,9,23] and is confined mainly to Europe and North America [14,24]. In practice, many existing DMHIs have high attrition rates and low user engagement, especially when accessed in stand-alone self-guided formats [25,26] and in “real-world” naturalistic settings outside of controlled research studies [27]. For example, a review by Linardon and Fuller-Tyszkiewicz [26] found that the dropout rate of users participating in studies that included smartphone apps for depressive or anxious symptoms was 36% and 21%, respectively. Dropout rates are even higher in naturalistic community settings. For instance, studies have shown that completion rates of DMHIs in naturalistic settings are at best half of what is found in clinical trials of the same intervention [28-30]. Several factors contribute to low DMHI engagement, including technical issues, motivation issues, and a lack of user-driven design [11,25,31,32]. Reviews of the existing literature also show that various features, functionality, and design considerations can promote user engagement with DMHIs. These include the perceived usefulness; positive impact and relevance of DMHIs; content that promotes good mental, physical, and cognitive health [33,34] and social connection [25,31]; design aspects (eg, ease of use and interface); personalized content and choice [35-37]; data security and privacy; and therapist guidance [25].
What the sources say
- Supportedcites [25] source
The Introduction > Background (p. 1) states that engagement with DMHIs 'remains to be an ongoing issue, varies from study to study, and is typically lower in real-world use than research studies,' with adherence to internet-delivered CBT ranging 6%-100% and real-world uptake of self-help DMHIs varying widely — covering the low-engagement and naturalistic-setting parts of the claim. The self-guided modifier is covered by Results > Program-Related Constructs ('Guided DMHIs had higher engagement than unguided interventions'; 'for interventions that were completely self-guided, participants experienced difficulty engaging with them and at times neglected to use the intervention') and the Discussion > Program Constructs. The only soft spot is wording: this review frames the problem as variable, often low uptake and sustained interaction rather than quantifying 'attrition rates' as such, but the content attributed is stated. (LLM, conf=0.82)
- Not checked yetcites [26] source
- Not checked yetcites [27] source
plainstates an association- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
65 more claims · 7 with their cited sources checked
Create a free account to see all 157 claims and to verify the 86 references still open.
- It may state two separate claims as one. 50
- Probably not a substantial claim. 48
- The quote only partly states this claim. 1
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“Consistent with the views of people with lived experience [56], participants also expected the blended DMHI to be evidence-based, credible, and protective of client data.”
The cited source says what the claim attributes to it.
In the citing paper
“Many of our findings on the needs, preferences, and expectations of mental health professionals for a DMHI that could facilitate blended care align with results from our participatory design study with people with lived and living experiences of depression and anxiety [56] and research with European mental health professionals [28303138-40undefinedundefined].”
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Rated major: it would touch a result — a value a result rests on, reported and recomputed p-values on opposite sides of the significance level, two passages that conflict with no sign which is right, or a cited work retracted before this paper was published.
In the paper
“A total of 209 (68.3%) of 306 participants rated their digital literacy as good to very good, with the rest rating it as acceptable (n=65, 21.2%) or poor (n=12, 3.9%).”
§ Needs and Expectations for the myNewWay Blended Digital and Face-to-Face Psychotherapy Model of Care for Depression and Anxiety (Part 1): Participatory Design Study including People with Lived and Living Experience > Results > Stage 1: Web-Based Survey
Reported 306 · recomputed 286
Citations
Cites
Reflecting on reflexive thematic analysis
Braun, V., & Clarke, V. (2019) · Qualitative Research in Sport, Exercise and Health · doi:10.1080/2159676x.2019.1628806 · Cited by 19,677 · cited 1×
“Reflexive thematic analysis was adopted for qualitative data because this methodology was appropriate for answering the research questions [61].”
Lovibond, P. F., & Lovibond, S. H. (1995) · Behaviour Research and Therapy · doi:10.1016/0005-7967(94)00075-u · Cited by 14,523 · cited 1×
“Participants’ current levels of depression, anxiety, and stress were also assessed using the validated 21-item Depression Anxiety Stress Scale (DASS-21) [59].”
Eysenbach, G. (2004) · Journal of Medical Internet Research · doi:10.2196/jmir.6.3.e34 · Cited by 6,480 · cited 1×
“The survey was developed in accordance with the Checklist for Reporting Results of Internet E-Surveys [58].”
How to Construct a Mixed Methods Research Design
Schoonenboom, J., & Johnson, R. B. (2017) · KZfSS Kölner Zeitschrift für Soziologie und Sozialpsychologie · doi:10.1007/s11577-017-0454-1 · Cited by 1,757 · cited 2×
“A mixed methods convergent parallel design [57] was used for this study, which included a convenience sample of people with lived and living experience.”
The World Mental Health Report: Transforming mental health for all
Freeman, M. (2022) · World Psychiatry · doi:10.1002/wps.21018 · Cited by 1,472
Borghouts, J., Eikey, E., Mark, G., De Leon, C., Schueller, S. M., Schneider, M., Stadnick, N., Zheng, K., Mukamel, D., & Sorkin, D. H. (2021) · Journal of Medical Internet Research · doi:10.2196/24387 · Cited by 1,069 · cited 10×
“…usefulness; positive impact and relevance of DMHIs; content that promotes good mental, physical, and cognitive health [33,34] and social connection [25,31]; design aspects (eg, ease of use and interface); personalized content and choice [35-37]; data security and privacy; and therapist guidance…”
InfluentialOsman, A., Wong, J. L., Bagge, C. L., Freedenthal, S., Gutierrez, P. M., & Lozano, G. (2012) · Journal of Clinical Psychology · doi:10.1002/jclp.21908 · Cited by 1,064 · cited 1×
“The DASS-21 is reported to have sound psychometric properties [60].”
Andrews, G., Basu, A., Cuijpers, P., Craske, M. G., McEvoy, P., English, C. L., & Newby, J. M. (2018) · Journal of Anxiety Disorders · doi:10.1016/j.janxdis.2018.01.001 · Cited by 922 · cited 1×
“While this approach has benefits [38], the downside is that the DMHI cannot be individually tailored to suit a person’s goals, needs, symptoms, and problems.”
Self-citationMental Health Smartphone Apps: Review and Evidence-Based Recommendations for Future Developments
Bakker, D., Kazantzis, N., Rickwood, D., & Rickard, N. (2016) · JMIR Mental Health · doi:10.2196/mental.4984 · Cited by 886 · cited 1×
“While this preference for short, positive motivational messages may be specific to conditions before the COVID-19 pandemic and DMHI users with high digital literacy, existing literature does suggest that the language used in DMHIs should be hopeful and confident [64].”
Cited by
Miller, R. K., O'Moore, K., Kikas, K., Matheson, J.-A. T., Whitton, A. E., Baldwin, P., Li, S., Black, M., Kampel, L., Cockayne, N., et al. (2025) · JMIR Human Factors · doi:10.2196/68789 · Cited by 3
“…and expectations of mental health professionals for a DMHI that could facilitate blended care align with results from our participatory design study with people with lived and living experiences of depression and anxiety [56] and research with European mental health professionals [28,30,31,38-40].”
InfluentialSelf-citationMiller, R. K., O’Moore, K., Kikas, K., Matheson, J.-A. T., Whitton, A. E., Baldwin, P. A., Li, S. H., Black, M., Kampel, L., Cockayne, N. L., et al. (2024) · doi:10.2196/preprints.68789 · Cited by 1
Self-citationPratiwi, D. A. S., Ardana, I. M., & Suweken, G. (2026) · Jurnal Penelitian Pendidikan IPA · doi:10.29303/jppipa.v12i3.14742
“Unlike printed modules, E-Modules allow multimedia integration (images, audio, video, animations) and flexible navigation, which are believed to facilitate diverse student learning styles and increase their engagement in learning (Hajek Gross et al., 2026; Kikas et al., 2025; Marques et al., 2024).”
Metadata
- Authors
- Kikas, K., O'Moore, K., Miller, R. K., Matheson, J.-A. T., Li, S., Varghese, K., Baldwin, P., Cockayne, N., Whitton, A. E., & Newby, J. M.
- Affiliations
- Black Dog Institute (AU)
- Corresponding author
- Newby, Jill Maree
- ORCID
- Venue
- JMIR Human Factors
- Publisher
- JMIR Publications Inc.
- Published
- 2025-06-11
- Volume
- 12
- Pages
- e69499
- ISSN
- 2292-9495 (ISSN-L)
- PMC
- PMC12198704
- OpenAlex
- W4409588586
- Cited by
- 3
- References
- 62
- Citations by year
- 2026: 1 · 2025: 1
- FWCI
- 1.60
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by
- Locations
- JMIR Human Factors (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Funders
- Wellcome Trust
- National Institute for Health and Care Research
- Medical Research Council
- National Health and Medical Research Council
- Topics
- Social Sciences › Psychology › Applied Psychology › Digital Mental Health Interventions
- Health Sciences › Health Professions › General Health Professions › Mobile Health and mHealth Applications
- Health Sciences › Medicine › Psychiatry and Mental health › Mental Health Treatment and Access
- Keywords
- digital mental health interventions, depression, anxiety, transdiagnostic treatment, participatory design, user engagement, mobile application, user preferences, peer support, symptom monitoring, barriers and facilitators
- MeSH terms
- Adult, Aged, Anxiety, Australia, Depression, Female, Humans, Male, Middle Aged, Psychotherapy, Telemedicine, Qualitative Research
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-10-11, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-11 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (qwen3.8-omni-flash and gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.