The DOI matches its Crossref record; 101 of the 101 references it cites were found in a registry or an index; 26 of the 109 sources its claims cite were checked for support.
Use of the Principles of Design Thinking to Address Limitations of Digital Mental Health Interventions for Youth: Viewpoint
Open accessPublished version of a preprint
Abstract
Numerous reviews and meta-analyses have indicated the enormous potential of technology to improve the appeal, effectiveness, cost, and reach of mental health interventions. However, the promise of digital mental health interventions for youth has not yet been realized. Significant challenges have been repeatedly identified, including engagement, fidelity, and the lack of personalization. We introduce the main tenets of design thinking and explain how they can specifically address these challenges, with an entirely new toolbox of mindsets and practices. In addition, we provide examples of a new wave of digital interventions to demonstrate the applicability of design thinking to a wide range of intervention goals. In the future, it will be critical for scientists and clinicians to implement their scientific standards, methods, and review outlets to evaluate the contribution of design thinking to the next iteration of digital mental health interventions for youth.
Overview
CoChat Summary
## TL;DR
This viewpoint argues that digital mental health interventions for youth have not yet delivered on their promise because of persistent problems with engagement, adherence, fidelity, personalization, and cognitive load. The authors propose design thinking—empathy, multidisciplinary ideation, and experimentation—as a framework to create more usable and engaging interventions, illustrated with examples including the MindLight anxiety game.
## Key findings
- Reviews and meta-analyses cited in the paper estimate that 64%–87% of youth mental health problems are undetected and untreated, underscoring the need for scalable interventions.
- For unguided digital interventions, one meta-analytic study reported that almost 70% of participants dropped out before completing 75% of the intervention.
- In adults, the paper reports that there is support for digital mental health (DMH) interventions: over 100 studies have established efficacy, and guided interventions are reported to be more effective than waiting list, attention, information, or online discussion groups.
- For youth, the paper says evidence is less conclusive: overall effects are moderate to large for anxiety and small to moderate for depression versus waitlist, but comparisons with active nontherapeutic controls generally did not show superiority; the authors also note that four RCTs of MindLight showed significant decreases in children’s anxiety symptoms, with two studies comparable to active control/TAU and two comparable to CBT interventions.
## Methods
- This is a viewpoint paper, not an original empirical study; it summarizes and critiques prior reviews/meta-analyses and presents a conceptual framework.
- The paper focuses mainly on digital mental health interventions for youth, especially interventions for anxiety and depression and CBT-based digital programs, and uses MindLight and a youth smoking game as illustrative examples.
- The analysis is a narrative synthesis of the literature plus examples from the authors’ own design and testing work, including prototyping, pilot studies, and RCTs reported for MindLight.
## Limitations
- The paper explicitly notes that its discussion is limited to postintervention measurements because most meta-analyses did not have enough power to conclude effects on follow-up outcomes.
- It states that the design-thinking approach is not enough as a stand-alone practice and should be combined with rigorous scientific standards and methodologies.
- Evident from the text: this is a narrative viewpoint with no new systematic review protocol or pooled reanalysis, so its claims depend on the cited literature and illustrative case examples rather than a new comprehensive empirical test.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Figures




Verification
Claims the paper makes
16 Valid · 3 Not valid · 34 Not checked · 29 Own results and interpretations
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“The influence of human guidance on DMH interventions for adult anxiety and depression is still debated [25,26].”
§ Use of the Principles of Design Thinking to Address Limitations of Digital Mental Health Interventions for Youth: Viewpoint > Outcome Research on Digital Mental Health Interventions
What the sources say
- Partly supportedcites [25] sourceExperimental — accuracy not yet measured
Our copy of the Ebert & Baumeister letter (with Karyotaki et al.'s reply) does state that the role of guidance is unresolved for internet-based self-help interventions for depression: the reply concedes 'the number of studies directly comparing guided with self-guided interventions is scarce, and the evidence that guided interventions are more effective is not conclusive,' while the letter asserts that 'guided self-help approaches for depression are superior over pure self-help interventions' — a genuine disagreement, i.e. a debate. However, the entire exchange concerns depressive symptoms only; no passage in our copy addresses anxiety disorders (searched: 'anxiety disorders guided versus self-guided internet interventions'), so the extension of the debated influence of guidance to adult anxiety is not supported by this source. The 'adult' population qualifier is likewise nowhere specified in our copy. (LLM, conf=0.75)
- Not checked yetcites [26] source
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“However, the effectiveness of digital technology in reducing the burden of mental health at a population level is progressing slowly at best [18-21].”
§ Use of the Principles of Design Thinking to Address Limitations of Digital Mental Health Interventions for Youth: Viewpoint > Background
What the sources say
- Partly supportedcites [18] sourceExperimental — accuracy not yet measured
The Abstract (Background; page unavailable) says large-scale adoption of e-mental health services is progressing slowly, and the Introduction (page unavailable) describes low impact in health care across the globe. These passages support slow population-level uptake, but the review does not establish that the effectiveness of digital technology in reducing the population’s mental-health burden is itself progressing slowly. (LLM, conf=0.85)
- Not checked yetcites [19] source
- Partly supportedcites [20] sourceExperimental — accuracy not yet measured
The Introduction says that realizing the potential of e-mental health requires embedding it in the health system. Facilitating Uptake says most studies focused on improving individual interventions rather than how to implement them system-wide. This supports concern about slow translation into population-wide care, but the review does not establish a rate of progress in reducing the population-level burden of mental illness. (LLM, conf=0.78)
- Partly supportedcites [21] sourceExperimental — accuracy not yet measured
The Introduction says implementation in routine care is challenging, and the Discussion’s Conclusions identify low acceptability as a barrier to large-scale dissemination. These passages support limited uptake, but the paper does not measure population-level mental-health burden or establish how quickly digital technology’s effectiveness in reducing it is progressing. No page numbers are available in our copy. (LLM, conf=0.83)
hedgedstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Numerous reviews and meta-analyses have indicated the enormous potential of technology to improve the appeal, effectiveness, cost, and reach of mental health interventions.”
- Also stated in: § Background · hedged
“Several reviews have indicated the enormous potential of technology to improve the effectiveness, efficiency, cost, reach, personalization, and appeal of mental health interventions [12-16].”
§ Use of the Principles of Design Thinking to Address Limitations of Digital Mental Health Interventions for Youth: Viewpoint > Abstract
What the sources say
- Not checked yetcites [12] source
- Not checked yetcites [13] source
- Not checked yetcites [14] source
- Not checked yetcites [15] source
- Partly supportedcites [16] sourceExperimental — accuracy not yet measured
Our copy does support two of the four attributed benefits: the 'Description of the intervention' section states that recent systematic reviews of computer- and Internet-based treatment for mental health problems 'suggest largely that these types of treatment are more effective than a waiting list control and equally effective as face-to-face psychotherapy' (Spek 2007; Bee 2008; Cuijpers 2009; Reger 2009; Cuijpers 2010), and 'Agreements and disagreements with other studies or reviews' surveys numerous prior meta-analyses (Barak 2008 d = 0.53; Spek 2007 d = 0.96; Andersson 2007 d = 0.91; Cuijpers 2009 d = 1.08; Reger 2009; Andrews 2010 g = 0.83–1.12) whose results are 'in accordance with the present findings'. Reach is likewise attributed (increase access for rural areas, limited mobility, minimise treatment barriers). But no passage of our copy credits any review or meta-analysis with evidence on cost — cost appears only inside an included-trial reference title (Kok 2012 protocol) — and appeal is supported only by this review's own pooled satisfaction data (section 1.5, ~90% satisfied), not by cited reviews. The review is also more hedged than 'enormous potential': 'Widespread rollout of ICBT may not yet be warranted' (Implications for practice). (LLM, conf=0.75)
hedgedstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Also stated in: § Background · hedged
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“However, the promise of digital mental health interventions for youth has not yet been realized.”
- Also stated in: § Limitations of DMH Interventions for Youth · hedged
“In summary, a convincing set of reviews and meta-analyses suggest that the promises of digital solutions, especially those targeted at youth, have not yet been realized [11,12,37].”
§ Use of the Principles of Design Thinking to Address Limitations of Digital Mental Health Interventions for Youth: Viewpoint > Abstract
What the sources say
- Partly supportedcites [11] sourceExperimental — accuracy not yet measured
In “The contribution of digital technology to the global dissemination of psychological treatments” (page unavailable), the paper says mobile and online technologies may help support young people with mental disorders, but that their effectiveness has received little formal evaluation. That supports the idea of an unfulfilled potential, but the paper does not establish the broader claim that the promise of digital mental health interventions for youth has not been realized. (LLM, conf=0.82)
- Not checked yetcites [12] source
- Partly supportedcites [37] sourceExperimental — accuracy not yet measured
The Abstract Conclusions say that long-term effects remain questionable and evidence of economic benefits is lacking, which supports caution about the promise of these interventions. But the Discussion Conclusions also find that web-based interventions are effective in the short term for depressive and anxiety symptoms, so the unqualified claim that their promise has not been realized overstates the review. Page numbers were not supplied. (LLM, conf=0.84)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Also stated in: § Limitations of DMH Interventions for Youth · hedged
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Välimäki and colleagues [37] showed that young people (between the ages of 10 and 24 years) in the digital intervention groups (most often, guided DMH interventions) left the study earlier than the control group participants.”
§ Use of the Principles of Design Thinking to Address Limitations of Digital Mental Health Interventions for Youth: Viewpoint > Limitations of DMH Interventions for Youth
What the sources say
- Partly supportedcites [37] sourceExperimental — accuracy not yet measured
The Results section on attrition reports that young people left the study earlier in the intervention group than in the control group, and the Methods eligibility criteria give the age range as 10–24 years. The paper does not establish that the interventions were most often guided; the Discussion instead describes Web-based interventions as often self-directed or self-guided. No page numbers are available in our copy. (LLM, conf=0.85)
plainstates an association- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
35 more claims · 8 with their cited sources checked
Create a free account to see all 82 claims and to verify the 83 references still open.
- It may state two separate claims as one. 26
- Probably not a substantial claim. 19
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“During its development, we cocreated the app with a large multidisciplinary team of child and adolescent psychiatrists, developmental and clinical psychologists, data analysts, game designers, and multiple test panels (adolescents aged 12-25 years) [35,36].”
From A Smartphone Serious Game for Adolescents (Grow It! App): Development, Feasibility, and Acceptance Study (2022) · cites this paper as [36]
Experimental — accuracy not yet measured
Citations
Cites
Mindset: The New Psychology of Success
(2006) · Choice Reviews Online · doi:10.5860/choice.44-2397 · Cited by 7,804
Polanczyk, G. V., Salum, G. A., Sugaya, L. S., Caye, A., & Rohde, L. A. (2015) · Journal of Child Psychology and Psychiatry · doi:10.1111/jcpp.12381 · Cited by 3,990 · cited 1×
“The prevalence of mental health problems has significantly increased among children (aged 5-10 years) and adolescents (aged 10-24 years [1]) [2-5], and the current prevalence rate of mental disorders is estimated to be 13.”
Sawyer, S. M., Azzopardi, P. S., Wickremarathne, D., & Patton, G. C. (2018) · The Lancet Child & Adolescent Health · doi:10.1016/s2352-4642(18)30022-1 · Cited by 3,666 · cited 1×
“The prevalence of mental health problems has significantly increased among children (aged 5-10 years) and adolescents (aged 10-24 years [1]) [2-5], and the current prevalence rate of mental disorders is estimated to be 13.4% [2-5].”
InfluentialKawachi, I. (2001) · Journal of Urban Health: Bulletin of the New York Academy of Medicine · doi:10.1093/jurban/78.3.458 · Cited by 3,538 · cited 1×
“These social processes are equally important in the design of interventions for anxious and depressed youth, as social ties play a beneficial role in maintaining psychological well-being and mental health [82,83].”
Gulliver, A., Griffiths, K. M., & Christensen, H. (2010) · BMC Psychiatry · doi:10.1186/1471-244x-10-113 · Cited by 3,292 · cited 2×
“Mental health researchers and clinicians often assume that young people, especially those who are emotionally vulnerable, do not know when they are suffering and are incapable of asking for the kind of help they need [7,78,79].”
A systematic literature review of empirical evidence on computer games and serious games
Connolly, T. M., Boyle, E. A., MacArthur, E., Hainey, T., & Boyle, J. M. (2012) · Computers & Education · doi:10.1016/j.compedu.2012.03.004 · Cited by 2,890 · cited 1×
“A zeitgeist has emerged in the medical and educational fields for applied or “serious” games as tools for enhancing medical care [58-61].”
Rowe, P. G. (1987) · Cited by 2,481
The benefits of playing video games.
Granic, I., Lobel, A., & Engels, R. C. M. E. (2014) · American Psychologist · doi:10.1037/a0034857 · Cited by 2,456 · cited 2×
“We previously provided a detailed empirical review [49] that supports the rationale for using digital games as intervention tools for young people.”
Self-citationPiaggio, G., Elbourne, D. R., Pocock, S. J., Evans, S. J. W., Altman, D. G., & CONSORT Group, F. T. (2012) · JAMA · doi:10.1001/jama.2012.87802 · Cited by 2,428
It's complicated: the social lives of networked teens
(2014) · Choice Reviews Online · doi:10.5860/choice.51-7042 · Cited by 1,607
Research works printed but not linked: 3
- Rickwood, DJ, 2007, Med J Aust, 187, S35
- Brown, T, 2008, Harv Bus Rev, 86, 84
- van Reine, PP, 2017, J Innov Manag, 5, 80
Cited by
Liverpool, S., Mota, C. P., Sales, C. M. D., Čuš, A., Carletto, S., Hancheva, C., Sousa, S., Cerón, S. C., Moreno-Peral, P., Pietrabissa, G., et al. (2020) · Journal of Medical Internet Research · doi:10.2196/16317 · Cited by 408
“Despite the growing interest in using mobile apps to deliver interventions, more research evidence is needed to support implementation in children and young people’s mental health (CYPMH) services [27-29].”
An overview of and recommendations for more accessible digital mental health services
Lattie, E. G., Stiles-Shields, C., & Graham, A. K. (2022) · Nature Reviews Psychology · doi:10.1038/s44159-021-00003-1 · Cited by 446
Torok, M., Han, J., Baker, S., Werner-Seidler, A., Wong, I., Larsen, M. E., & Christensen, H. (2020) · The Lancet Digital Health · doi:10.1016/s2589-7500(19)30199-2 · Cited by 273
Digital Mental Health Challenges and the Horizon Ahead for Solutions
Balcombe, L., & De Leo, D. (2021) · JMIR Mental Health · doi:10.2196/26811 · Cited by 173
“Scholten and Granic [10] noted that researchers are reconceptualizing the scientific framework, methodology, and implementation strategies for digital mental health implementation and highlighted significant technological challenges including engagement, retention, fidelity, lack of personalization, and cognitive load.”
BackgroundAbookire, S., Plover, C. M., Frasso, R., & Ku, B. S. (2020) · Frontiers in Public Health · doi:10.3389/fpubh.2020.00459 · Cited by 200
Metadata
- Authors
- Scholten, H., & Granic, I.
- Affiliations
- Radboud University Nijmegen (NL)
- Corresponding author
- Scholten, Hanneke
- Venue
- Journal of Medical Internet Research
- Publisher
- JMIR Publications Inc.
- Published
- 2019-01-14
- Volume
- 21
- Issue
- 1
- Pages
- e11528
- ISSN
- 1438-8871 (ISSN-L)
- PMC
- PMC6682276
- OpenAlex
- W2895871399
- Cited by
- 138
- References
- 101
- Citations by year
- 2026: 13 · 2025: 13 · 2024: 23 · 2023: 22 · 2022: 24 · 2021: 22 · 2020: 18 · 2019: 3
- FWCI
- 13.56
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by
- Locations
- Journal of Medical Internet Research (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- Radboud Repository (Radboud University) (submittedVersion, cc-by)
- Radboud Repository (Radboud University) (submittedVersion)
- Funders
- European Commission (HORIZON2020)
- H2020 European Research Council (683262)
- Topics
- Social Sciences › Psychology › Applied Psychology › Digital Mental Health Interventions
- Physical Sciences › Computer Science › Human-Computer Interaction › Innovative Human-Technology Interaction
- Health Sciences › Health Professions › General Health Professions › Mobile Health and mHealth Applications
- Keywords
- design thinking, digital mental health interventions, youth mental health, user engagement, intervention fidelity, personalization
- MeSH terms
- Adolescent, Data Collection, Humans, Mental Health, Research Design, Technology
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-10-11, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-11 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (qwen3.8-omni-flash and gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Use of the Principles of Design Thinking to Address Limitations of Digital Mental Health Interventions for Youth: Viewpoint. https://app.cochat.ai/papers/10.2196/11528
- The paper
- Scholten, H., & Granic, I. (2019). Use of the Principles of Design Thinking to Address Limitations of Digital Mental Health Interventions for Youth: Viewpoint. Journal of Medical Internet Research. https://doi.org/10.2196/11528
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.