CoChat

Pilot evaluation of the Sleep Ninja: A smartphone application for adolescent insomnia symptoms

Open access

The DOI matches its Crossref record; 53 of the 54 references it cites were found in a registry or an index; 19 of the 41 sources its claims cite were checked for support.

Abstract

Objectives The aim of this study was to test the feasibility, acceptability and preliminary effects of a recently developed smartphone application, Sleep Ninja, for adolescent sleep difficulties. Setting The study was conducted online with Australian individuals recruited through the community. Participants Participants were 50 young people aged 12-16 years with sleep difficulties. Design A single-Arm pre-post design was used to evaluate feasibility, acceptability and sleep and mental health variables at baseline and postintervention. Intervention Cognitive-behavioural therapy for insomnia informed the development of the Sleep Ninja. The core strategies covered by the app are psychoeducation, stimulus control, sleep hygiene and sleep-related cognitive therapy. It includes six training sessions (lessons), a sleep tracking function, recommended bedtimes based on sleep guidelines, reminders to start a wind-down routine each night, a series of sleep tips and general information about sleep. Users progress through each training session and conclude the 6-week programme with a black belt in sleep. Outcome measures Feasibility was evaluated based on consent rates, adherence and attrition, acceptability was assessed using questionnaires and a poststudy interview, and sleep, depression and anxiety variables were assessed at baseline and postintervention. Results Data indicated that the Sleep Ninja is a feasible intervention and is acceptable to young people. Findings showed that there were significant improvements on sleep variables including insomnia (within-group effect size d=-0.90), sleep quality (d=-0.46), depression (d=-0.36) and anxiety (d=-0.41). Conclusions The Sleep Ninja is a promising intervention that could assist adolescents who experience sleep difficulties. A follow-up randomised controlled trial is now warranted. © Author(s) (or their employer(s)) 2019. Re-use permitted under CC BY-NC. No commercial re-use. See rights and permissions. Published by BMJ.

Overview

CoChat Summary

TL;DR

This pilot study found that the fully automated Sleep Ninja smartphone app was feasible and acceptable for adolescents aged 12–16 years with sleep difficulties. In a single-arm pre–post evaluation, participants showed significant improvements in insomnia, sleep quality, depression, and anxiety, but the authors note that a controlled trial is needed.

Key findings

  • Recruitment and retention were reasonably strong: >300 enquiries led to 60 eligible consent forms, 50 participants enrolled, 47/50 (94%) completed baseline, and 34/50 (72%) completed the poststudy battery.
  • Uptake/adherence was moderate: 45 participants (96% of those who completed baseline) downloaded the app; 82% completed the first lesson, 51% completed 4 of 6 lessons, and 33% completed all 6.
  • Acceptability was high: 97% said the app was “easy” or “very easy” to use, 78% found it useful or very useful, 72% reported behaviour change, and 91% would recommend it to a friend.
  • Preliminary effects favored improvement from baseline to poststudy: insomnia severity decreased (ISI, β=−4.29, p<0.001, d=−0.90), sleep quality improved (PSQI, β=−1.88, p<0.001, d=−0.46), and depression and anxiety also decreased (PHQ-A, β=−2.60, p<0.001, d=−0.36; GAD-7, β=−2.56, p<0.001, d=−0.41). Sleep diary outcomes also improved, including going to bed 35 min earlier, falling asleep 21 min faster, sleeping 33 min longer, and reducing night awakenings to 0.87 on average.

Methods

  • Single-arm pre–post pilot study conducted online with Australian community-recruited adolescents aged 12–16 years who had at least mild insomnia symptoms.
  • Sample: 50 participants; inclusion required a smartphone (iOS or Android), email, internet access, and personal plus parental consent.
  • Main analysis used multilevel modelling comparing baseline with poststudy outcomes; feasibility was assessed via consent, adherence, and attrition, and acceptability via questionnaires plus semistructured interviews.

Limitations

  • Stated by the paper: the sample had relatively minor insomnia symptoms at entry, there was no control group, and sleep outcomes were exclusively self-reported.
  • Evident from the text: the study was small (n=50) and therefore preliminary, so the reported effects cannot establish causality or separate intervention effects from time or other confounders.

Model-written summary. Check it against the paper before relying on it.

Integrity signals

Registry

Crossref · 10.1136/bmjopen-2018-026502

Cites

53 of 53 references verified0 citation errors · 0 not checkable

Statistics

Nothing to recompute.

Figures

Figure 1 Example screens from the Sleep Ninja app. From left: homescreen, training session access and progress record, tracking and bedtime setting, more information.
Figure 1 Example screens from the Sleep Ninja app. From left: homescreen, training session access and progress record, tracking and bedtime setting, more information.CC BY-NC · PubMed Central
Figure 2 Participant Flow.
Figure 2 Participant Flow.CC BY-NC · PubMed Central

Verification

Claims the paper makes

14 Valid · 1 Not valid · 13 Not checked · 81 Own results and interpretations

62 more claims · 3 with their cited sources checked

Create a free account to see all 109 claims and every source verdict.

See all claims — free account
  • Probably not a substantial claim. 17
  • It may state two separate claims as one. 33
  • The quote only partly states this claim. 1

Create a free account to see these claims.

Citations

Cites

Show all 53 references

Cited by

See all 83

Metadata

Authors
Werner-Seidler, A., Wong, Q., Johnston, L., O’Dea, B., Torok, M., & Christensen, H.
Affiliations
  • Black Dog Institute, University of New South Wales, Sydney, NSW, Australia
  • Black Dog Institute (AU)
Venue
BMJ Open
Publisher
BMJ
Published
2019-05
Volume
9
Issue
5
Pages
e026502
ISSN
2044-6055 (ISSN-L)
OpenAlex
W2946137690
Cited by
82
References
54
Citations by year
2026: 11 · 2025: 14 · 2024: 16 · 2023: 16 · 2022: 10 · 2021: 7 · 2020: 7 · 2019: 1
FWCI
7.35
Type
journal article
Language
en
Open access
Licence
cc-by-nc
Locations
  • BMJ Open (publishedVersion, cc-by-nc)
  • PubMed Central (publishedVersion, cc-by-nc)
  • PubMed (publishedVersion)
  • UNSWorks (University of New South Wales, Sydney, Australia) (submittedVersion, cc-by-nc-nd)
  • HighWire Press Open Archive (submittedVersion)
Funders
Corella Foundation
Topics
  • Social Sciences › Psychology › Experimental and Cognitive Psychology › Sleep and related disorders
  • Social Sciences › Psychology › Applied Psychology › Digital Mental Health Interventions
  • Health Sciences › Health Professions › General Health Professions › Mobile Health and mHealth Applications
Keywords
mobile application, adolescent insomnia, sleep disorders, cognitive behavioral therapy for insomnia, feasibility, acceptability, depression, anxiety, sleep hygiene, stimulus control, psychoeducation, sleep monitoring, digital mental health interventions
MeSH terms
Smartphone, Adolescent, Anxiety, Australia, Child, Depression, Female, Humans, Sleep Initiation and Maintenance Disorders, Male, Mental Health Services, Patient Acceptance of Health Care, Pilot Projects, Psychiatric Status Rating Scales, Surveys and Questionnaires, Cognitive Behavioral Therapy, Mobile Applications

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

The claim verdicts this report counts are experimental: their accuracy is not yet measured.

A language model drew the claims from the paper on 2026-10-11, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).

A second model labelled each claim on 2026-10-11 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).

Cited sources are checked with a language model’s help (gpt-6-sol).

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Pilot evaluation of the Sleep Ninja: A smartphone application for adolescent insomnia symptoms. https://app.cochat.ai/papers/10.1136/bmjopen-2018-026502
The paper
Werner-Seidler, A., Wong, Q., Johnston, L., O’Dea, B., Torok, M., & Christensen, H. (2019). Pilot evaluation of the Sleep Ninja: A smartphone application for adolescent insomnia symptoms. BMJ Open. https://doi.org/10.1136/bmjopen-2018-026502

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.