CoChat
Sign Up
Cited by 57Digital Mental Health InterventionsMobile Health and mHealth ApplicationsMindfulness and Compassion Interventions

Comparing usage of a web and app stress management intervention: An observational study

Open access
Morrison, Leanne G., Geraghty, Adam W.A., Lloyd, Scott, Goodman, Natalie, Michaelides, Danius T., Hargood, Charlie, Weal, Mark, Yardley, Lucy·2018·Internet Interventions
DOI 10.1016/j.invent.2018.03.006PMC PMC6096327
Open this paper in CoChat — free accountOpen PDF

Abstract

Choices in the design and delivery of digital health behaviour interventions may have a direct influence on subsequent usage and engagement. Few studies have been able to make direct, detailed comparisons of differences in usage between interventions that are delivered via web or app. This study compared the usage of two versions of a digital stress management intervention, one delivered via a website (Healthy Paths) and the other delivered via an app (Healthy Mind). Design modifications were introduced within Healthy Mind to take account of reported differences in how individuals engage with websites compared to apps and mobile phones. Data were collected as part of an observational study nested within a broader exploratory trial of Healthy Mind. Objective usage of Healthy Paths and Healthy Mind were automatically recorded, including frequency and duration of logins, access to specific components within the intervention and order of page/screen visits. Usage was compared for a two week period following initial registration. In total, 381 participants completed the registration process for Healthy Paths (web) and 162 participants completed the registration process for Healthy Mind (app). App users logged in twice as often (Mdn = 2.00) as web users (Mdn = 1.00), U = 13,059.50, p ≤ 0.001, but spent half as much time (Mdn = 5.23 min) on the intervention compared to web users (Mdn = 10.52 min), U = 19,740.00, p ≤ 0.001. Visual exploration of usage patterns over time revealed that a significantly higher proportion of app users (n = 126, 82.35%) accessed both types of support available within the intervention (i.e. awareness and change-focused tools) compared to web users (n = 92, 40.17%), χ2(1, n = 382) = 66.60, p < 0.001. This study suggests that the digital platform used to deliver an intervention (i.e. web versus app) and specific design choices (e.g. navigation, length and volume of content) may be associated with differences in how the intervention content is used. Broad summative usage data (e.g. total time spent on the intervention) may mask important differences in how an intervention is used by different user groups if it is not complemented by more fine-grained analyses of usage patterns over time. Trial registration number: ISRCTN67177737.

AI snapshot

Written from the paper’s full text.

TL;DR

This observational study compared usage of a web-based stress management intervention (Healthy Paths) and an app-based version (Healthy Mind) with design modifications for mobile use. App users logged in more often but spent less total time, and accessed more core tools, especially starter tools, than web users.

Key findings

  • App users logged in twice as often (Mdn = 2.00) as web users (Mdn = 1.00), U = 13,059.50, p ≤ 0.001, but spent half as much time on the intervention (Mdn = 5.23 min) compared with web users (Mdn = 10.52 min), U = 19,740.00, p ≤ 0.001.
  • A significantly higher proportion of web users ceased use within 2 weeks (n = 313, 82.15%) compared with app users (n = 69, 42.59%), χ2(1, n = 543) = 36.90, p < 0.001.
  • More app users accessed at least one tool (n = 153, 94.44%) than web users (n = 229, 60.10%), χ2(1, n = 543) = 64.26, p < 0.001; app users also more often accessed both awareness and change-focused tools (n = 126, 82.35%) than web users (n = 92, 40.17%), χ2(1, n = 382) = 66.60, p < 0.001.
  • App starter tools were each accessed by 70–80% of app users versus <30% for non-starter app tools; each web tool was accessed by 20–40% of web users. All four designated starter tools were accessed by 68 app users (44.44%) versus 17 web users (7.42%), χ2(1, n = 382) = 72.66, p < 0.001.

Methods

  • Observational study nested within a broader exploratory trial of Healthy Mind; data collected September 2014–February 2015. Participants were recruited via posters, newsletters, and emails in workplaces across the North East, UK; eligibility required age 18+ and Internet or Android smartphone access.
  • In total, 389 registered for Healthy Paths and 202 downloaded Healthy Mind; 381 (97.94%) web and 162 (80.20%) app participants completed registration and baseline and were included. Usage was automatically recorded for the two weeks after initial registration, including frequency and duration of logins, page/screen visits, and order of visits.
  • Usage variables were compared using Mann-Whitney U and Chi-Square tests; individual-level flow through the intervention was explored visually using a LifeGuide visualisation tool.

Limitations

  • The paper states it was observational: participants were not randomised to web or app, user characteristics differed significantly between samples, and the website and app were not directly comparable because design modifications were introduced. It therefore cannot draw definitive causal conclusions about how specific design choices influenced usage.
  • The paper states analyses were exploratory, follow-up survey response rates were low (web n = 80, 21.00%; app n = 34, 20.99%), and no formal analyses of satisfaction or health-related outcomes were presented; no conclusions are drawn about effective levels of usage.
  • Evident from the text: app users were randomised to different push-notification schedules within the broader trial, while web users received no email notifications or reminders to log back in, so notification exposure differed between platforms and may confound the comparison.

Model-written summary. Check it against the paper before relying on it.

Integrity signals

Registry

Crossref · 10.1016/j.invent.2018.03.006

Cites

22 of 22 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

0 of 22 cited sources checked · 0 supported · 0 flagged

  • Findingown data

    App users logged in twice as often as web users (Mdn = 2.00 vs 1.00, U = 13,059.50, p ≤ 0.001).

    “App users logged in twice as often (Mdn = 2.00) as web users (Mdn = 1.00), U = 13,059.50, p ≤ 0.001”
    Quote in the paperSubstantial claim
  • Findingown data

    A significantly higher proportion of app users (n = 126, 82.35%) accessed both types of support available within the intervention (awareness and change-focused tools) compared to web users (n = 92, 40.17%), χ2(1, n = 382) = 66.60, p < 0.001.

    “a significantly higher proportion of app users (n = 126, 82.35%) accessed both types of support available within the intervention (i.e. awareness and change-focused tools) compared to web users (n = 92, 40.17%), χ2(1, n = 382) = 66.60, p < 0.001”
    Quote in the paperSubstantial claim
  • Findingown data

    App users spent half as much time on the intervention compared to web users (Mdn = 5.23 min vs 10.52 min, U = 19,740.00, p ≤ 0.001).

    “but spent half as much time (Mdn = 5.23 min) on the intervention compared to web users (Mdn = 10.52 min), U = 19,740.00, p ≤ 0.001”
    Quote in the paperSubstantial claim
  • Findingown data

    A greater proportion of app users accessed at least one of the available tools compared to web users.

    “A greater proportion of app users accessed at least one of the available tools (n = 153, 94.44%) compared to web users (n = 229, 60.10%), χ2(1, n = 543) = 64.26, p < 0.001.”
    Quote in the paperSubstantial claim
  • Findingown data

    A significantly higher proportion of web users were female compared to app users.

    “A significantly higher proportion of web users were female (around three quarters) compared to app users (just over half), χ2(1, n = 523) = 23.71, p < 0.001.”
    Quote in the paperNot a substantial claim
  • May combine two claims. 22
  • Classified as probably not a substantial claim. 31

  • May combine two claims.

    Findingown data

    In total, 381 participants completed the registration process for Healthy Paths (web) and 162 participants completed the registration process for Healthy Mind (app).

    “In total, 381 participants completed the registration process for Healthy Paths (web) and 162 participants completed the registration process for Healthy Mind (app).”
    Quote in the paperNot a substantial claim

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Findingnone given

    These extended explanations were removed from the app.

    “These extended explanations were removed from the app.”
    Quote in the paperNot a substantial claim

  • May combine two claims.

    Findingown data

    In total, 389 participants registered to the Healthy Paths website and 202 participants downloaded the Healthy Mind app.

    “In total, 389 participants registered to the Healthy Paths website and 202 participants downloaded the Healthy Mind app.”
    Quote in the paperNot a substantial claim

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Findingown data

    Around half of both web and app users were educated to degree level or higher.

    “Around half the users of both the website (n = 207, 54.43%) and the app (n = 71, 50.00%) were educated to degree level or higher.”
    Quote in the paperNot a substantial claim

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Findingown data

    Response rates to the online feedback survey were low for both web (21.00%) and app (20.99%) users.

    “As expected, response rates to the online feedback survey were low for both web (n = 80, 21.00%) and app (n = 34, 20.99%) users.”
    Quote in the paperNot a substantial claim

  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Findingnone given

    Each tool was designed to support participants to improve awareness of their thoughts or behaviours or support change in thinking patterns and behaviours.

    “Each tool was designed to support participants to improve awareness of their thoughts or behaviours or support change in thinking patterns and behaviours.”
    Quote in the paperNot a substantial claim

  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Findingnone given

    Four starter tools were initially available on the app; new tools were unlocked each time users completed and rated a tool until all tools were available.

    “Four starter tools were initially available on the app (see Table 1). New tools were unlocked each time users completed and rated a tool until all tools were available.”
    Quote in the paperNot a substantial claim

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Findingnone given

    Tools that focused on the same types of thought or behaviour were combined within the app.

    “Tools that focused on the same types of thought or behaviour were combined within the app (see Table 1).”
    Quote in the paperNot a substantial claim

  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Findingcitation

    Healthy Mind is an Android app that was adapted from the Healthy Paths website and was created using the Life Guide Toolbox software.

    “Healthy Mind is an Android app that was adapted from the Healthy Paths website and was created using the Life Guide Toolbox software (Hargood et al., 2014).”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Hargood et al., 2014

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Findingnone given

    The tools provided in the web version comprised those to support increased awareness of thoughts or behaviours and those that supported users to change thoughts or behaviours.

    “The tools provided in the web version comprised those to support increased awareness of thoughts or behaviours and those that supported users to change thoughts or behaviours.”
    Quote in the paperNot a substantial claim

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Findingnone given

    The number of tools available was reduced in the app version.

    “Additionally, the number of tools available was reduced in the app version.”
    Quote in the paperNot a substantial claim

  • May combine two claims.

    Findingown data

    Data on sample characteristics were missing for 20 participants who downloaded the Healthy Mind app, and age data for an additional 14 participants was suspected to be false.

    “Data on sample characteristics were missing for 20 participants who downloaded the Healthy Mind app; age data for an additional 14 participants was suspected to be false (i.e. <18 and improbable based on reported educational attainment).”
    Quote in the paperNot a substantial claim

  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Findingnone given

    The longer introduction within the web version was used to normalise the experience of distress and explain the distinction between increasing awareness of thoughts or behaviours versus making changes to thoughts or behaviours.

    “The longer introduction within the web version was used to normalise the experience of distress and explain the distinction between increasing awareness of thoughts or behaviours versus making changes to thoughts or behaviours.”
    Quote in the paperNot a substantial claim

  • May combine two claims.

    Findingown data

    The age range of web users was 20 to 69 years compared to 18 to 62 years for app users.

    “The age range of web users was 20 to 69 years compared to 18 to 62 years for app users.”
    Quote in the paperNot a substantial claim

  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Findingnone given

    Explanations for why and how each tool may be helpful for managing stress were provided as tunnelled content in the web version; these explanations were simplified and made optional within the app.

    “Similarly, explanations for why and how each tool may be helpful for managing stress were provided as tunnelled content in the web version. These explanations were simplified and made optional within the app.”
    Quote in the paperNot a substantial claim

  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Findingnone given

    Healthy Paths was designed to support users in managing emotional distress and was not intended as an intervention for psychological disorders (e.g. depressive disorder or generalised anxiety disorder).

    “Healthy Paths was designed to support users in managing emotional distress and was not intended as an intervention for psychological disorders (e.g. depressive disorder or generalised anxiety disorder).”
    Quote in the paperNot a substantial claim

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Findingnone given

    Participants using Healthy Paths (Web) did not receive email notifications/reminders to log back into the website.

    “Participants using Healthy Paths (Web) did not receive email notifications/reminders to log back into the website.”
    Quote in the paperNot a substantial claim

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Findingnone given

    The tools provided by Healthy Paths are drawn from mindfulness-based approaches and cognitive behavioural therapy.

    “The tools provided by Healthy Paths are drawn from mindfulness-based approaches and cognitive behavioural therapy (see Table 1).”
    Quote in the paperNot a substantial claim

  • May combine two claims.

    Findingnone given

    Three design changes were introduced in the app version of the intervention: simplifying the navigation and introducing a tool unlocking feature, simplifying and reducing the content to enable faster access to the core tools, and use of push notifications to suggest specific tools.

    “Three design changes were introduced in the app version of the intervention: 1) simplifying the navigation of the app and introducing a tool unlocking feature (see Section 2.3.1), 2) simplifying and reducing the content of the app to enable faster access to the core tools (see Section 2.3.2), and 3) use of push notifications to suggest specific tools (see Section 2.3.3).”
    Quote in the paperSubstantial claim

  • May combine two claims.

    Findingown data

    Each tool on the website was accessed by 20 to 40% of web users, with the greatest proportion accessing the walking with awareness tool.

    “In contrast, each tool on the website was accessed by 20 to 40% of web users, with the greatest proportion of users accessing the walking with awareness tool.”
    Quote in the paperNot a substantial claim

  • May combine two claims.

    Findingown data

    The designated starter tools on the app were each accessed by 70 to 80% of app users, compared to non-starter tools accessed by less than 30% of app users.

    “The designated starter tools on the app (3 min breathing space, walking with awareness, self-kindness, and connect with others) were each accessed by 70 to 80% of app users compared to the non-starter tools, each accessed by <30% of app users (see Table 4).”
    Quote in the paperSubstantial claim

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Findingnone given

    All tools within the website were available from the outset.

    “All tools within the website were available from the outset.”
    Quote in the paperNot a substantial claim

  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Findingnone given

    The length and volume of textual content was substantially reduced in the app; the introduction was reduced from 18 screens in the web version to one optional screen in the app version.

    “The length and volume of textual content was substantially reduced in the app. Specifically, the introduction to the intervention was reduced from 18 screens in the web version to one optional screen in the app version.”
    Quote in the paperNot a substantial claim

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Study design and conductnone given

    Participants using the app were randomised to one of three different versions that delivered notifications at different times with varying frequencies.

    “Participants using the app were therefore randomised to one of three different versions that delivered notifications at different times with varying frequencies (adaptively based on sensed data, daily between 17.00 and 20.00 and twice weekly between 17.00 and 20.00).”
    Quote in the paperNot a substantial claim

  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Study design and conductown data

    Usage data were positively skewed and compared using non-parametric tests.

    “Usage data were positively skewed and compared using non-parametric tests.”
    Quote in the paperNot a substantial claim

  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Premisecitation

    Email delivery was associated with lower rates of drop out and higher self-reported engagement with tailored physical activity messages compared to SMS delivery.

    “Their analysis demonstrated that email delivery was associated with lower rates of drop out and higher self-reported engagement with the tailored physical activity messages (e.g. number of messages received and read).”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Quinonez et al., 2016

      Not checked in the free run.

  • Classified as probably not a substantial claim.

    Study design and conductnone given

    The automated study procedures were designed to support comparison of usage between the web and app versions of the intervention in a real-world context.

    “The automated study procedures were designed to support comparison of usage between the web and app versions of the intervention in a real-world context.”
    Quote in the paperSubstantial claim

  • Classified as probably not a substantial claim.

    Study design and conductnone given

    Only participants who completed the registration procedure and baseline questionnaire are included in the presented analysis.

    “Only participants who completed the registration procedure and baseline questionnaire are included in the presented analysis.”
    Quote in the paperSubstantial claim

  • Classified as probably not a substantial claim.

    Study design and conductreasoning

    Comparing usage for the two week period following initial registration ensured that comparisons were made across the same period of usage and were not biased by participants having used the website or app for varying periods of time based on their initial registration date.

    “This ensured that comparisons were made across the same period of usage and were not biased by participants having used the website or app for varying periods of time based on their initial registration date.”
    Quote in the paperSubstantial claim

  • Probably not a substantial claim: may not pass S2 (checkable).

    Premisecitation

    The relationship between usage and health-related outcomes is complex.

    “The relationship between usage and health-related outcomes is complex.”
    Quote in the paperNot a substantial claim0 of 2 sources checked
    • cites Van Gemert-Pijnen et al., 2014 source

      Not checked in the free run.

    • cites Saul et al., 2016 source

      Not checked in the free run.

  • May combine two claims.

    Interpretationreasoning

    The usage patterns observed in this study appear to fit with the Perski et al. model; enabling easier and quicker access to core intervention content, the introduction of a game-based element, and/or prompting tool use through notifications may have encouraged app users to access more content in a shorter time.

    “The usage patterns observed in this study appear to fit with this model; enabling easier and quicker access to the core intervention content (i.e. tools), the introduction of a game-based element (tool unlocking) and/or prompting tool use through notifications may have encouraged app users to access more content in a shorter time.”
    Quote in the paperSubstantial claim

  • Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing).

    Premisecitation

    This study adds to a growing literature emphasising the benefits of moving beyond summative usage metrics.

    “This study adds to a growing literature emphasising the benefits of moving beyond summative usage metrics (Arden-Close et al., 2015; Morrison and Doherty, 2014).”
    Quote in the paperNot a substantial claim0 of 2 sources checked
    • cites Arden-Close et al., 2015 source

      Not checked in the free run.

    • cites Morrison and Doherty, 2014

      Not checked in the free run.

  • May combine two claims.

    Interpretationown data

    App users chose to access a higher number of tools from a narrower range whereas web users chose to access a fewer number of tools from a wider range.

    “App users chose to access a higher number of tools from a narrower range (e.g. designated starter tools) whereas web users chose to access a fewer number of tools from a wider range.”
    Quote in the paperSubstantial claim

  • Classified as probably not a substantial claim.

    Premisecitation

    A cumulative science around digital intervention usage is constrained by the lack of comparability across different studies.

    “A cumulative science around digital intervention usage is also constrained by the lack of comparability across different studies (Nelson et al., 2016).”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites Nelson et al., 2016

      Not checked in the free run.

  • May combine two claims.

    Interpretationcitation

    The observed usage pattern (web users logging in fewer times for longer periods; app users logging in more frequently for shorter periods) fits with prior qualitative and mixed-methods work suggesting that apps may be used more sporadically.

    “This usage pattern fits with insights from prior qualitative and mixed-methods work suggesting that apps may be used more sporadically (Dennison et al., 2013; Morrison et al., 2014).”
    Quote in the paperNot a substantial claim0 of 2 sources checked
    • cites Dennison et al., 2013 source

      Not checked in the free run.

    • cites Morrison et al., 2014

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

    Interpretationnone given

    The volume and delivery of content provided by the app was adapted in specific ways to better accommodate how individuals were perceived to routinely engage with their mobile phones on a day-to-day basis.

    “However, the volume and delivery of content provided by the app was adapted in specific ways to better accommodate how individuals were perceived to routinely engage with their mobile phones on a day-to-day basis.”
    Quote in the paperNot a substantial claim

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    Greater exposure to intervention content can be associated with intended intervention outcomes.

    “Although there is evidence that greater exposure to intervention content can be associated with intended intervention outcomes (e.g. Van Gemert-Pijnen et al., 2014)”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Van Gemert-Pijnen et al., 2014 source

      Not checked in the free run.

  • May combine two claims.

    Study design and conductreasoning

    This study employed two different approaches to analysing intervention usage that each provided useful and complementary data.

    “This study employed two different approaches to analysing intervention usage that each provided useful and complementary data.”
    Quote in the paperSubstantial claim

  • Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing).

    Premisecitation

    There is growing consensus that we need to identify and promote an effective level of engagement with digital interventions.

    “There is now growing consensus that we need to identify and promote an effective level of engagement with digital interventions (Yardley et al., 2016).”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Yardley et al., 2016 source

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S2 (checkable).

    Interpretationreasoning

    Combining broad summative usage metrics with more detailed individual-level data on how specific parts of the intervention are used over time can provide a more informed interpretation of intervention usage and engagement.

    “Combining broad summative usage metrics (e.g. total time spent on the intervention, number of log-ins) with more detailed individual-level data on how specific parts of the intervention are used over time can provide a more informed interpretation of intervention usage and engagement.”
    Quote in the paperNot a substantial claim

  • Probably not a substantial claim: may not pass S2 (checkable).

    Interpretationreasoning

    What constitutes effective engagement may vary for different user groups, behaviours or intervention settings.

    “What constitutes “effective engagement” may vary for different user groups, behaviours or intervention settings.”
    Quote in the paperNot a substantial claim

  • May combine two claims.

    Study design and conductnone given

    The website and app were not directly comparable and a number of design modifications were introduced.

    “Additionally, the website and app were not directly comparable and a number of design modifications were introduced.”
    Quote in the paperSubstantial claim

  • Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing). May combine two claims.

    Study design and conductreasoning

    The analyses were exploratory and illustrate one possible approach to interpreting the data.

    “The analyses were exploratory and illustrate one possible approach to interpreting the data.”
    Quote in the paperNot a substantial claim
43 of 43

  • The paper relies on this without support.

    Mobile screen space is more limited than on PCs.

    “Mobile screen space is also more limited than on PCs.”

  • The authors state this as an assumption.

    The analyses presented in this paper assume that more or greater usage is optimal.

    “There is an underlying assumption in many usage analyses, including the analyses presented in this paper, that more or greater usage is optimal.”

  • The paper relies on this without support.

    The web-based and app-based interventions shared the same underlying theoretical components.

    “Usage of a web-based stress management intervention differed from usage of an app-based intervention that shared the same underlying theoretical components.”
3 of 3

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Statistics recomputed

Every reported test result, recomputed from its test statistic and degrees of freedom. A result shows as not adding up only once an independent check has confirmed it.

  • Consistentt(507) = -7.74reported p < .001 · recomputed p < .001

    “t(507) = −7.74, p < .001”

1 of 1

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

Each contradiction between two passages listed here was confirmed by an independent check.

  • Website tool-access range contradicts Table 4

    Minor

    The text says every website tool was accessed by 20% to 40% of web users, but Table 4 reports that 62.01% accessed walking with awareness.

1 of 1

Cites

Flagged first, then by citations

1 of the 23 references couldn’t be matched to a known paper.

Cited by

Sorted by citations

Related

Authors
Morrison, L. G., Geraghty, A. W. A., Lloyd, S., Goodman, N., Michaelides, D. T., Hargood, C., Weal, M., & Yardley, L.
Affiliations
  • University of Southampton (GB)
  • Durham University (GB)
  • Gateshead Council (GB)
  • University of Oxford (GB)
Corresponding author
Geraghty, Adam W.A.
ORCID
Venue
Internet Interventions
Publisher
Elsevier BV
Published
2018-06
Volume
12
Pages
74-82
ISSN
2214-7829 (ISSN-L)
DOI
10.1016/j.invent.2018.03.006
PMC
PMC6096327
OpenAlex
W2801423675
Semantic Scholar
a1ee3150d96d89719983865d3a66e15171c4610c
Cited by
57
References
23
Citations by year
2026: 7 · 2025: 8 · 2024: 4 · 2023: 7 · 2022: 8 · 2021: 6 · 2020: 3 · 2019: 9 · 2018: 5
FWCI
7.19
Type
journal article
Language
en
Open access
Licence
Locations
  • Internet Interventions (publishedVersion, cc-by)
  • Europe PMC (PubMed Central) (publishedVersion, cc-by)
  • PubMed Central (publishedVersion, cc-by)
  • PubMed (publishedVersion)
  • Explore Bristol Research (publishedVersion, cc-by)
  • Bournemouth University Research Online (Bournemouth University) (acceptedVersion)
  • Durham Research Online (Durham University) (acceptedVersion, other-oa)
  • ePrints Soton (University of Southampton) (acceptedVersion)
  • DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
  • Durham Research Online (Durham University) (submittedVersion, cc-by)
  • Bristol Research (University of Bristol) (submittedVersion, cc-by)
Funders
Economic and Physical Sciences Research Council (EP/I032673/1)
Topics
  • Social Sciences › Psychology › Applied Psychology › Digital Mental Health Interventions
  • Health Sciences › Health Professions › General Health Professions › Mobile Health and mHealth Applications
  • Social Sciences › Psychology › Clinical Psychology › Mindfulness and Compassion Interventions
Keywords
digital health interventions, stress management, mobile application, online intervention, user engagement, healthy mind, navigation design, login frequency

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Claims read by deepseek-v4.1-flash under definition version 3 (extract-v3) on 2026-10-10.

Classified by jev-1.13-20260917 (gold-guideline-v0.2) on 2026-10-10.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review