CoChat
Sign Up
Cited by 32Mobile Health and mHealth ApplicationsDigital Mental Health InterventionsData Visualization and Analytics

A Visualization Tool to Analyse Usage of Web-Based Interventions: The Example of Positive Online Weight Reduction (POWeR)

Open access
Arden-Close, Emily Julia, Smith, Emily, Bradbury, Katherine, Morrison, Leanne, Dennison, Laura, Michaelides, Danius, Yardley, Lucy·2015·JMIR Human Factors
DOI 10.2196/humanfactors.4310PMC PMC4797665
Open this paper in CoChat — free accountOpen PDF

Abstract

BACKGROUND: Attrition is a significant problem in Web-based interventions. Consequently, this research aims to identify the relation between Web usage and benefit from such interventions. A visualization tool has been developed that enables researchers to more easily examine large datasets on intervention usage that can be difficult to make sense of using traditional descriptive or statistical techniques alone. OBJECTIVE: This paper demonstrates how the visualization tool was used to explore patterns in participants' use of a Web-based weight management intervention, termed "positive online weight reduction (POWeR)." We also demonstrate how the visualization tool can be used to perform subsequent statistical analyses of the association between usage patterns, participant characteristics, and intervention outcome. METHODS: The visualization tool was used to analyze data from 132 participants who had accessed at least one session of the POWeR intervention. RESULTS: There was a drop in usage of optional sessions after participants had accessed the initial, core POWeR sessions, but many users nevertheless continued to complete goal and weight reviews. The POWeR tools relating to the food diary and steps diary were reused most often. Differences in participant characteristics and usage of other intervention components were identified between participants who did and did not choose to access optional POWeR sessions (in addition to the initial core sessions) or reuse the food and steps diaries. Reuse of the steps diary and the getting support tools was associated with greater weight loss. CONCLUSIONS: The visualization tool provided a quick and efficient method for exploring patterns of Web usage, which enabled further analyses of whether different usage patterns were associated with participant characteristics or differences in intervention outcome. Further usage of visualization techniques is recommended to (1) make sense of large datasets more quickly and efficiently; (2) determine the likely active ingredients in Web-based interventions, and thereby enhance the benefit they may provide; and (3) guide in designing (or redesigning) of future interventions to promote greater use and engagement by enabling users to easily access valued intervention content/tools. TRIAL REGISTRATION: International Standard Randomized Controlled Trial Number (ISRCTN): 31685626; http://www.isrctn.com/ISRCTN31685626 (Archived by WebCite at http://www.webcitation.org/6YXYIw9vc).

AI snapshot

Written from the paper’s full text.

TL;DR

This paper describes a visualization tool for exploring usage log data from Web-based interventions and applies it to the POWeR Web-based weight management feasibility trial. It shows patterns of core/optional session use, participant characteristics associated with reuse of specific tools, and some associations between tool reuse and weight loss.

Key findings

  • Among 132 participants who viewed at least one session page, core sessions were widely used: eating plan part 1, 132 (100%); part 2, 120 (90.9%); support, 104 (78.7%); physical activity, 90 (68.1%). Optional sessions were each accessed by less than 1 in 4 participants, except the compulsory final review, 36 (27.2%). A total of 30/132 (23%) used all core sessions but no optional sessions; later sessions 7-11 were viewed by 48/132 (36%); mean goal and weight reviews were 8.62 (SD 10.46; range 0-43).
  • After core sessions, 62/132 (47%) accessed both goal/weight reviews and optional sessions, 58/132 (44%) continued reviews but not optional sessions, and 4/132 (3%) used neither. Participants who did not use optional sessions had higher baseline BMI (36.68 vs 34.60), were more likely to use the low-carbohydrate plan (χ²=8.71, P=.03) and walking plan (χ²=2.08, P<.001), but did not differ in weight loss (3.67 kg vs 2.14 kg; P=.13).
  • Reused tools were most often eating plan tools, 91 (68.9%); support tools, 68 (51.5%); and physical activity plan tools, 21 (15.9%). The weekly food diary was reused by 76/132 (57.5%), low-calorie information by 71/132 (53.7%), and low-carbohydrate information by 57/132 (43.1%). Food diary reusers were older (53.62 vs 48.95; P=.04) and completed more goal/weight reviews (8.89 vs 3.23; P<.001), with no weight-loss difference (P=.87).
  • Steps diary reusers (n=17) lost more weight than non-reusers, 5.78 kg (SD 6.87) vs 2.63 kg (SD 5.56; P=.04). Getting support tool reusers (68/104, 65%) completed more sessions (3.39 vs 0.5; P<.001) and lost more weight, 4.03 kg (SD 6.93) vs 1.53 kg (SD 4.04; P=.038); the paper also reports a goal/weight review comparison with values listed as 0 vs 8.81 (P<.001), despite describing users as completing more reviews.

Methods

  • Secondary analysis of a randomized nonblinded feasibility trial of POWeR in primary care. Participants were recruited May 2011-December 2012 from five general practices in southern England; inclusion included age over 18 and BMI ≥30, or ≥28 with hypertension, hypercholesterolemia, or diabetes. Of 195 consented participants, 132 who viewed at least one session page were included in the usage analysis.
  • POWeR consisted of 12 weekly online sessions: sessions 1-3 were core, followed by optional weekly sessions and a final review. LifeGuide captured pages accessed and viewing time. The visualization tool was built in R with a Shiny Web interface and produced normal, frequency, clustered, and group plots; it could filter by variables or page groups and export user IDs for follow-up.
  • Usage patterns were explored visually, then moderator analyses were conducted in SPSS comparing optional session use, food diary reuse, steps diary reuse, and getting support tool reuse with participant characteristics and weight change.

Limitations

  • The paper states that results come from a single feasibility study and may not generalize widely; the sample included fewer men and very few ethnic minorities, though it was not young or highly educated and was considered broadly representative of primary care patients eligible for such an intervention.
  • The paper states that exploratory analyses need confirmation, that the steps diary-weight loss finding was based on a small number of users and should be interpreted cautiously, and that intervention groups were treated as a single population even though nurse support may have influenced Web usage; small sample size prevented testing this.
  • Evident from the text: the usage-outcome findings are correlational and cannot establish causality, and the getting support review-count values appear internally inconsistent as reported (0 vs 8.81 while described as users completing more reviews).

Model-written summary. Check it against the paper before relying on it.

Integrity signals

Registry

Crossref · 10.2196/humanfactors.4310

Cites

Statistics

Nothing to recompute.

Claims the paper makes

0 of 29 cited sources checked · 0 supported · 0 flagged

  • Findingown data

    Participants who reused the weekly food diary completed more goal and weight review sessions than those who did not (8.89 vs 3.23; t125.34=−3.64, P<.001).

    “and completed more goal and weight review sessions than those who did not reuse the diary, 8.89 versus 3.23 (t 125.34=−3.64, P<.001).”
    Quote in the paperNot a substantial claim
  • Findingown data

    120/132 (91%) used part 2 of session 1.

    “120/132 (91%) used part 2 of session 1”
    Quote in the paperNot a substantial claim
    • Rests on an assumption: LifeGuide automatically captures data regarding all Web pages accessed and length of time spent viewing each Web page.
  • Findingown data

    Each optional session except the final review session was accessed by less than 1 in 4 participants.

    “However, each optional session (except the final review session, which was made compulsory) was accessed by less than 1 in 4 of the participants.”
    Quote in the paperNot a substantial claim
    • Rests on an assumption: LifeGuide automatically captures data regarding all Web pages accessed and length of time spent viewing each Web page.
  • Findingown data

    115/132 (87%) completed session 1.

    “115/132 (87%) completed session 1 (reached the last page).”
    Quote in the paperNot a substantial claim
    • Rests on an assumption: LifeGuide automatically captures data regarding all Web pages accessed and length of time spent viewing each Web page.
  • Findingown data

    The POWeR tools relating to the food diary and steps diary were reused most often.

    “The POWeR tools relating to the food diary and steps diary were reused most often.”
    Quote in the paperNot a substantial claim
    • Rests on an assumption: LifeGuide automatically captures data regarding all Web pages accessed and length of time spent viewing each Web page.
  • May combine two claims. 31
  • Classified as probably not a substantial claim. 16

  • May combine two claims.

    Findingown data

    The core eating plan session was the most widely used, followed by the core sessions on support and physical activity.

    “It can be seen from Figure 2 that the core eating plan session (part 1, light green; and part 2, pink) was the most widely used, followed by the core sessions on “support” (session 2, dark gray) and “physical activity” (session 3, brown).”
    Quote in the paperNot a substantial claim
    • Rests on an assumption: LifeGuide automatically captures data regarding all Web pages accessed and length of time spent viewing each Web page.

  • May combine two claims.

    Findingown data

    The most frequently viewed pages were part 1 of the eating plan session and the goal and weight review, whereas optional sessions and optional tools pages were not widely used.

    “It also shows that the most frequently viewed pages were those relating to part 1 of the eating plan session and the goal and weight review, whereas the optional sessions and optional tools pages were not widely used.”
    Quote in the paperNot a substantial claim
    • Rests on an assumption: LifeGuide automatically captures data regarding all Web pages accessed and length of time spent viewing each Web page.

  • May combine two claims.

    Findingown data

    There was a drop in usage of optional sessions after participants had accessed the initial core POWeR sessions, but many users nevertheless continued to complete goal and weight reviews.

    “There was a drop in usage of optional sessions after participants had accessed the initial, core POWeR sessions, but many users nevertheless continued to complete goal and weight reviews.”
    Quote in the paperNot a substantial claim
    • Rests on an assumption: LifeGuide automatically captures data regarding all Web pages accessed and length of time spent viewing each Web page.

  • May combine two claims.

    Findingown data

    Overall, 106 participants reused the eating plan tools, of whom 76 reused the weekly food diary.

    “Overall, 106 participants reused the eating plan tools, of whom 76 reused the weekly food diary.”
    Quote in the paperNot a substantial claim

  • May combine two claims.

    Findingown data

    The motivational 'reasons to lose weight' and 'sending motivational emails' support tools were not reused.

    “less essential tools such as the motivational “reasons to lose weight” or “sending motivational emails” support tools were not reused.”
    Quote in the paperNot a substantial claim

  • May combine two claims.

    Findingown data

    The vast majority of participants who went online accessed the first session, but there was a drop of approximately 20% of participants from the first session (n=132 in part 1 and n=120 in part 2) to the second session (n=104).

    “A first key observation is that the vast majority of participants who went online accessed the first session, but there was a drop of approximately 20% of participants from the first session (n=132 in part 1 and n=120 in part 2) to the second session (n=104).”
    Quote in the paperSubstantial claim

  • May combine two claims.

    Findingown data

    The visualization showed that although some participants reused the 'getting support' tools all in one go after accessing the session on 'getting support,' it was more common to follow each brief usage of the 'getting support' session with reuse of the 'getting support' tools.

    “This visualization shows that although some participants reused the “getting support” tools all in one go after accessing the session on “getting support,” it was more common to follow each brief usage of the “getting support” session with reuse of the “getting support” tools.”
    Quote in the paperNot a substantial claim

  • May combine two claims.

    Findingown data

    Sixty-two participants used both the goal and weight reviews and the optional sessions, while 58 accessed the goal and weight reviews but not the optional sessions.

    “Sixty-two participants used both the goal and weight reviews and the optional sessions, but 58 accessed the goal and weight reviews but not the optional sessions.”
    Quote in the paperNot a substantial claim

  • May combine two claims.

    Findingown data

    The steps diary was the most widely reused physical activity tool and was associated with greater weight loss.

    “of the physical activity tools, the steps diary was the most widely reused, and was associated with greater weight loss.”
    Quote in the paperSubstantial claim

  • May combine two claims.

    Findingown data

    The eating plan tools were the most reused, especially the weekly food diary, information about the low-calorie eating plan, and information about the low-carbohydrate eating plan.

    “The eating plan tools were the most reused, especially the weekly food diary, and information about the low-calorie eating plan and the low-carbohydrate eating plan.”
    Quote in the paperSubstantial claim

  • May combine two claims.

    Findingown data

    Figure 7 shows that the most widely reused physical activity tools pages were the steps diary and the pages on getting more active, but some other tools were used only by one person.

    “Figure 7 shows that the most widely reused physical activity tools pages were the steps diary (orange) and the pages on getting more active (light green), but that some of the other tools were used only by one person.”
    Quote in the paperNot a substantial claim

  • May combine two claims.

    Findingown data

    Only half the participants accessed any of the optional sessions, and each optional session was viewed by less than 25% of participants.

    “A second key observation is that only half the participants accessed any of the optional sessions, and each optional session was viewed by less than 25% of participants.”
    Quote in the paperSubstantial claim

  • May combine two claims.

    Premisecitation

    POWeR was tested in a feasibility trial with 4 groups: Web only, Web plus basic nurse support, Web plus regular nurse support, and usual care, to assess weight loss maintenance at 12-month follow-up.

    “It was tested in a feasibility trial that consisted of 4 groups, namely: Web only, Web plus basic nurse support, Web plus regular nurse support, and usual care, to assess the extent to which weight loss was maintained at 12-month follow-up.”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites [11] source

      Not checked in the free run.

  • May combine two claims.

    Premisecitation

    In the POWeR feasibility trial, participants completed a mean of nine goal and weight reviews, ranging from none to 43 during the 12-month trial.

    “Although participants completed a mean of nine goal and weight reviews, this ranged from none to 43 completed during the 12-month trial.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [11] source

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S4 (based).

    Interpretationreasoning

    The visualization tool makes analysis quicker and easier compared with standard data analysis.

    “This makes analysis quicker and easier compared with standard data analysis.”
    Quote in the paperNot a substantial claim

  • Probably not a substantial claim: may not pass S4 (based). May combine two claims.

    Premisenone given

    Existing visualization tools provide a useful means to explore each individual participant's usage of an intervention, or particular aspects of all participants' usage of an intervention.

    “Existing visualization tools provide a useful means to explore each individual participant’s usage of an intervention, or particular aspects of all participants’ usage of an intervention (such as days/dates of logins, start and end points of each login).”
    Quote in the paperNot a substantial claim

  • May combine two claims.

    Interpretationreasoning

    The visualization tool provided a quick and efficient method for exploring patterns of Web usage, which enabled further analyses of whether different usage patterns were associated with participant characteristics or differences in intervention outcome.

    “The visualization tool provided a quick and efficient method for exploring patterns of Web usage, which enabled further analyses of whether different usage patterns were associated with participant characteristics or differences in intervention outcome.”
    Quote in the paperSubstantial claim

  • May combine two claims.

    Study design and conductcitation

    The trial was a randomized nonblinded feasibility trial comparing 4 parallel groups: usual care, website only, website with basic nurse support, and website with regular nurse support.

    “As reported elsewhere [11], a randomized nonblinded feasibility trial of a Web-based weight management intervention (POWeR) for obese patients in primary care was used to compare 4 parallel groups: usual care, website only, website with basic nurse support, and website with regular nurse support.”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites [11] source

      Not checked in the free run.

  • Classified as probably not a substantial claim.

    Premisecitation

    POWeR was developed as a Web-based weight management intervention for use in primary care that aimed to result in sustainable weight loss.

    “Positive Online Weight Reduction [11] was developed as a Web-based weight management intervention for use in primary care that aimed to result in sustainable weight loss.”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites [11] source

      Not checked in the free run.

  • May combine two claims.

    Premisecitation

    Freely available visualization tools are useful for detecting usability or content issues, enabling researchers to edit content for future Web-based interventions.

    “detecting usability or content issues, and thereby enable researchers to edit content for use in future Web-based interventions”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites [15] source

      Not checked in the free run.

  • Classified as probably not a substantial claim.

    Premisecitation

    Freely available visualization tools are useful for performing exploratory analysis to support the design of statistical queries about whether use of particular pages is related to benefit.

    “performing exploratory analysis to support the design of statistical queries to summarize data regarding whether use of particular pages is related to benefit [15].”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites [15] source

      Not checked in the free run.

  • Classified as probably not a substantial claim. May combine two claims.

    Premisecitation

    Higher use of website features may be associated with weight loss, but it is not clear which features improve this effect or reduce attrition.

    “Although higher use of website features may be associated with weight loss, it is not clear which features improve this effect or reduce attrition [5].”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites [5] source

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Study design and conductnone given

    The trial was approved by the UK National Health Service National Research Ethics Service and registered with Current Controlled Trials (ISRCTN 31685626).

    “The trial was approved by the UK National Health Service National Research Ethics Service, and was registered with Current Controlled Trials (ISRCTN 31685626).”
    Quote in the paperNot a substantial claim

  • Classified as probably not a substantial claim.

    Study design and conductown data

    Data from 132 participants who had viewed at least one page of a session were included in the Web usage analysis.

    “To analyze Web usage, data from the 132 participants who had viewed at least one page of a session, which comprised the groups “Web only,” “Web + basic nurse support,” and “Web + regular nurse support” were included.”
    Quote in the paperSubstantial claim
    • Rests on an assumption: LifeGuide automatically captures data regarding all Web pages accessed and length of time spent viewing each Web page.

  • Classified as probably not a substantial claim.

    Interpretationreasoning

    Usage sequences for each individual are stacked within one visualization plot to facilitate comparison across all participants.

    “Usage sequences for each individual are stacked within one visualization plot to facilitate comparison across all participants.”
    Quote in the paperSubstantial claim

  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Premisecitation

    Web-based weight management interventions lead to meaningful weight loss, particularly relative to no-intervention control groups or minimal interventions.

    “There is evidence that such interventions lead to meaningful weight loss [1], particularly relative to no-intervention control groups or minimal interventions [2].”
    Quote in the paperNot a substantial claim0 of 2 sources checked
    • cites [1] source

      Not checked in the free run.

    • cites [2] source

      Not checked in the free run.

  • May combine two claims.

    Premiseown data

    In the POWeR feasibility trial, average website usage, defined as duration of page viewing, was similar across intervention arms but extremely variable within groups.

    “Analysis revealed that average website usage, defined as duration of page viewing, was similar across the intervention arms, but extremely variable within groups.”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites [11] source

      Not checked in the free run.

  • May combine two claims.

    Interpretationreasoning

    Using visual analysis allows differences in usage to emerge from the data and ensures that unanticipated relationships between usage and outcomes are not overlooked.

    “Using visual analysis allows differences in usage to emerge from the data and ensures that unanticipated relationships between usage and outcomes are not overlooked.”
    Quote in the paperSubstantial claim

  • Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing).

    Premisenone given

    The toolkits developed by van Gemert-Pijnen and colleagues [12] may be particularly beneficial for usage analyses following a priori assumptions about key intervention components.

    “By contrast, the toolkits developed by van Gemert-Pijnen and colleagues [12] may be particularly beneficial for usage analyses following a priori assumptions about key intervention components.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [12] source

      Not checked in the free run.

  • May combine two claims.

    Study design and conductown data

    The results regarding use of the steps diary and weight loss were based on a small number of users of the steps diary, and should therefore be interpreted with caution.

    “Third, the results regarding use of the steps diary and weight loss were based on a small number of users of the steps diary, and should therefore be interpreted with caution.”
    Quote in the paperNot a substantial claim

  • May combine two claims.

    Study design and conductnone given

    The sample participating in POWeR included fewer men and very few members of ethnic minorities.

    “In particular, the sample participating in POWeR included fewer men and very few members of ethnic minorities.”
    Quote in the paperNot a substantial claim

  • Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing).

    Interpretationreasoning

    The visualization tool presented here may be particularly useful for inductive analyses of tunneled interventions.

    “The visualization tool presented here may be particularly useful for inductive analyses of tunneled interventions.”
    Quote in the paperNot a substantial claim

  • May combine two claims.

    Study design and conductown data

    The intervention groups from POWeR were considered as a single population, and it was not possible to determine whether nurse support influenced Web usage due to the small sample size.

    “Fourth, we considered the intervention groups from POWeR as a single population. It is possible that nurse support may have influenced Web usage. We were not able to determine this due to the small sample size.”
    Quote in the paperNot a substantial claim

  • May combine two claims.

    Study design and conductown data

    The results described here are based on a single feasibility study, and it is unclear how widely they would apply to a wider population.

    “First, the results described here are based on a single feasibility study, and it is unclear how widely they would apply to a wider population.”
    Quote in the paperSubstantial claim

  • Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing).

    Interpretationreasoning

    Different visualization tools are likely to be more or less useful depending on the intervention architecture and research questions of interest.

    “Different visualization tools are likely to be more or less useful depending on the intervention architecture and research questions of interest.”
    Quote in the paperNot a substantial claim

  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Premisecitation

    POWeR specifically encourages users to employ food diaries only occasionally, as diagnostic tools when necessary, and not to rely on them for long-term weight management.

    “POWeR specifically encourages users to employ food diaries only occasionally, as diagnostic tools when necessary, and not to rely on them for long-term weight management[18].”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [18] source

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisenone given

    The toolkit developed by Morrison and Doherty [15] may be particularly beneficial for individual-level analyses or group-level analyses of nontunneled interventions that do not have a clear start and end point.

    “The toolkit developed by Morrison and Doherty[15] may be particularly beneficial for individual-level analyses or group-level analyses of nontunneled interventions that do not have a clear start and end point.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [15] source

      Not checked in the free run.

  • May combine two claims.

    Interpretationcitation

    The sample was not young or highly educated, and could be considered broadly representative of the population eligible to enroll in such an intervention in primary care.

    “However, the sample was not young or highly educated, and as such could be considered broadly representative of the population eligible to enroll in such an intervention in primary care [11].”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [11] source

      Not checked in the free run.

  • May combine two claims.

    Interpretationown data

    There were no differences in weight loss between participants who did and did not use the optional sessions, indicating that the optional content was not necessary for weight loss.

    “In support of this interpretation, there were no differences in weight loss between participants who did and did not use the optional sessions, indicating that the optional content was indeed not necessary for weight loss.”
    Quote in the paperSubstantial claim

  • May combine two claims.

    Interpretationreasoning

    It is not clear whether it was specifically the steps diary that was useful, or whether the walking plan was more beneficial than the mixed physical activity plan.

    “From these results it is therefore not clear whether it was specifically the steps diary that was useful, or whether the walking plan was more beneficial than the mixed physical activity plan.”
    Quote in the paperSubstantial claim

  • Probably not a substantial claim: may not pass S2 (checkable).

    Interpretationreasoning

    Visualization toolkits can be used as part of a mixed-methods approach for developing and evaluating digital interventions to arrive at a more complete picture of differences in participant use.

    “Visualization toolkits can be used as part of a mixed-methods approach for developing and evaluating digital interventions that seek to arrive at a more complete picture of the differences in the way in which participants use an intervention”
    Quote in the paperNot a substantial claim

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    Self-monitoring and diary usage on weight loss is mediated by autonomous motivation in previous studies.

    “this has mediated the effect of self-monitoring and diary usage on weight loss in previous studies [21].”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [21] source

      Not checked in the free run.

42 of 42

  • The paper relies on this without support.

    No study has assessed in detail whether certain Web pages are more frequently used than others, or whether certain groups of people are more likely to use particular pages.

    “However, no study has assessed in detail whether certain Web pages are more frequently used than others, or whether certain groups of people are more likely to use particular pages.”

  • The paper relies on this without support.

    Existing visualization tools do not allow for a detailed comparison of how all components of an intervention have been used by all participants within one sequence plot.

    “However, to our knowledge, these tools do not allow for a detailed comparison of how all components of an intervention have been used by all participants within one sequence plot.”

  • The paper relies on this without support.

    LifeGuide automatically captures data regarding all Web pages accessed and length of time spent viewing each Web page.

    “This software automatically captures data regarding all Web pages accessed, and length of time spent viewing each Web page.”
3 of 3

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

Each contradiction between two passages listed here was confirmed by an independent check.

  • Goal-review averages reverse the claimed group difference

    Major

    The text says getting-support-tool users completed more goal and weight reviews, but gives them 0 versus 8.81 for nonusers, following the group order used in the preceding comparison.

  • Eating-plan tool reuse counts disagree

    Major

    Table 4 lists 91 participants as reusing eating-plan tools, whereas the later results state that 106 did so.

  • The number using optional sessions changes from 62 to 58

    Minor

    The results say 62 participants accessed optional sessions alongside reviews, but later say only 58 participants used optional sessions.

  • Two different counts are given for completing session 1

    Minor

    The results say 115 participants reached the last page of session 1, while the discussion says 120 completed it.

4 of 4

The citation lists haven’t been fetched yet

References 22 · Cited by 32

Authors
Arden-Close, E. J., Smith, E., Bradbury, K., Morrison, L., Dennison, L., Michaelides, D., & Yardley, L.
Affiliations
  • Bournemouth University (GB)
  • University of Southampton (GB)
Corresponding author
Arden-Close, Emily Julia
ORCID
Venue
JMIR Human Factors
Publisher
JMIR Publications Inc.
Published
2015-05-19
Volume
2
Issue
1
Pages
e8
ISSN
2292-9495 (ISSN-L)
DOI
10.2196/humanfactors.4310
PMC
PMC4797665
OpenAlex
W1845999405
Semantic Scholar
c610ad23c5ebc9ea370ef56a046fcbe603b0fede
Cited by
32
References
22
Citations by year
2026: 2 · 2025: 1 · 2024: 1 · 2022: 1 · 2021: 4 · 2020: 5 · 2019: 4 · 2018: 5 · 2017: 5 · 2016: 3 · 2015: 1
FWCI
8.44
Type
journal article
Language
en
Open access
Licence
cc-by
Locations
  • JMIR Human Factors (publishedVersion, cc-by)
  • PubMed Central (publishedVersion, cc-by)
  • PubMed (publishedVersion)
  • ePrints Soton (University of Southampton) (acceptedVersion)
  • Bournemouth University Research Online (Bournemouth University) (submittedVersion)
  • DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
  • Explore Bristol Research (submittedVersion)
  • Bristol Research (University of Bristol) (submittedVersion)
Funders
  • Engineering and Physical Sciences Research Council (EP/I032673/1)
  • Economic and Social Research Council (ES/F029624/1)
Topics
  • Health Sciences › Health Professions › General Health Professions › Mobile Health and mHealth Applications
  • Social Sciences › Psychology › Applied Psychology › Digital Mental Health Interventions
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Data Visualization and Analytics
Keywords
online intervention, visualization tools, attrition, weight management, food diary, user engagement, weight loss, active ingredients

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Claims read by deepseek-v4.1-flash under definition version 3 (extract-v3) on 2026-10-10.

Classified by jev-1.13-20260917 (gold-guideline-v0.2) on 2026-10-10.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review