Cited by 93Mobile Health and mHealth ApplicationsDigital Mental Health InterventionsWorkplace Health and Well-being

Personal Health Technologies in Employee Health Promotion: Usage Activity, Usefulness, and Health-Related Outcomes in a 1-Year Randomized Controlled Trial

Open access
Mattila, Elina, Orsama, Anna-Leena, Ahtinen, Aino, Hopsu, Leila, Leino, Timo, Korhonen, Ilkka·2013·JMIR mhealth and uhealth

Abstract

BACKGROUND: Common risk factors such as obesity, poor nutrition, physical inactivity, stress, and sleep deprivation threaten the wellness and work ability of employees. Personal health technologies may help improve engagement in health promotion programs and maintenance of their effect. OBJECTIVE: This study investigated personal health technologies in supporting employee health promotion targeting multiple behavioral health risks. We studied the relations of usage activity to demographic and physiological characteristics, health-related outcomes (weight, aerobic fitness, blood pressure and cholesterol), and the perceived usefulness of technologies in wellness management. METHODS: We conducted a subgroup analysis of the technology group (114 subjects, 33 males, average age 45 years, average BMI 27.1 kg/m(2)) of a 3-arm randomized controlled trial (N=352). The trial was organized to study the efficacy of a face-to-face group intervention supported by technologies, including Web services, mobile applications, and personal monitoring devices. Technology usage was investigated based on log files and questionnaires. The associations between sustained usage of Web and mobile technologies and demographic and physiological characteristics were analyzed by comparing the baseline data of sustained and non-sustained users. The associations between sustained usage and changes in health-related outcomes were studied by repeated analysis of variance, using data measured by baseline and end questionnaires, and anthropometric and laboratory measurements. The experienced usability, usefulness, motivation, and barriers to using technologies were investigated by 4 questionnaires and 2 interviews. RESULTS: 111 subjects (97.4%) used technologies at some point of the study, and 33 (29.9%) were classified as sustained users of Web or mobile technologies. Simple technologies, weight scales and pedometer, attracted the most users. The sustained users were slightly older 47 years (95% CI 44 to 49) versus 44 years (95% CI 42 to 45), P=.034 and had poorer aerobic fitness at baseline (mean difference in maximal metabolic equivalent 1.0, 95% Cl 0.39 to 1.39; P=.013) than non-sustained users. They succeeded better in weight management: their weight decreased -1.2 kg (95% CI -2.38 to -0.01) versus +0.6 kg (95% CI -0.095 to 1.27), P=.006; body fat percentage -0.9%-units (95% CI -1.64 to -0.09) versus +0.3%-units (95% CI -0.28 to 0.73), P=.014; and waist circumference -1.4 cm (95% CI -2.60 to -0.20) versus +0.7 cm (95% CI -0.21 to 1.66), P=.01. They also participated in intervention meetings more actively: median 4 meetings (interquartile range; IQR 4-5) versus 4 meetings (IQR 3-4), P=.009. The key factors in usefulness were: simplicity, integration into daily life, and clear feedback on progress. CONCLUSIONS: Despite active initial usage, less than 30% of subjects continued using Web or mobile technologies throughout the study. Sustained users achieved better weight-related outcomes than non-sustained users. High non-usage attrition and modest outcomes cast doubt on the potential of technologies to support interventions.

AI snapshot

Written from the paper’s full text.

TL;DR

In a 1-year RCT subgroup of 114 employees using personal health technologies alongside face-to-face health promotion, 97.4% tried a technology but only 28.9% were sustained Web/mobile users. Sustained users showed small weight-related improvements and attended more meetings, but high attrition and modest outcomes limit the technologies’ potential.

Key findings

  • Of 114 technology-group subjects, 111 (97.4%) tried some technology and 106 (93.0%) tried Web or mobile technologies at least once; 33 (28.9%) were classified as sustained users, with median 14 usage weeks (IQR 7–31).
  • Sustained users were older (47 vs 44 years, P=.034) and had poorer baseline aerobic fitness (mean METmax difference 1.0, 95% CI 0.39–1.39; P=.013) than non-sustained users.
  • Sustained users had better weight-related changes than non-sustained users: weight −1.2 kg vs +0.6 kg (P=.006), body fat −0.9%-units vs +0.3%-units (P=.014), and waist circumference −1.4 cm vs +0.7 cm (P=.01); they also attended more intervention meetings (median 4, IQR 4–5 vs median 4, IQR 3–4; P=.009).
  • Simple technologies were most used and valued: at 12 months, 72% of questionnaire respondents reported using weight scales and 39% a pedometer; key usefulness factors were simplicity, integration into daily life, and clear feedback.

Methods

  • Subgroup analysis of the technology group (114 subjects; 33 male; mean age 44.6 years; mean BMI 27.1 kg/m²) from a 3-arm randomized controlled trial (N=352) testing a face-to-face group intervention with or without personal health technologies.
  • The technology toolbox included Web services, mobile applications, and monitoring devices; usage was assessed from log files and questionnaires, with sustained users defined as using any Web or mobile technology in at least 11 of 13 four-week blocks.
  • Baseline comparisons used t tests and chi-square/Fisher exact tests; health-related outcomes (weight, body fat, waist circumference, blood pressure, cholesterol, triglycerides, aerobic fitness) were analyzed with repeated-measures ANOVA, and usefulness was assessed via 4 questionnaires and 2 interview rounds.

Limitations

  • The paper states that randomization gave subjects no choice of intervention modality, volunteer bias limits generalizability (only ~38% of employees responded to screening; only 29% of the technology group self-selected into sustained use), and the sample was unevenly gendered (~30% male), making generalization to male employees unreliable.
  • The paper also states technology-related limitations: technologies were at different maturity stages, the Portal had frequent downtime, systems were not well integrated, there were no reminders, monitoring-device usage was self-reported rather than continuously logged, choice overload may have confused users, and statistical power was modest with multiple tests uncorrected for alpha.
  • Evident from the text: this is a subgroup analysis of the technology arm only, so sustained vs non-sustained comparisons are observational within the intervention group and cannot establish causality; the paper itself notes the health-related changes were not clinically significant.

Model-written summary. Check it against the paper before relying on it.

Integrity signals

Registry

Crossref · 10.2196/mhealth.2557

Cites

43 of 43 references verified0 citation errors · 0 not checkable

Statistics

Nothing to recompute.

Claims the paper makes

0 of 33 cited sources checked · 0 supported · 0 flagged

  • Findingown data

    Sustained users had a body fat percentage change of -0.9%-units (95% CI -1.64 to -0.09) versus +0.3%-units (95% CI -0.28 to 0.73), P=.014.

    “body fat percentage -0.9%-units (95% CI -1.64 to -0.09) versus +0.3%-units (95% CI -0.28 to 0.73), P=.014”
    Quote in the paperSubstantial claim
    • Rests on an assumption: Differences in weight-related outcomes between sustained and non-sustained users are not due to unmeasured confounding.
    • Rests on an assumption: The 13 subjects who did not participate in laboratory measurements at the end of the study are missing at random with respect to the outcomes.
  • Findingown data

    Fewer respondents believed in the usefulness of health-related Web services (46/88, 52%).

    “Fewer believed in the usefulness of health-related Web services (46/88, 52%).”
    Quote in the paperNot a substantial claim
  • Findingown data

    Of all respondents, 68-83% felt that the pedometer motivated them to maintain or improve personal wellness.

    “The same was true for 68–83% of respondents about the pedometer and for 43–59% about the Wellness Diary.”
    Quote in the paperNot a substantial claim
  • Findingown data

    111 subjects (97.4%) used or tried some technology at some point during the study.

    “111 subjects (97.4%) used technologies at some point of the study”
    • Also stated in: § Usage Activity · plain
      “Altogether 111 subjects (97.4%) tried some technology during the study.”
    Quote in the paperNot a substantial claim
  • Findingnone given

    For most technologies, satisfaction decreased slightly over time.

    “For most technologies, satisfaction decreased slightly over time.”
    Quote in the paperNot a substantial claim
  • Classified as probably not a substantial claim. 38
  • May combine two claims. 47
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Findingown data

    Interviewees noted benefits of SelfRelax, which provided relaxation programs for specific situations, such as falling asleep, relaxing after work, or unwinding after a challenging encounter.

    “The interviewees also noted the benefits of SelfRelax, which provided relaxation programs for specific situations, such as falling asleep, relaxing after work, or unwinding after a challenging encounter.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Findingown data

    The benefits of the Wellness Diary were the record it provided of personal progress and development in long-term health data through graphical feedback.

    “The benefits of the Wellness Diary were the record it provided of personal progress and development in long-term health data through graphical feedback.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Findingown data

    Among participants in the technology group, sustained users were slightly older than non-sustained users.

    “The sustained users were slightly older than the non-sustained users (Table 4).”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Findingown data

    There were 7 major themes identified in the interview responses: ease of use, usefulness, motivation, learning, barriers to use, role of technologies in achieving wellness benefits, and usage habits.

    “There were 7 major themes (ie, ease of use, usefulness, motivation, learning, barriers to use, role of technologies in achieving wellness benefits, and usage habits) identified in the interview responses.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Findingown data

    The scales, pedometer, and Wellness Diary were perceived as having useful features by 79-83%, 79-88%, and 45-66% of respondents, respectively.

    “The same technologies were also perceived as having useful features by most respondents: 79–83% for the scales, 79–88% for the pedometer, and 45–66% for Wellness Diary.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Findingown data

    Response rates to the usefulness questionnaires varied between questionnaires and between questions within the questionnaires.

    “Response rates to the usefulness questionnaires varied between questionnaires and also between questions within the questionnaires.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Findingown data

    Among sustained users, aerobic fitness and total cholesterol increased from baseline to end.

    “Weight, body fat, BMI, waist circumference decreased, aerobic fitness, and total cholesterol increased among sustained users (Table 5).”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Findingown data

    The median number of usage weeks among interviewees was 16 in the first interview and 13 in the second interview.

    “The median number of usage weeks among the interviewees was 16 in the first interview and 13 in the second interview.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Findingnone given

    The key factors in usefulness were simplicity, integration into daily life, and clear feedback on progress.

    “The key factors in usefulness were: simplicity, integration into daily life, and clear feedback on progress.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Findingown data

    The weight scales and pedometer were regarded as the best technologies for supporting wellness management in all post-intervention questionnaires, followed by Wellness Diary and heart rate belt.

    “The weight scales and pedometer were regarded as the best technologies for supporting wellness management in all post-intervention questionnaires, followed by Wellness Diary and heart rate belt (Figure 4).”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Findingown data

    Typical barriers to using the technologies included problems with the phone or the Portal being down.

    “Typical barriers to using the technologies included problems with the phone or the Portal being down.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Findingnone given

    The interviewees represented different types of technology users, including non-users, moderately active and sustained users.

    “The interviewees represented different types of technology users, including non-users, moderately active and sustained users.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Findingown data

    The heart rate belt was borrowed at least once by 65 subjects (57.0%).

    “The heart rate belt was borrowed at least once by 65 (57.0%) subjects.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Findingown data

    Of the 114 subjects, 64 (56.1%) responded to the 1-month questionnaire, 60 (52.6%) to the 3-month questionnaire, 85 (74.6%) to the 6-month questionnaire, and 95 (83.3%) to the 12-month questionnaire.

    “Of the 114 subjects, there were 64 (56.1%) who responded to the 1-month questionnaire (range for individual questions 33–64 subjects, 28.9–56.1%), 60 subjects (52.6%) to the 3-month questionnaire (range 49–60 subjects, 43.0–52.6%), 85 subjects (74.6%) to the 6-month questionnaire (range 77–85 subjects, 67.5–74.6%), and 95 subjects (83.3%) to the 12-month questionnaire (range 90–95 subjects, 78.9–8”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Findingown data

    The benefits of the Mobile Coach were seen to be its adaptive exercise programs and coaching.

    “The benefits of the Mobile Coach were seen to be its adaptive exercise programs and coaching.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Findingown data

    67-80% of respondents would recommend the scales, 71-85% the pedometer, and 38-55% the Wellness Diary to others.

    “Most of the respondents reported that they would also recommend these technologies to others: 67–80% would recommend the scales, 71–85% the pedometer, and 38–55% the Wellness Diary.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Findingown data

    Among sustained users, weight, body fat, BMI, and waist circumference decreased from baseline to end.

    “Weight, body fat, BMI, waist circumference decreased, aerobic fitness, and total cholesterol increased among sustained users (Table 5).”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Findingown data

    The main appeal of the weight scales and pedometer were their simplicity, ease of use, and concreteness.

    “The main appeal of the weight scales and pedometer were their simplicity, ease of use, and concreteness.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Findingown data

    9 subjects (7.9%) borrowed the heart rate belt 2 times and 3 subjects (2.6%) borrowed it 3 times.

    “In addition, 9 (7.9%) subjects borrowed it 2 times and 3 (2.6%) subjects 3 times.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Findingown data

    Sustained users lost more weight and body fat and decreased their waist circumference more than non-sustained users.

    “Sustained users lost more weight and body fat and decreased their waist circumference more than non-sustained users.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Findingown data

    Interviewees reported taking breaks, and a typical time to take a break was summer holidays.

    “The interviewees also reported taking breaks, and recommended that the technologies could better support such intermittent usage. A typical time to take a break was summer holidays.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Findingown data

    The technologies were not well integrated; similar information had to be entered to several applications.

    “In addition, the technologies were not well integrated. Similar information had to be entered to several applications, for example, whenever someone wanted to use both the Wellness Diary and Mobile Coach for tracking exercises.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Findingown data

    Some respondents continued to use the technologies after a break but others did not.

    “Some of the respondents continued to use the technologies after a break but others did not.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Findingown data

    Among those 23 respondents, 17 had lost at least 0.5% of baseline weight, 5 had maintained or gained weight, and 1 had no end measurement.

    “There were 17 respondents who had lost at least 0.5% of their baseline weight, 5 who had maintained or gained weight, and 1 respondent who had no end measurement.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Findingown data

    Only about 38% of the employee population responded to the screening questionnaire and only 29% of the subjects in the technology group self-selected to use technologies over the long-term.

    “Only about 38% of the employee population responded to the screening questionnaire and only 29% of the subjects in the technology group self-selected to use technologies over the long-term.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Findingcitation

    There were few, if any, health-related benefits in any of the study arms, which may be linked to the selection of the study population.

    “Secondly, there were few, if any, health-related benefits in any of the study arms [23], which may be linked to the selection of the study population.”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites [23] Hopsu, L, 2010, Barents Newsletter on Occupational Health and Safety

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Findingown data

    Users changed technologies during the study.

    “The users also changed technologies during the study.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Findingown data

    Among those 51 respondents, 36 had increased aerobic fitness, 13 had maintained or decreased fitness, and 2 had no end measurement.

    “There were 36 respondents who had increased their aerobic fitness, 13 who had maintained or decreased their fitness, and 2 who had no end measurement.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Findingown data

    Half of the subjects had used mobile or Web technologies throughout the active intervention period (weeks 1-8), after which the number of users declined, leaving 33 (29%) sustained users.

    “Half of them had used mobile or Web technologies throughout the active intervention period (weeks 1–8), after which the number of users declined, leaving 33 (29%) sustained users.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Findingown data

    Reasons for decreased usage of the Wellness Diary were a change of routines from daily entries to entering several days' data at a time or stopping usage of certain variables due to a perceived lack of need.

    “The reasons for the decrease in usage of the Wellness Diary were a change of routines from daily entries to entering several days’ data at a time or stopping usage of certain variables due to a perceived lack of need.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Findingnone given

    Some subjects had difficulty adopting the study phone as their primary phone, while others considered the phone screen, font, and keypad to be too small.

    “Some subjects had difficulty adopting the study phone as their primary phone, while others considered the phone screen, font, and keypad to be too small.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Findingown data

    The scales and pedometer were the most popular technologies; at the end of the study, 72% of questionnaire respondents reported continuing to use the scales and 39% the pedometer.

    “The scales and pedometer were the most popular technologies; at the end of the study, 72% of the questionnaire respondents reported continuing to use the scales and 39% the pedometer.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Findingnone given

    The technologies were at different stages of maturity; some were already at the commercial or pre-commercial stage whereas others were being developed specifically for the study and had undergone limited technical and user testing.

    “Firstly the technologies were at different stages of maturity; some of them were already at the commercial or pre-commercial stage whereas others were being developed specifically for the study and had undergone limited technical and user testing.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Findingnone given

    Overall, the features appreciated in any of the technologies were ease of use, simplicity, availability, and clear and informative feedback.

    “Overall, the features appreciated in any of the technologies were ease of use, simplicity, availability, and clear and informative feedback.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Findingreasoning

    Although the inclusion criteria required sub-optimally healthy lifestyles, the subjects were in fact generally healthy, and thus had less room to show improvement except for overweight.

    “Although the inclusion criteria required sub-optimally healthy lifestyles, the subjects were in fact generally healthy, and thus had less room to show improvement except for overweight.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Findingown data

    Almost all the subjects tried to make use of the Web and mobile technologies but less than 30% of them did so for the entire 1-year period of the study.

    “Almost all the subjects tried to make use of the Web and mobile technologies but less than 30% of them did so for the entire 1-year period of the study.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Findingnone given

    Sustained usage was associated with slightly older subjects and lower baseline aerobic fitness.

    “Sustained usage was associated with slightly older subjects and lower baseline aerobic fitness.”
    Quote in the paperNot a substantial claim
  • Classified as probably not a substantial claim. May combine two claims.

    Premisecitation

    Single-approach interventions were used a median of 3 times, whereas multiple approach interventions had a median of 11 usage sessions.

    “Portnoy et al [1] found that single-approach interventions were used a median of 3 times, whereas multiple approach interventions had a median of 11 usage sessions.”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites Portnoy et al [1]

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    A weight loss program delivered via a heart rate monitor was superior to standard care weight management advice.

    “Byrne et al [14] found that a weight loss program delivered via a heart rate monitor was superior to standard care weight management advice.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Byrne et al [14]

      Not checked in the free run.

  • May combine two claims.

    Premisecitation

    Low participation and high attrition also plague eHealth interventions.

    “Low participation and high attrition also plague eHealth interventions [19].”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [19] source

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Premisecitation

    Using pedometers is associated with significant increases in physical activity and decreases in body mass index and blood pressure.

    “A review by Bravata et al [13] found that using pedometers was associated with significant increases in physical activity and decreases in body mass index and blood pressure.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Bravata et al [13]

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    The median attrition rate in worksite health promotion programs was 28%.

    “In a review by Bull et al [18], the median attrition rate in worksite health promotion programs was 28%.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Bull et al [18]

      Not checked in the free run.

  • Classified as probably not a substantial claim.

    Premisecitation

    Frequent self-weighing is associated with better weight loss and weight maintenance results.

    “Frequent self-weighing has been found to be associated with better weight loss and weight maintenance results [11,12].”
    Quote in the paperSubstantial claim0 of 2 sources checked
    • cites [11] source

      Not checked in the free run.

    • cites [12] source

      Not checked in the free run.

  • May combine two claims.

    Premisecitation

    Mobile health promotion interventions using text messaging or portable devices have produced favorable outcomes in weight loss, physical activity, smoking cessation, and anxiety.

    “These interventions have produced favorable outcomes in areas such as weight loss, physical activity, smoking cessation, and anxiety [3-7].”
    Quote in the paperSubstantial claim0 of 5 sources checked
    • cites [3] source

      Not checked in the free run.

    • cites [4] source

      Not checked in the free run.

    • cites [5] source

      Not checked in the free run.

    • cites [6] source

      Not checked in the free run.

    • cites [7] source

      Not checked in the free run.

  • Classified as probably not a substantial claim. May combine two claims.

    Premisecitation

    Computerized interventions have been successful in changing health-related knowledge, attitudes, and intentions; nutrition and smoking, but not physical activity or weight.

    “Portnoy et al [1] reviewed 75 articles on computerized interventions over 20 years and found that they were successful in changing health-related knowledge, attitudes, and intentions; nutrition and smoking, but not physical activity or weight.”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites Portnoy et al [1]

      Not checked in the free run.

  • Classified as probably not a substantial claim.

    Premisecitation

    In the United States, the majority of adults have more than 1 out of the 4 main health risks (smoking, risky alcohol consumption, physical inactivity, and overweight).

    “In the United States, the majority of adults have more than 1 out of the 4 main health risks (smoking, risky alcohol consumption, physical inactivity, and overweight ) [15]”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites [15] source

      Not checked in the free run.

  • May combine two claims.

    Premisecitation

    Combined with low usage rates, participants usually do not receive the intended dose of intervention, which detracts from effectiveness, cost-effectiveness, and generalizability.

    “Combined with low usage rates, this usually means that the participants do not receive the intended dose of intervention, which detracts from the effectiveness, cost-effectiveness, and generalizability of the interventions [20].”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites [20] source

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    Programs consisting of multiple components or targeting multiple behaviors produced higher participation rates.

    “Robroek et al [17] found that programs consisting of multiple components or targeting multiple behaviors produced higher participation rates.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Robroek et al [17]

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    About half of eHealth intervention studies had favorable outcomes for eHealth interventions compared to control groups in increasing physical activity, improving diet, and facilitating weight loss.

    “Norman et al [2] reviewed 47 eHealth intervention studies and found that about half of them had favorable outcomes for eHealth interventions compared to control groups in increasing physical activity, improving diet, and facilitating weight loss.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Norman et al [2]

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Study design and conductown data

    Thirteen subjects did not participate in laboratory measurements at the end of the study, and their data were unavailable; no imputations were made and these subjects were excluded from the analysis.

    “There were 13 subjects who did not participate in laboratory measurements at the end of the study, and thus their data were unavailable. No imputations were made but the subjects were excluded from the analysis.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Study design and conductreasoning

    The trial was registered with a local ethics committee in Finland, but not in any international registry.

    “The trial was registered with a local ethics committee in Finland, but not in any international registry.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Study design and conductnone given

    The ethics committee of Helsinki and Uusimaa Hospital District approved the study and all subjects gave written informed consent.

    “The ethics committee of Helsinki and Uusimaa Hospital District approved the study and all the subjects gave their written informed consent.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Study design and conductown data

    There were 13 subjects (12 of them non-sustained users) who did not attend the laboratory measurements at the end of the study.

    “There were 13 subjects (12 of them non-sustained users) who did not attend the laboratory measurements at the end of the study.”
    Quote in the paperNot a substantial claim
  • Classified as probably not a substantial claim.

    Study design and conductown data

    Randomization was done by drawing a random number between 0-1 from a uniform distribution for each eligible respondent, sorting the numbers ascending, and assigning the lowest 120 to the technology-supported intervention, the next 120 to the intervention without technologies, and the next 120 to control.

    “The randomization was done by drawing a random number between 0-1 from a uniform distribution for each eligible respondent. The random numbers were sorted to ascending order and the subjects with the lowest 120 random numbers were assigned to the intervention supported by technologies, the next 120 to the intervention without technologies, and the next 120 to control group.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Study design and conductnone given

    Post hoc power was calculated for all analyses where sustained and non-sustained users were compared.

    “Additionally, we calculated the post hoc power for all analyses where sustained and non-sustained users were compared.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Study design and conductnone given

    At week 48, 95% of the subjects stayed enrolled in the study, after which they gradually finished the study.

    “At week 48, 95% of the subjects stayed enrolled in the study, after which they gradually finished the study.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Study design and conductreasoning

    The authors conducted multiple tests without correcting the alpha level, so the probability of having at least 1 significant result is greater than 0.05.

    “We also note that we have conducted multiple tests without correcting the alpha level. As a consequence the probability of having at least 1 significant result is greater than 0.05.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    In a study of a commercial weight loss service, Neve et al found that 30% of participants could still be classified as users after 1 year.

    “In a study of a commercial weight loss service, Neve et al [48] used criteria comparable to ours to define sustained usage. They found that 30% of participants could still be classified as users after 1 year.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [48] source

      Not checked in the free run.

  • May combine two claims.

    Study design and conductnone given

    Self-reporting was used to assess the usage of personal monitoring devices, though this gives less accurate results and the likelihood of positive bias.

    “Self-reporting was used to assess the usage of these technologies, though this gives less accurate results and the likelihood of positive bias.”
    Quote in the paperNot a substantial claim
    • Rests on an assumption: Self-reported usage of personal monitoring devices gives less accurate results and is likely positively biased.
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Interpretationreasoning

    The lower physical fitness level may be an indication of technologies being adopted by those who had a real need to improve their wellness.

    “The lower physical fitness level may be an indication of technologies being adopted by those who had a real need to improve their wellness.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Premisecitation

    Potential reasons of non-usage include that the intervention is not mandatory or not critical to wellness, a lack of tangible and immediate advantages, a lack of encouragement and reminders, and distraction due to routine events.

    “Potential reasons of non-usage include that the intervention is not mandatory or not critical to wellness, a lack of tangible and immediate advantages, a lack of encouragement and reminders, and distraction due to routine events [19].”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [19] source

      Not checked in the free run.

  • May combine two claims.

    Premisecitation

    In a study by Robroek et al, 64% of participants visited the intervention website 3 times or more, with a median of 3 visits (IQR 2-6) over 2 years.

    “In a study by Robroek et al [20], 64% of participants visited the intervention website 3 times or more, the median number of visits being 3 (IQR 2-6) over 2 years.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [20] source

      Not checked in the free run.

  • May combine two claims.

    Interpretationown data

    The average age difference between the groups was only 3 years, so this tendency may not have practical relevance.

    “As the average age difference between the groups was only 3 years, this tendency may not have practical relevance.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S2 (checkable).

    Interpretationreasoning

    Although the results are not clinically significant, maintenance of current weight is in itself beneficial for health if the alternative is continued weight gain.

    “Although the results are not clinically significant, maintenance of current weight is in itself beneficial for health if the alternative is continued weight gain.”
    Quote in the paperNot a substantial claim
    • Rests on an assumption: Maintenance of current weight is beneficial for health if the alternative is continued weight gain.
  • May combine two claims.

    Study design and conductown data

    Usage rates of the personal monitoring devices could not be continuously logged at the time of the study and so they could not be included in the detailed analysis of sustained usage.

    “Usage rates of the personal monitoring devices could not be continuously logged at the time of the study and so they could not be included in the detailed analysis of sustained usage.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Interpretationreasoning

    The subjects may have made minor changes in several areas, which may not be considered relevant changes in any single health-related outcome measure when the changes are looked at separately.

    “The subjects may also have made minor changes in several areas, which may not be considered relevant changes in any single health-related outcome measure when the changes are looked at separately.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Interpretationreasoning

    Since there were no differences in participation between the two intervention conditions at the group level, the result may indicate that the technologies improved engagement with the intervention and also partly explain the slightly better health-related outcomes in sustained users as compared to non-sustained users.

    “Since there were no differences in participation between two intervention conditions at the group level [22], this result may indicate that the technologies improved engagement with the intervention and also partly explain the slightly better health-related outcomes in sustained users as compared to non-sustained users.”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites [22] Hopsu, L, 2010, Nuadu: Terveyden edistäminen terveysteknologialla

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Premisecitation

    Low participation and high attrition rates are common drawbacks in occupational health promotion programs.

    “Low participation and high attrition rates are common drawbacks in occupational health promotion programs.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [47] McCarty, CA, 2005, WMJ

      Not checked in the free run.

  • May combine two claims.

    Interpretationreasoning

    The results highlight the key requirements for personal health technologies: ease of use, simplicity, integration to daily life, and clear feedback.

    “The results highlight the key requirements for personal health technologies: ease of use, simplicity, integration to daily life, and clear feedback.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Interpretationown data

    Despite the high expectations placed on personal health technologies to cost-effectively support or deliver health promotion interventions to a broad range of users, high attrition rates, and modest health-related outcomes related to sustained usage may limit their potential.

    “Despite the high expectations placed on personal health technologies to cost-effectively support or deliver health promotion interventions to a broad range of users, high attrition rates, and modest health-related outcomes related to sustained usage may limit their potential.”
    Quote in the paperSubstantial claim
70 of 70
  • The paper relies on this without support.

    Self-reported use of weight scales and pedometer in the usefulness questionnaires accurately reflects actual usage.

    “The usage activity of personal monitoring devices was studied from the usefulness questionnaires.”
    “Table 3 presents the usage activity of the weight scales and pedometer based on usefulness questionnaires.”
  • The paper relies on this without support.

    Differences in weight-related outcomes between sustained and non-sustained users are not due to unmeasured confounding.

    “Further adjustments to other baseline covariates were made if an imbalance between the groups was observed in the baseline demographic or physiological parameters.”
  • The paper relies on this without support.

    The 13 subjects who did not participate in laboratory measurements at the end of the study are missing at random with respect to the outcomes.

    “There were 13 subjects who did not participate in laboratory measurements at the end of the study, and thus their data were unavailable. No imputations were made but the subjects were excluded from the analysis.”
  • The paper relies on this without support.

    Maintenance of current weight is beneficial for health if the alternative is continued weight gain.

    “Although the results are not clinically significant, maintenance of current weight is in itself beneficial for health if the alternative is continued weight gain.”
  • The paper relies on this without support.

    Self-reported usage of personal monitoring devices gives less accurate results and is likely positively biased.

    “Self-reporting was used to assess the usage of these technologies, though this gives less accurate results and the likelihood of positive bias.”
5 of 5

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

Each contradiction between two passages listed here was confirmed by an independent check.

  • Daily-exercise counts disagree between Results and Table 4

    Major

    The Results text says 68 of 108 baseline-health-questionnaire respondents exercised at least 30 minutes daily. Table 4 gives 12 sustained and 28 non-sustained respondents meeting that criterion, totaling only 40 of the same 108 respondents.

  • Self-rated good-health counts disagree between Results and Table 4

    Major

    The Results text reports 72 of 108 respondents rating their health good or fairly good. Table 4 reports 27 sustained plus 51 non-sustained respondents, or 78 of the same 108.

  • Abstract and Table 5 give different body-fat changes and P values

    Minor

    For non-sustained users, the abstract reports a 0.3 percentage-point increase in body fat, whereas Table 5 reports 0.23, which rounds to 0.2 at the abstract's precision. The reported group-by-time P values also differ (.014 versus .017).

  • Sustained-user percentage uses the wrong denominator

    Minor

    The technology group had 114 subjects, so 33 sustained users represent 28.9%, not 29.9%. The Results section reports 28.9% for the same count.

    Reported 29.9 · recomputed 28.947368

4 of 4

Cites

Flagged first, then by citations

3 of the 46 references couldn’t be matched to a known paper.

Research works printed but not linked: 6

  1. Hopsu, L, 2010, Nuadu: Terveyden edistäminen terveysteknologialla
  2. Babor, TF, 2001, Geneva: World Health Organization
  3. Gibbs, GR, 2007, The Sage qualitative research kit
  4. McCarty, CA, 2005, WMJ, 104, 61
  5. Conrad, P, 1987, J Occup Med, 29, 317
  6. Fogg, BJ, 2003, Persuasive Technology: Using Computers to Change What We Think and Do

Cited by

Sorted by citations

Authors
Mattila, E., Orsama, A.-L., Ahtinen, A., Hopsu, L., Leino, T., & Korhonen, I.
Affiliations
  • Tampere University of Technology (FI)
  • VTT Technical Research Centre of Finland (FI)
  • Finnish Institute of Occupational Health (FI)
Corresponding author
Mattila, Elina
Venue
JMIR mhealth and uhealth
Published
2013-07-29
Volume
1
Issue
2
Pages
e16
ISSN
2291-5222 (ISSN-L)
OpenAlex
W2096855299
Cited by
93
References
46
Citations by year
2026: 2 · 2025: 7 · 2024: 3 · 2023: 4 · 2022: 6 · 2021: 14 · 2020: 9 · 2019: 12 · 2018: 9 · 2017: 9 · 2016: 9 · 2015: 4 · 2014: 4 · 2013: 1
FWCI
10.87
Type
journal article
Language
en
Open access
Licence
cc-by
Locations
  • JMIR mhealth and uhealth (publishedVersion, cc-by)
  • Europe PMC (PubMed Central) (publishedVersion, cc-by)
  • PubMed Central (publishedVersion, cc-by)
  • PubMed (publishedVersion)
  • DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
Funders
  • ITEA
  • Teknologian Tutkimuskeskus VTT
Topics
  • Health Sciences › Health Professions › General Health Professions › Mobile Health and mHealth Applications
  • Social Sciences › Psychology › Applied Psychology › Digital Mental Health Interventions
  • Health Sciences › Health Professions › General Health Professions › Workplace Health and Well-being
Keywords
workplace health promotion, technology use, perceived usefulness, mobile health apps, web-based health services, pedometers, weight management, cardiorespiratory fitness, blood pressure, cholesterol, workplace wellness, technology adoption barriers, motivation, physical inactivity, sleep deprivation, stress, nutrition, work ability, group intervention, wearable devices

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Claims read by deepseek-v4.1-flash under definition version 3 (extract-v3) on 2026-10-10.

Classified by jev-1.13-20260917 (gold-guideline-v0.2) on 2026-10-10.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review