Cited by 28Mobile Health and mHealth ApplicationsHealth, Technology, Consumer BehaviorDigital Mental Health Interventions

Use of machine learning to mine user-generated content from mobile health apps for weight loss to assess factors correlated with user satisfaction

Open access
Wang, Tong, Zheng, Xu, Liang, Jun, An, Kai, He, Yunfan, Nuo, Mingfu, Wang, Wei, Lei, Jianbo·2022·JAMA Network Open

Abstract

Importance: The effectiveness of mobile health (mHealth) apps for reducing obesity is not ideal in daily life. Therefore, it would be useful to explore factors associated with user satisfaction with weight loss apps. Currently, research on these factors from the perspective of user-generated content is lacking. Objective: To mine the themes and topics frequently discussed in user-generated content in mHealth apps for weight loss, explore correlations of the topics with user satisfaction and dissatisfaction, and assess whether these correlations were asymmetric. Design, Setting, and Participants: In this population-based cross-sectional study, unsupervised machine learning was used to identify themes and topics in online discussions generated between January 1, 2019, and May 20, 2021, by Chinese users of mHealth apps for weight loss. Main Outcomes and Measures: Based on the 2-factor theory, a tobit regression model was used to explore the correlation of various app discussion topics with user satisfaction and dissatisfaction. Differences of the coefficients in models of positive rating deviation (PD) and negative rating deviation (ND), defined as the difference between the users' rating of the app and the app's comprehensive rating in the app stores, were analyzed by the Wald test. Results: In total, 191 619 reviews and ratings from unique usernames were collected for 2139 weight loss apps; 86 423 reviews (45.1%) from 339 apps (15.8%) were included in the study. Most users (65 249 [75.5%]) were satisfied with the mHealth app. Eighteen topics were identified and summarized into 9 themes. Nine topics had significant positive correlations with the PD of user satisfaction, and 6 had significant negative correlations. The factor with the strongest positive correlation with the PD was celebrity effect (β = 0.307; 95% CI, 0.290-0.323), and the factor with the weakest correlation was economic cost (β = -0.426; 95% CI, -0.447 to -0.406). Nine topics had significant positive correlations with the ND of user satisfaction, whereas 7 topics had significant negative correlations. The factor with the strongest positive correlation with the ND was fitness effect (β = 1.369; 95% CI, 1.283-1.455), and the factor with the strongest negative correlation was economic cost (β = -2.813; 95% CI, -2.875 to -2.751). There were significant differences in the PD and ND of user satisfaction. Nine motivation factors (ie, value-added attributes) and 7 hygiene factors (ie, user-expected attributes) for mHealth apps were identified. Conclusions and Relevance: In this cross-sectional study, 16 factors had asymmetric correlations with user satisfaction and dissatisfaction with weight loss apps; 7 were related to basic expected attributes of the apps and 9 to value-added attributes. By distinguishing between expected and value-added factors, the use of weight loss apps may be improved.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1001/jamanetworkopen.2022.15014

Cites

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • When individuals are given the right of choice or autonomy, their intrinsic motivation increases.

    “When individuals are given the right of choice or autonomy, their intrinsic motivation increases [52][53][54].”

    From What Influences Users’ Intention to Share Works in Designer-Driven User-Generated Content Communities? A Study Based on Self-Determination Theory (2023) · cites this paper as [54]

    The Introduction defines “motivation factors” as value-added app attributes associated with user satisfaction, and the Discussion addresses their possible relationship to satisfaction and adherence. Searches for choice, autonomy, and intrinsic motivation found no passage saying that giving people a choice increases intrinsic motivation. No page numbers are available in our copy. (LLM, conf=0.78)

    Experimental — accuracy not yet measured

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

No citation lists for this paper

No citation lists for this paper yet — checked again daily.

References 32 · Cited by 28

Research works printed but not linked: 1

  1. Herzberg F. Motivation to Work. Routledge; 2017.

Authors
Wang, T., Zheng, X., Liang, J., An, K., He, Y., Nuo, M., Wang, W., & Lei, J.
Affiliations
  • Jilin University (CN)
  • Peking University Third Hospital (CN)
  • Second Affiliated Hospital of Zhejiang University (CN)
  • Zhejiang University (CN)
  • Peking University (CN)
Corresponding author
  • Wang, Wei
  • Lei, Jianbo
Venue
JAMA Network Open
Published
2022-05-31
Volume
5
Issue
5
Pages
e2215014
ISSN
2574-3805 (ISSN-L)
OpenAlex
W4281649506
Cited by
28
References
32
Citations by year
2026: 8 · 2025: 8 · 2024: 6 · 2023: 5 · 2022: 1
FWCI
5.24
Type
journal article
Language
en
Open access
Licence
cc-by
Locations
  • JAMA Network Open (publishedVersion, cc-by)
  • PubMed (publishedVersion)
Funders
  • Baidu
  • National Natural Science Foundation of China (81871455, 81771937)
  • Natural Science Foundation of Zhejiang Province (LY22H180001)
Topics
  • Health Sciences › Health Professions › General Health Professions › Mobile Health and mHealth Applications
  • Health Sciences › Health Professions › Health Information Management › Health, Technology, Consumer Behavior
  • Social Sciences › Psychology › Applied Psychology › Digital Mental Health Interventions
Keywords
mobile health apps, weight loss apps, user-generated content, user satisfaction, obesity, celebrity influence, economic costs, app ratings, Chinese users, user dissatisfaction, app store optimization
MeSH terms
Machine Learning, Cross-Sectional Studies, Humans, Personal Satisfaction, Weight Loss, Telemedicine, Mobile Applications

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review