The DOI matches its Crossref record; 62 of the 62 references it cites were found in a registry or an index.
Best practices for analyzing large-scale health data from wearables and smartphone apps
Open accessAbstract
Smartphone apps and wearable devices for tracking physical activity and other health behaviors have become popular in recent years and provide a largely untapped source of data about health behaviors in the free-living environment. The data are large in scale, collected at low cost in the “wild”, and often recorded in an automatic fashion, providing a powerful complement to traditional surveillance studies and controlled trials. These data are helping to reveal, for example, new insights about environmental and social influences on physical activity. The observational nature of the datasets and collection via commercial devices and apps pose challenges, however, including the potential for measurement, population, and/or selection bias, as well as missing data. In this article, we review insights gleaned from these datasets and propose best practices for addressing the limitations of large-scale data from apps and wearables. Our goal is to enable researchers to effectively harness the data from smartphone apps and wearable devices to better understand what drives physical activity and other health behaviors.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures








Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“The literature underlines the potential for wearable-based research in low-resource settings to generate data and improve health care [9], based on their low cost and ease of use (data acquisition, hardware, and software handling) [233].”
From The impact of wearable technologies in health research: scoping review (2022) · cites this paper as [233]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Controlling the False Discovery Rate: A Practical and Powerful Approach to Multiple Testing
Benjamini, Y., & Hochberg, Y. (1995) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1995.tb02031.x · Cited by 109,482
The central role of the propensity score in observational studies for causal effects
ROSENBAUM, P. R., & RUBIN, D. B. (1983) · Biometrika · doi:10.1093/biomet/70.1.41 · Cited by 31,241
Multiple Imputation for Nonresponse in Surveys
Rubin, D. B. (1987) · Wiley Series in Probability and Statistics · doi:10.1002/9780470316696 · Cited by 20,701
Writing Group for the Women's Health Initiative Investigators (2002) · JAMA: The Journal of the American Medical Association · doi:10.1001/jama.288.3.321 · Cited by 15,889
Finding and evaluating community structure in networks
Newman, M. E. J., & Girvan, M. (2004) · Physical Review E · doi:10.1103/physreve.69.026113 · Cited by 13,931
Sudlow, C., Gallacher, J., Allen, N., Beral, V., Burton, P., Danesh, J., Downey, P., Elliott, P., Green, J., Landray, M., et al. (2015) · PLOS Medicine · doi:10.1371/journal.pmed.1001779 · Cited by 12,728
Austin, P. C. (2011) · Multivariate Behavioral Research · doi:10.1080/00273171.2011.568786 · Cited by 12,242
‘Small Changes' to Diet and Physical Activity Behaviors for Weight Management
Hills, A. P., Byrne, N. M., Lindstrom, R., & Hill, J. O. (2013) · Obesity Facts · doi:10.1159/000345030 · Cited by 9,493
Physical Activity in the United States Measured by Accelerometer
TROIANO, R. P., BERRIGAN, D., DODD, K. W., MÂSSE, L. C., TILERT, T., & MCDOWELL, M. (2008) · Medicine & Science in Sports & Exercise · doi:10.1249/mss.0b013e31815a51b3 · Cited by 7,638
Sterne, J. A. C., White, I. R., Carlin, J. B., Spratt, M., Royston, P., Kenward, M. G., Wood, A. M., & Carpenter, J. R. (2009) · BMJ · doi:10.1136/bmj.b2393 · Cited by 7,299
Cited by
Alber, M., Buganza Tepole, A., Cannon, W. R., De, S., Dura-Bernal, S., Garikipati, K., Karniadakis, G., Lytton, W. W., Perdikaris, P., Petzold, L., et al. (2019) · npj Digital Medicine · doi:10.1038/s41746-019-0193-y · Cited by 639
Methods in predictive techniques for mental health status on social media: a critical review
Chancellor, S., & De Choudhury, M. (2020) · npj Digital Medicine · doi:10.1038/s41746-020-0233-7 · Cited by 557
The impact of wearable technologies in health research: scoping review
Huhn, S., Axt, M., Gunga, H.-C., Maggioni, M. A., Munga, S., Obor, D., Sié, A., Boudo, V., Bunker, A., Sauerborn, R., et al. (2022) · JMIR mHealth and uHealth · doi:10.2196/34384 · Cited by 379
Malgaroli, M., Hull, T. D., Zech, J. M., & Althoff, T. (2023) · Translational Psychiatry · doi:10.1038/s41398-023-02592-2 · Cited by 201
“One suggested procedure is to calculate the standardized mean difference (SMD) between the groups with and without missing data [149].”
MethodSelf-citationClinical Applications of Mobile Health Wearable–Based Sleep Monitoring: Systematic Review
Guillodo, E., Lemey, C., Simonnet, M., Walter, M., Baca-García, E., Masetti, V., Moga, S., Larsen, M., HUGOPSY Network, Ropars, J., et al. (2020) · JMIR mHealth and uHealth · doi:10.2196/10733 · Cited by 167
Metadata
- Authors
- Hicks, J. L., Althoff, T., Sosic, R., Kuhar, P., Bostjancic, B., King, A. C., Leskovec, J., & Delp, S. L.
- Affiliations
- Stanford University (US)
- University of Washington (US)
- Stanford Medicine (US)
- Chan Zuckerberg Biohub San Francisco (US)
- Corresponding author
- Hicks, Jennifer L.
- Venue
- npj Digital Medicine
- Published
- 2019-06-03
- Volume
- 2
- Issue
- 1
- Pages
- 45-45
- ISSN
- 2398-6352 (ISSN-L)
- PMC
- PMC6550237
- OpenAlex
- W2948756736
- Cited by
- 183
- References
- 62
- Citations by year
- 2026: 22 · 2025: 19 · 2024: 27 · 2023: 17 · 2022: 36 · 2021: 35 · 2020: 22 · 2019: 5
- FWCI
- 4.58
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by
- creativecommons.org/licenses/by/4.0 (tdm)
- creativecommons.org/licenses/by/4.0 (vor)
- Locations
- npj Digital Medicine (publishedVersion, cc-by)
- Europe PMC (PubMed Central) (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion)
- Funders
- Robert Wood Johnson Foundation (ID#7334, #7334)
- Silicon Valley Community Foundation (101518)
- National Institutes of Health
- National Cancer Institute (P20CA217199, R01CA211048, 5R01CA211048 and P20CA217199)
- National Institute of Diabetes and Digestive and Kidney Diseases (R01DK102016)
- National Institute of Biomedical Imaging and Bioengineering (U54EB020405)
- National Institute on Minority Health and Health Disparities (U54MD010724)
- Eunice Kennedy Shriver National Institute of Child Health and Human Development (P2CHD065690)
- Topics
- Health Sciences › Health Professions › General Health Professions › Mobile Health and mHealth Applications
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Physical Activity and Health
- Social Sciences › Transportation › Human Mobility and Location-Based Analysis
- Keywords
- wearable devices, mobile application, physical activity, health behavior, measurement bias, selection bias, missing data, data quality
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Best practices for analyzing large-scale health data from wearables and smartphone apps. https://app.cochat.ai/papers/10.1038/s41746-019-0121-1
- The paper
- Hicks, J. L., Althoff, T., Sosic, R., Kuhar, P., Bostjancic, B., King, A. C., Leskovec, J., & Delp, S. L. (2019). Best practices for analyzing large-scale health data from wearables and smartphone apps. npj Digital Medicine. https://doi.org/10.1038/s41746-019-0121-1
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.