Big data vs accurate data in health research: Large-scale physical activity monitoring, smartphones, wearable devices and risk of unconscious bias
Open accessThe DOI matches its Crossref record; 9 of the 9 references it cites were found in a registry or an index.
Abstract
Fundamental to the advancement of scientific knowledge is unbiased, accurate and validated measurement techniques. Recent United Nations and landmark Nature publications highlight the global uptake of mobile technology and the staggering potential for big data to encourage people to be physically active and to influence health policy. However, concerns exist about inconsistencies in smartphone health apps. Big data has many benefits, but noisy data may lead to wrong conclusions. In reaction to the increasing availability of low quality data; we call for a rigorous debate into the validity of substituting big data for accurate data in health research. We evaluated the step counting accuracy of a smartphone app previously used by 717,527 people from 111 countries. Our new data (from 48 participants; aged 21-59 years; body mass index 17.7-33.5 kg/m2) revealed significant (15-66%) undercounting by Apple phones. In contrast to the generally positive performances of wearable devices for stereotypical treadmill like walking, we observed extraordinarily large (0-200% of steps taken) error ranges for both Android and Apple phones. Unconscious bias (developers' perceptions of usual behaviour) may be embedded into many unvalidated smartphone apps. Consumer-grade wearable devices appear unsuitable to detect steps in people with slow, short or non-stereotypical gait patterns. Specifically, there is a risk of systematically undercounting the steps by obese people, females or people from different ethnic groups resulting in biases when reporting associations between physical inactivity and obesity. More research is required to develop smartphone apps suitable for all people of the heterogeneous global population.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Global physical activity levels: surveillance progress, pitfalls, and prospects
Hallal, P. C., Andersen, L. B., Bull, F. C., Guthold, R., Haskell, W., & Ekelund, U. (2012) · The Lancet · doi:10.1016/s0140-6736(12)60646-1 · Cited by 5,711
Correlates of physical activity: why are some people physically active and others not?
Bauman, A. E., Reis, R. S., Sallis, J. F., Wells, J. C., Loos, R. J., & Martin, B. W. (2012) · The Lancet · doi:10.1016/s0140-6736(12)60735-1 · Cited by 4,151
A survey of mobile phone sensing
Lane, N., Miluzzo, E., Lu, H., Peebles, D., Choudhury, T., & Campbell, A. (2010) · IEEE Communications Magazine · doi:10.1109/mcom.2010.5560598 · Cited by 2,292
Challenges of Big Data analysis
Fan, J., Han, F., & Liu, H. (2014) · National Science Review · doi:10.1093/nsr/nwt032 · Cited by 1,482
Large-scale physical activity data reveal worldwide activity inequality
Althoff, T., Sosič, R., Hicks, J. L., King, A. C., Delp, S. L., & Leskovec, J. (2017) · Nature · doi:10.1038/nature23018 · Cited by 1,000
Dennison, L., Morrison, L., Conway, G., & Yardley, L. (2013) · Journal of Medical Internet Research · doi:10.2196/jmir.2583 · Cited by 895
Accuracy of Smartphone Applications and Wearable Devices for Tracking Physical Activity Data
Case, M. A., Burwick, H. A., Volpp, K. G., & Patel, M. S. (2015) · JAMA · doi:10.1001/jama.2014.17841 · Cited by 694
Vallerand, R. J., & Reid, G. (1984) · Journal of Sport Psychology · doi:10.1123/jsp.6.1.94 · Cited by 527
Hekler, E. B., Buman, M. P., Grieco, L., Rosenberger, M., Winter, S. J., Haskell, W., & King, A. C. (2015) · JMIR mhealth and uhealth · doi:10.2196/mhealth.3505 · Cited by 137
Cited by
Implicit bias in healthcare: clinical practice, research and decision making
Gopal, D. P., Chetty, U., O'Donnell, P., Gajria, C., & Blackadder-Weinstein, J. (2021) · Future Healthcare Journal · doi:10.7861/fhj.2020-0233 · Cited by 298
Bauer, M., Glenn, T., Geddes, J., Gitlin, M., Grof, P., Kessing, L. V., Monteith, S., Faurholt-Jepsen, M., Severus, E., & Whybrow, P. C. (2020) · International Journal of Bipolar Disorders · doi:10.1186/s40345-019-0164-x · Cited by 163
Brand, Y. E., Kluge, F., Palmerini, L., Paraschiv-Ionescu, A., Becker, C., Cereatti, A., Maetzler, W., Sharrack, B., Vereijken, B., Yarnall, A. J., et al. (2024) · Scientific Reports · doi:10.1038/s41598-024-71491-3 · Cited by 19
Metadata
- Authors
- Brodie, M. A., Pliner, E. M., Ho, A., Li, K., Chen, Z., Gandevia, S. C., & Lord, S. R.
- Venue
- Medical Hypotheses
- Publisher
- Elsevier BV
- Published
- 2018-10
- Volume
- 119
- Pages
- 32-36
- ISSN
- 0306-9877 (ISSN-L)
- OpenAlex
- W2882997960
- Cited by
- 57
- References
- 9
- FWCI
- 11.79
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Big data vs accurate data in health research: Large-scale physical activity monitoring, smartphones, wearable devices and risk of unconscious bias. https://app.cochat.ai/papers/10.1016/j.mehy.2018.07.015
- The paper
- Brodie, M. A., Pliner, E. M., Ho, A., Li, K., Chen, Z., Gandevia, S. C., & Lord, S. R. (2018). Big data vs accurate data in health research: Large-scale physical activity monitoring, smartphones, wearable devices and risk of unconscious bias. Medical Hypotheses. https://doi.org/10.1016/j.mehy.2018.07.015
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.