Evaluating the Consistency of Current Mainstream Wearable Devices in Health Monitoring: A Comparison Under Free-Living Conditions
Open accessThe DOI matches its Crossref record; 11 of the 11 references it cites were found in a registry or an index.
Abstract
Background: Wearable devices are gaining increasing market attention; however, the monitoring accuracy and consistency of the devices remains unknown. Objective: The purpose of this study was to assess the consistency of the monitoring measurements of the latest wearable devices in the state of normal activities to provide advice to the industry and support to consumers in making purchasing choices. Methods: Ten pieces of representative wearable devices (2 smart watches, 4 smart bracelets of Chinese brands or foreign brands, and 4 mobile phone apps) were selected, and 5 subjects were employed to simultaneously use all the devices and the apps. From these devices, intact health monitoring data were acquired for 5 consecutive days and analyzed on the degree of differences and the relationships of the monitoring measurements by the different devices. Results: The daily measurements by the different devices fluctuated greatly, and the coefficient of variation (CV) fluctuated in the range of 2-38% for the number of steps, 5-30% for distance, 19-112% for activity duration, .1-17% for total energy expenditure (EE), 22-100% for activity EE, 2-44% for sleep duration, and 35-117% for deep sleep duration. After integrating the measurement data of 25 days among the devices, the measurements of the number of steps (intraclass correlation coefficient, ICC=.89) and distance (ICC=.84) displayed excellent consistencies, followed by those of activity duration (ICC=.59) and the total EE (ICC=.59) and activity EE (ICC=.57). However, the measurements for sleep duration (ICC=.30) and deep sleep duration (ICC=.27) were poor. For most devices, there was a strong correlation between the number of steps and distance measurements (R2>.95), and for some devices, there was a strong correlation between activity duration measurements and EE measurements (R2>.7). A strong correlation was observed in the measurements of steps, distance and EE from smart watches and mobile phones of the same brand, Apple or Samsung (r>.88). Conclusions: Although wearable devices are developing rapidly, the current mainstream devices are only reliable in measuring the number of steps and distance, which can be used as health assessment indicators. However, the measurement consistencies of activity duration, EE, sleep quality, and so on, are still inadequate, which require further investigation and improved algorithms.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Using Pedometers to Increase Physical Activity and Improve Health: A Systematic Review
Bravata, D. M., Smith-Spangler, C., Sundaram, V., Gienger, A. L., Lin, N., Lewis, R., Stave, C. D., Olkin, I., & Sirard, J. R. (2007) · JAMA · doi:10.1001/jama.298.19.2296 · Cited by 2,064 · cited 1×
“…often overestimated their physical activity compared with the actual measurement [6]; in this regard, a pedometer can accurately estimate the amount of activity to prompt the user to engage in more physical activities and significantly lower their body mass index (BMI) and blood pressure [7].”
How Many Steps/Day Are Enough?: Preliminary Pedometer Indices for Public Health
Tudor-Locke, C., & Bassett, D. R. (2004) · Sports Medicine · doi:10.2165/00007256-200434010-00001 · Cited by 2,054 · cited 1×
“The physical activities promoted by a pedometer have been mainly based on the social cognitive theory, self-efficacy theory, and cross-theoretical model, and it was revealed that the outcome of increased physical activity has been achieved by adopting strategies such as setting goals and participating in group activit…”
Daily Sitting Time and All-Cause Mortality: A Meta-Analysis
Chau, J. Y., Grunseit, A. C., Chey, T., Stamatakis, E., Brown, W. J., Matthews, C. E., Bauman, A. E., & van der Ploeg, H. P. (2013) · PLoS ONE · doi:10.1371/journal.pone.0080000 · Cited by 876 · cited 1×
“The longer the daily sedentary time is, the higher the risk of all-cause mortality [2].”
Ferguson, T., Rowlands, A. V., Olds, T., & Maher, C. (2015) · International Journal of Behavioral Nutrition and Physical Activity · doi:10.1186/s12966-015-0201-9 · Cited by 468 · cited 5×
“…wearable devices showed moderate validity for measurement of moderate to vigorous physical activity in free-living conditions ( r =.52-.91) [16] The inter-device reliability of wearable devices in measuring distance was excellent for all treadmill speeds (ICC c ≥.90) [14] Consumer-grade…”
InfluentialFitbit®: An accurate and reliable device for wireless physical activity tracking
Diaz, K. M., Krupka, D. J., Chang, M. J., Peacock, J., Ma, Y., Goldsmith, J., Schwartz, J. E., & Davidson, K. W. (2015) · International Journal of Cardiology · doi:10.1016/j.ijcard.2015.03.038 · Cited by 405
Validity of Consumer-Based Physical Activity Monitors
LEE, J.-M., KIM, Y., & WELK, G. J. (2014) · Medicine & Science in Sports & Exercise · doi:10.1249/mss.0000000000000287 · Cited by 401 · cited 1×
“LEE et al [15] investigated the accuracy of EE measurements on 60 subjects wearing 8 types of wearable devices performing activities at different intensities and showed that the mean absolute percent error of different devices on EE measurements varied between 9.3% and 23.5%; moreover, the error…”
InfluentialBehavior Change Techniques Present in Wearable Activity Trackers: A Critical Analysis
Mercer, K., Li, M., Giangregorio, L., Burns, C., & Grindrod, K. (2016) · JMIR mHealth and uHealth · doi:10.2196/mhealth.4461 · Cited by 304 · cited 1×
“trends of users’ health characteristics are better portrayed and potential health risks are spotted in a timely manner [12,13].”
Movement toward a novel activity monitoring device
Montgomery-Downs, H. E., Insana, S. P., & Bond, J. A. (2012) · Sleep and Breathing · doi:10.1007/s11325-011-0585-y · Cited by 301
Dwyer, T., Pezic, A., Sun, C., Cochrane, J., Venn, A., Srikanth, V., Jones, G., Shook, R., Sui, X., Ortaglia, A., et al. (2015) · PLOS ONE · doi:10.1371/journal.pone.0141274 · Cited by 239 · cited 1×
“For healthy people, increasing the number of steps reduces the risk of death [4].”
Comparison of Consumer and Research Monitors under Semistructured Settings
BAI, Y., WELK, G. J., NAM, Y. H., LEE, J. A., LEE, J.-M., KIM, Y., MEIER, N. F., & DIXON, P. M. (2016) · Medicine & Science in Sports & Exercise · doi:10.1249/mss.0000000000000727 · Cited by 149 · cited 3×
“Bai et al [27] asked 52 subjects to wear 5 pieces of consumer-level devices and 2 pieces of research-level devices and examined the accuracy of EE measurements during optional activities of various types and found that in general, the percentage of EE measurement error ranged from 15.3% to 30.4%,…”
InfluentialEvaluation of a consumer fitness-tracking device to assess sleep in adults
de Zambotti, M., Claudatos, S., Inkelis, S., Colrain, I. M., & Baker, F. C. (2015) · Chronobiology International · doi:10.3109/07420528.2015.1054395 · Cited by 127 · cited 1×
“According to the Rechtschaffen and Kales classification, sleep can be divided into the rapid eye movement phase and the nonrapid eye movement phase; the fourth period of the nonrapid eye movement phase is the deep sleep stage, which has the high amplitude brain wave, mainly the delta-wave with a frequency of 1-2 times…”
Cited by
Sim, I. (2019) · New England Journal of Medicine · doi:10.1056/nejmra1806949 · Cited by 491
Zhao, D., Liu, L., Yu, F., Heidari, A. A., Wang, M., Liang, G., Muhammad, K., & Chen, H. (2021) · Knowledge-Based Systems · doi:10.1016/j.knosys.2020.106510 · Cited by 307
Hu, J., Chen, H., Heidari, A. A., Wang, M., Zhang, X., Chen, Y., & Pan, Z. (2021) · Knowledge-Based Systems · doi:10.1016/j.knosys.2020.106684 · Cited by 289
Self-citationMOSMA: Multi-Objective Slime Mould Algorithm Based on Elitist Non-Dominated Sorting
Premkumar, M., Jangir, P., Sowmya, R., Alhelou, H. H., Heidari, A. A., & Chen, H. (2021) · IEEE Access · doi:10.1109/access.2020.3047936 · Cited by 233
“…but practitioners face them in any discipline, especially fuzzy optimization [3], location-based services [4], traffic management [5], neural networks [6], wireless sensor networks [7]–[9], hon-eynet potency [10], monitoring [11], [12], computer-aided design [13], and Internet of things [14].”
BackgroundMelting process of nanoparticle enhanced PCM through storage cylinder incorporating fins
Li, F., Almarashi, A., Jafaryar, M., Hajizadeh, M. R., & Chu, Y.-M. (2021) · Powder Technology · doi:10.1016/j.powtec.2020.12.026 · Cited by 184
Metadata
- Authors
- Wen, D., Zhang, X., Liu, X., & Lei, J.
- Venue
- Journal of Medical Internet Research
- Publisher
- JMIR Publications Inc.
- Published
- 2017-03-07
- Volume
- 19
- Issue
- 3
- Pages
- e68
- ISSN
- 1438-8871 (ISSN-L)
- OpenAlex
- W2593064265
- Cited by
- 111
- References
- 11
- FWCI
- 5.84
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.