Heart Rate Measures From Wrist-Worn Activity Trackers in a Laboratory and Free-Living Setting: Validation Study
Open accessThe DOI matches its Crossref record; 31 of the 31 references it cites were found in a registry or an index.
Abstract
Background: Wrist-worn activity trackers are popular, and an increasing number of these devices are equipped with heart rate (HR) measurement capabilities. However, the validity of HR data obtained from such trackers has not been thoroughly assessed outside the laboratory setting. Objective: This study aimed to investigate the validity of HR measures of a high-cost consumer-based tracker (Polar A370) and a low-cost tracker (Tempo HR) in the laboratory and free-living settings. Methods: Participants underwent a laboratory-based cycling protocol while wearing the two trackers and the chest-strapped Polar H10, which acted as criterion. Participants also wore the devices throughout the waking hours of the following day during which they were required to conduct at least one 10-min bout of moderate-to-vigorous physical activity (MVPA) to ensure variability in the HR signal. We extracted 10-second values from all devices and time-matched HR data from the trackers with those from the Polar H10. We calculated intraclass correlation coefficients (ICCs), mean absolute errors, and mean absolute percentage errors (MAPEs) between the criterion and the trackers. We constructed decile plots that compared HR data from Tempo HR and Polar A370 with criterion measures across intensity deciles. We investigated how many HR data points within the MVPA zone (≥64% of maximum HR) were detected by the trackers. Results: Of the 57 people screened, 55 joined the study (mean age 30.5 [SD 9.8] years). Tempo HR showed moderate agreement and large errors (laboratory: ICC 0.51 and MAPE 13.00%; free-living: ICC 0.71 and MAPE 10.20%). Polar A370 showed moderate-to-strong agreement and small errors (laboratory: ICC 0.73 and MAPE 6.40%; free-living: ICC 0.83 and MAPE 7.10%). Decile plots indicated increasing differences between Tempo HR and the criterion as HRs increased. Such trend was less pronounced when considering the Polar A370 HR data. Tempo HR identified 62.13% (1872/3013) and 54.27% (5717/10,535) of all MVPA time points in the laboratory phase and free-living phase, respectively. Polar A370 detected 81.09% (2273/2803) and 83.55% (9323/11,158) of all MVPA time points in the laboratory phase and free-living phase, respectively. Conclusions: HR data from the examined wrist-worn trackers were reasonably accurate in both the settings, with the Polar A370 showing stronger agreement with the Polar H10 and smaller errors. Inaccuracies increased with increasing HRs; this was pronounced for Tempo HR.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
A guideline of selecting and reporting intraclass correlation coefficients for reliability research
Koo, T. K., & Li, M. Y. (2016) · Journal of Chiropractic Medicine · doi:10.1016/j.jcm.2016.02.012 · Cited by 31,709
Lear, S. A., Hu, W., Rangarajan, S., Gasevic, D., Leong, D., Iqbal, R., Casanova, A., Swaminathan, S., Anjana, R. M., Kumar, R., et al. (2017) · The Lancet · doi:10.1016/s0140-6736(17)31634-3 · Cited by 1,331
Kyu, H. H., Bachman, V. F., Alexander, L. T., Mumford, J. E., Afshin, A., Estep, K., Veerman, J. L., Delwiche, K., Iannarone, M. L., Moyer, M. L., et al. (2016) · BMJ · doi:10.1136/bmj.i3857 · Cited by 1,272 · cited 1×
“For example, positive effects of MVPA have been shown in the domains of mortality risk [3,4] as well as physical and psychological health and well-being [1,5-7].”
Doherty, A., Jackson, D., Hammerla, N., Plötz, T., Olivier, P., Granat, M. H., White, T., van Hees, V. T., Trenell, M. I., Owen, C. G., et al. (2017) · PLOS ONE · doi:10.1371/journal.pone.0169649 · Cited by 1,250
Systematic review of the validity and reliability of consumer-wearable activity trackers
Evenson, K. R., Goto, M. M., & Furberg, R. D. (2015) · International Journal of Behavioral Nutrition and Physical Activity · doi:10.1186/s12966-015-0314-1 · Cited by 1,232
Progress in physical activity over the Olympic quadrennium
Sallis, J. F., Bull, F., Guthold, R., Heath, G. W., Inoue, S., Kelly, P., Oyeyemi, A. L., Perez, L. G., Richards, J., & Hallal, P. C. (2016) · The Lancet · doi:10.1016/s0140-6736(16)30581-5 · Cited by 935
Wearable photoplethysmographic sensors—past and present
Tamura, T., Maeda, Y., Sekine, M., & Yoshida, M. (2014) · Electronics · doi:10.3390/electronics3020282 · Cited by 912 · cited 2×
“A review by Tamura et al provides some insights into the factors that impact HR measurement through PPG in different devices [19].”
Reis, R. S., Salvo, D., Ogilvie, D., Lambert, E. V., Goenka, S., & Brownson, R. C. (2016) · The Lancet · doi:10.1016/s0140-6736(16)30728-0 · Cited by 719 · cited 2×
“The PA research landscape could broadly be divided into 2 core facets—PA surveillance and PA promotion [1,2].”
Domain-Specific Physical Activity and Mental Health: A Meta-analysis
White, R. L., Babic, M. J., Parker, P. D., Lubans, D. R., Astell-Burt, T., & Lonsdale, C. (2017) · American Journal of Preventive Medicine · doi:10.1016/j.amepre.2016.12.008 · Cited by 715 · cited 1×
“For example, positive effects of MVPA have been shown in the domains of mortality risk [3,4] as well as physical and psychological health and well-being [1,5-7].”
Shcherbina, A., Mattsson, C., Waggott, D., Salisbury, H., Christle, J., Hastie, T., Wheeler, M., & Ashley, E. (2017) · Journal of Personalized Medicine · doi:10.3390/jpm7020003 · Cited by 625 · cited 2×
“In addition, sample sizes were mostly small, with only few studies having more than 50 participants [22,28,40].”
Lyons, E. J., Lewis, Z. H., Mayrsohn, B. G., & Rowland, J. L. (2014) · Journal of Medical Internet Research · doi:10.2196/jmir.3469 · Cited by 547 · cited 1×
“A key promise of such wrist-worn trackers is that they can facilitate PA behavior change through self-monitoring and feedback, 2 well-established behavioral change techniques that are supposed to enable individuals to bridge the gap between current behavior and behavioral targets [55,56].”
Henriksen, A., Haugen Mikalsen, M., Woldaregay, A. Z., Muzny, M., Hartvigsen, G., Hopstock, L. A., & Grimsgaard, S. (2018) · Journal of Medical Internet Research · doi:10.2196/jmir.9157 · Cited by 542 · cited 6×
“In addition to measurements of accelerometer-based metrics, many newer wrist-worn trackers are equipped with capabilities to collect data on physiological measures such as heart rate (HR) [14].”
InfluentialPhysical activity and the prevention of coronary heart disease
Fox, S. M., & Naughton, J. P. (1972) · Preventive Medicine · doi:10.1016/0091-7435(72)90079-5 · Cited by 497
Ferguson, T., Rowlands, A. V., Olds, T., & Maher, C. (2015) · International Journal of Behavioral Nutrition and Physical Activity · doi:10.1186/s12966-015-0201-9 · Cited by 468
Accelerometry and physical activity questionnaires - a systematic review
Skender, S., Ose, J., Chang-Claude, J., Paskow, M., Brühmann, B., Siegel, E. M., Steindorf, K., & Ulrich, C. M. (2016) · BMC Public Health · doi:10.1186/s12889-016-3172-0 · Cited by 449
Assessing Physical Activity Using Wearable Monitors: Measures of Physical Activity
BUTTE, N. F., EKELUND, U., & WESTERTERP, K. R. (2012) · Medicine & Science in Sports & Exercise · doi:10.1249/mss.0b013e3182399c0e · Cited by 359 · cited 1×
“Wearable research-grade devices such as accelerometers are commonly used, which have improved the validity of PA estimates [9,10].”
Variable Accuracy of Wearable Heart Rate Monitors during Aerobic Exercise
GILLINOV, S., ETIWY, M., WANG, R., BLACKBURN, G., PHELAN, D., GILLINOV, A. M., HOUGHTALING, P., JAVADIKASGARI, H., & DESAI, M. Y. (2017) · Medicine & Science in Sports & Exercise · doi:10.1249/mss.0000000000001284 · Cited by 345 · cited 1×
“When contextualizing our laboratory findings with those reported in the literature, the Polar A370 and the Tempo HR appear to have comparable or better accuracy with the market leader Fitbit, which has been studied extensively [20-25, 28-32,34 , 36,37”
Accuracy of Heart Rate Watches: Implications for Weight Management
Wallen, M. P., Gomersall, S. R., Keating, S. E., Wisløff, U., & Coombes, J. S. (2016) · PLOS ONE · doi:10.1371/journal.pone.0154420 · Cited by 336
Xie, J., Wen, D., Liang, L., Jia, Y., Gao, L., & Lei, J. (2018) · JMIR mHealth and uHealth · doi:10.2196/mhealth.9754 · Cited by 310 · cited 2×
“Some of these studies also examined tracker accuracy during chores [31], outdoor activities [33], and resistance exercises [32,35,36], and 1 research team was solely interested in HR data accuracy during sedentary time [37].”
Nelson, B. W., & Allen, N. B. (2019) · JMIR mHealth and uHealth · doi:10.2196/10828 · Cited by 310 · cited 2×
“Comparing our results from the free-living phase with the results reported in other studies is problematic as, to our knowledge, there are only 2 studies that had a free-living element [38,39].”
Stahl, S. E., An, H.-S., Dinkel, D. M., Noble, J. M., & Lee, J.-M. (2016) · BMJ Open Sport & Exercise Medicine · doi:10.1136/bmjsem-2015-000106 · Cited by 276
Dooley, E. E., Golaszewski, N. M., & Bartholomew, J. B. (2017) · JMIR mHealth and uHealth · doi:10.2196/mhealth.7043 · Cited by 242
Validity of Wearable Activity Monitors during Cycling and Resistance Exercise
BOUDREAUX, B. D., HEBERT, E. P., HOLLANDER, D. B., WILLIAMS, B. M., CORMIER, C. L., NAQUIN, M. R., GILLAN, W. W., GUSEW, E. E., & KRAEMER, R. R. (2018) · Medicine & Science in Sports & Exercise · doi:10.1249/mss.0000000000001471 · Cited by 205 · cited 4×
“As highlighted in a recent study, there is no clear cutoff for what level of error would indicate adequate validity between measures [32].”
InfluentialThe effect of contacting force on photoplethysmographic signals
Teng, X. F., & Zhang, Y. T. (2004) · Physiological Measurement · doi:10.1088/0967-3334/25/5/020 · Cited by 171
Assessment of the Fitbit Charge 2 for monitoring heart rate
Benedetto, S., Caldato, C., Bazzan, E., Greenwood, D. C., Pensabene, V., & Actis, P. (2018) · PLOS ONE · doi:10.1371/journal.pone.0192691 · Cited by 149
Evaluation of wearable consumer heart rate monitors based on photopletysmography
Parak, J., & Korhonen, I. (2014) · 2014 36th Annual International Conference of the IEEE Engineering in Medicine and Biology Society · doi:10.1109/embc.2014.6944419 · Cited by 148
Validation of photoplethysmography as a method to detect heart rate during rest and exercise
Spierer, D. K., Rosen, Z., Litman, L. L., & Fujii, K. (2015) · Journal of Medical Engineering & Technology · doi:10.3109/03091902.2015.1047536 · Cited by 139 · cited 2×
“Some of these studies also examined tracker accuracy during chores [31], outdoor activities [33], and resistance exercises [32,35,36], and 1 research team was solely interested in HR data accuracy during sedentary time [37].”
Lee, I.-M., Shiroma, E. J., Evenson, K. R., Kamada, M., LaCroix, A. Z., & Buring, J. E. (2018) · Circulation · doi:10.1161/circulationaha.117.031300 · Cited by 138
Evaluating the Impact of Physical Activity Apps and Wearables: Interdisciplinary Review
McCallum, C., Rooksby, J., & Gray, C. M. (2018) · JMIR mhealth and uhealth · doi:10.2196/mhealth.9054 · Cited by 126 · cited 2×
“As such, researchers will increasingly make use of them [11,54].”
Gorny, A. W., Liew, S. J., Tan, C. S., & Müller-Riemenschneider, F. (2017) · JMIR mHealth and uHealth · doi:10.2196/mhealth.8233 · Cited by 94 · cited 2×
“Comparing our results from the free-living phase with the results reported in other studies is problematic as, to our knowledge, there are only 2 studies that had a free-living element [38,39].”
Self-citationSartor, F., Gelissen, J., van Dinther, R., Roovers, D., Papini, G. B., & Coppola, G. (2018) · BMC Sports Science, Medicine and Rehabilitation · doi:10.1186/s13102-018-0098-0 · Cited by 65 · cited 1×
“In addition, sample sizes were mostly small, with only few studies having more than 50 participants [22,28,40].”
Cited by
The impact of wearable technologies in health research: scoping review
Huhn, S., Axt, M., Gunga, H.-C., Maggioni, M. A., Munga, S., Obor, D., Sié, A., Boudo, V., Bunker, A., Sauerborn, R., et al. (2022) · JMIR mHealth and uHealth · doi:10.2196/34384 · Cited by 379
Mapping and Taking Stock of the Personal Informatics Literature
Epstein, D. A., Caldeira, C., Figueiredo, M. C., Lu, X., Silva, L. M., Williams, L., Lee, J. H., Li, Q., Ahuja, S., Chen, Q., et al. (2020) · Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies · doi:10.1145/3432231 · Cited by 218
Zhang, Y., Weaver, R. G., Armstrong, B., Burkart, S., Zhang, S., & Beets, M. W. (2020) · Journal of Sports Sciences · doi:10.1080/02640414.2020.1767348 · Cited by 88
Höller, I., Stenzel, J.-S., Rath, D., & Forkmann, T. (2021) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph18094893 · Cited by 27
Metadata
- Authors
- Müller, A. M., Wang, N. X., Yao, J., Tan, C. S., Low, I. C. C., Lim, N., Tan, J., Tan, A., & Müller-Riemenschneider, F.
- Venue
- JMIR mHealth and uHealth
- Publisher
- JMIR Publications Inc.
- Published
- 2019-10-02
- Volume
- 7
- Issue
- 10
- Pages
- e14120
- ISSN
- 2291-5222 (ISSN-L)
- OpenAlex
- W2959673803
- Cited by
- 58
- References
- 31
- FWCI
- 2.49
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.