Accuracy of consumer-level and research-grade activity trackers in ambulatory settings in older adults
Open accessAbstract
Wrist-worn activity trackers have experienced a tremendous growth lately and studies on the accuracy of mainstream trackers used by older adults are needed. This study explores the performance of six trackers (Fitbit Charge2, Garmin VivoSmart HR+, Philips Health Watch, Withings Pulse Ox, ActiGraph GT9X-BT, Omron HJ-72OITC) for estimating: steps, travelled distance, and heart-rate measurements for a cohort of older adults. Eighteen older adults completed a structured protocol involving walking tasks, simulated household activities, and sedentary activities. Less standardized activities were also included, such as: dusting, using a walking aid, or playing cards, in order to simulate real-life scenarios. Wrist-mounted and chest/waist-mounted devices were used. Gold-standards included treadmill, ECG-based chest strap, direct observation or video recording according to the activity and parameter. Every tracker showed a decreasing accuracy with slower walking speed, which resulted in a significant step under-counting. A large mean absolute percentage error (MAPE) was found for every monitor at slower walking speeds with the lowest reported MAPE at 2 km/h being 7.78%, increasing to 20.88% at 1.5 km/h, and 44.53% at 1 km/h. During household activities, the MAPE climbing up/down-stairs ranged from 8.38-19.3% and 10.06-19.01% (dominant and non-dominant arm), respectively. Waist-worn devices showed a more uniform performance. However, unstructured activities (e.g. dusting, playing cards), and using a walking aid represent a challenge for all wrist-worn trackers as evidenced by large MAPE (> 57.66% for dusting, > 67.32% when using a walking aid). Poor performance in travelled distance estimation was also evident during walking at low speeds and climbing up/down-stairs (MAPE > 71.44% and > 48.3%, respectively). Regarding heart-rate measurement, there was no significant difference (p-values > 0.05) in accuracy between trackers placed on the dominant or non-dominant arm. Concordant with existing literature, while the mean error was limited (between -3.57 bpm and 4.21 bpm), a single heart-rate measurement could be underestimated up to 30 beats-per-minute. This study showed a number of limitations of consumer-level wrist-based activity trackers for older adults. Therefore caution is required when used, in healthcare or in research settings, to measure activity in older adults.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In healthy older adults, Fitbit Charge 2 showed good reliability during treadmill and overground bouts and poor reliability during hand movement tasks such as dusting [58].
“In the examination of interdevice reliability in healthy older adults, Fitbit Charge 2 showed good reliability during treadmill and overground bouts and poor reliability during hand movement tasks such as dusting [58].”
From Reliability and Validity of Commercially Available Wearable Devices for Measuring Steps, Energy Expenditure, and Heart Rate: Systematic Review (2020) · cites this paper as [58]
Three studies (23 comparisons) examined interdevice reliability for heart rate, with analyzed sample sizes ranging from 13 to 21.
“Three studies (23 comparisons) examined interdevice reliability for heart rate [24,26,58], with analyzed sample sizes ranging from 13 [24] to 21 [26].”
From Reliability and Validity of Commercially Available Wearable Devices for Measuring Steps, Energy Expenditure, and Heart Rate: Systematic Review (2020) · cites this paper as [58]
During the same tasks, Garmin Vivosmart HR+ showed good reliability during all tasks and had narrower limits of agreement than Fitbit.
“During the same tasks, Garmin Vivosmart HR+ showed good reliability during all tasks and had narrower limits of agreement than Fitbit.”
From Reliability and Validity of Commercially Available Wearable Devices for Measuring Steps, Energy Expenditure, and Heart Rate: Systematic Review (2020) · cites this paper as [58]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Wearable Sensors for Human Activity Monitoring: A Review
Mukhopadhyay, S. C. (2015) · IEEE Sensors Journal · doi:10.1109/jsen.2014.2370945 · Cited by 1,401 · see citing works
Systematic review of the validity and reliability of consumer-wearable activity trackers
Evenson, K. R., Goto, M. M., & Furberg, R. D. (2015) · International Journal of Behavioral Nutrition and Physical Activity · doi:10.1186/s12966-015-0314-1 · Cited by 1,232 · see citing works
Accuracy of Fitbit Devices: Systematic Review and Narrative Syntheses of Quantitative Data
Feehan, L. M., Geldman, J., Sayre, E. C., Park, C., Ezzat, A. M., Yoo, J. Y., Hamilton, C. B., & Li, L. C. (2018) · JMIR mHealth and uHealth · doi:10.2196/10527 · Cited by 616 · see citing works
Henriksen, A., Haugen Mikalsen, M., Woldaregay, A. Z., Muzny, M., Hartvigsen, G., Hopstock, L. A., & Grimsgaard, S. (2018) · Journal of Medical Internet Research · doi:10.2196/jmir.9157 · Cited by 542 · see citing works
Reliability and validity of ten consumer activity trackers
Kooiman, T. J. M., Dontje, M. L., Sprenger, S. R., Krijnen, W. P., van der Schans, C. P., & de Groot, M. (2015) · BMC Sports Science, Medicine and Rehabilitation · doi:10.1186/s13102-015-0018-5 · Cited by 360 · see citing works
Xie, J., Wen, D., Liang, L., Jia, Y., Gao, L., & Lei, J. (2018) · JMIR mHealth and uHealth · doi:10.2196/mhealth.9754 · Cited by 310 · see citing works
Behavior Change Techniques Present in Wearable Activity Trackers: A Critical Analysis
Mercer, K., Li, M., Giangregorio, L., Burns, C., & Grindrod, K. (2016) · JMIR mHealth and uHealth · doi:10.2196/mhealth.4461 · Cited by 304 · see citing works
Twenty-four Hours of Sleep, Sedentary Behavior, and Physical Activity with Nine Wearable Devices
Rosenberger, M. E., Buman, M. P., Haskell, W. L., McConnell, M. V., & Carstensen, L. L. (2015) · Medicine & Science in Sports & Exercise · doi:10.1249/mss.0000000000000778 · Cited by 298 · see citing works
Stahl, S. E., An, H.-S., Dinkel, D. M., Noble, J. M., & Lee, J.-M. (2016) · BMJ Open Sport & Exercise Medicine · doi:10.1136/bmjsem-2015-000106 · Cited by 276 · see citing works
Sensors and Functionalities of Non-Invasive Wrist-Wearable Devices: A Review
Kamišalić, A., Fister, I., Turkanović, M., & Karakatič, S. (2018) · Sensors · doi:10.3390/s18061714 · Cited by 272 · see citing works
Ancillao, A., Tedesco, S. A., Barton, J. J., & O’Flynn, B. (2018) · Sensors · doi:10.3390/s18082564 · Cited by 244 · see citing works
Self-citationReliability and Validity of Ten Consumer Activity Trackers Depend on Walking Speed
Fokkema, T., Kooiman, T. J. M., Krijnen, W. P., van der Schans, C. P., & de Groot, M. (2016) · Medicine & Science in Sports & Exercise · doi:10.1249/mss.0000000000001146 · Cited by 212 · see citing works
Validity of Consumer-Based Physical Activity Monitors for Specific Activity Types
Nelson, M. B., Kaminsky, L. A., Dickin, D. C., & Montoye, A. H. K. (2016) · Medicine & Science in Sports & Exercise · doi:10.1249/mss.0000000000000933 · Cited by 206 · see citing works
Current State of Commercial Wearable Technology in Physical Activity Monitoring 2015-2017
Bunn, J., Navalta, J. W., Fountaine, C. J., & Reece, J. (2018) · International Journal of Exercise Science · doi:10.70252/njqx2719 · Cited by 194 · see citing works
Assessment of the Fitbit Charge 2 for monitoring heart rate
Benedetto, S., Caldato, C., Bazzan, E., Greenwood, D. C., Pensabene, V., & Actis, P. (2018) · PLOS ONE · doi:10.1371/journal.pone.0192691 · Cited by 149 · see citing works
Straiton, N., Alharbi, M., Bauman, A., Neubeck, L., Gullick, J., Bhindi, R., & Gallagher, R. (2018) · Maturitas · doi:10.1016/j.maturitas.2018.03.016 · Cited by 147 · see citing works
Wahl, Y., Düking, P., Droszez, A., Wahl, P., & Mester, J. (2017) · Frontiers in Physiology · doi:10.3389/fphys.2017.00725 · Cited by 133 · see citing works
How valid are wearable physical activity trackers for measuring steps?
An, H., Jones, G. C., Kang, S., Welk, G. J., & Lee, J. M. (2016) · European Journal of Sport Science · doi:10.1080/17461391.2016.1255261 · Cited by 131 · see citing works
Older Adults’ Acceptance of Activity Trackers
Preusse, K. C., Mitzner, T. L., Fausset, C. B., & Rogers, W. A. (2017) · Journal of Applied Gerontology · doi:10.1177/0733464815624151 · Cited by 128 · see citing works
Tedesco, S. A., Barton, J. J., & O’Flynn, B. (2017) · Sensors · doi:10.3390/s17061277 · Cited by 126 · see citing works
Self-citationValidity of FitBit, Jawbone UP, Nike+ and other wearable devices for level and stair walking
Huang, Y., Xu, J., Yu, B., & Shull, P. B. (2016) · Gait & Posture · doi:10.1016/j.gaitpost.2016.04.025 · Cited by 122 · see citing works
Mobile and wearable technologies in healthcare for the ageing population
Malwade, S., Syed-Abdul, S., Uddin, M., Nursetyo, A. A., Fernández-Luque, L., Zhu, X., Cilliers, L., Wong, C.-P., Bamidis, P. D., & Li, Y. (2018) · Computer Methods and Programs in Biomedicine · doi:10.1016/j.cmpb.2018.04.026 · Cited by 122 · see citing works
Chu, A. H. Y., Ng, S. H.-X., Paknezhad, M., Gauterin, A., Koh, D. S. Q., Brown, M. S., & Müller‐Riemenschneider, F. (2017) · PLoS ONE · doi:10.1371/journal.pone.0172535 · Cited by 121 · see citing works
Imboden, M. T., Nelson, M. B., Kaminsky, L. A., & Montoye, A. H. K. (2017) · British Journal of Sports Medicine · doi:10.1136/bjsports-2016-096990 · Cited by 119 · see citing works
Thomson, E. A., Nuss, K. J., Comstock, A., Reinwald, S., Blake, S., Pimentel, R. E., Tracy, B. L., & Li, K. (2019) · Journal of Sports Sciences · doi:10.1080/02640414.2018.1560644 · Cited by 112 · see citing works
Floegel, T. A., Flórez-Pregonero, A., Hekler, E. B., & Buman, M. P. (2016) · The Journals of Gerontology Series A · doi:10.1093/gerona/glw098 · Cited by 108 · see citing works
Gorny, A. W., Liew, S. J., Tan, C. S., & Müller-Riemenschneider, F. (2017) · JMIR mHealth and uHealth · doi:10.2196/mhealth.8233 · Cited by 94 · see citing works
Accuracy of Wristband Activity Monitors during Ambulation and Activities
CHEN, M.-D., KUO, C.-C., PELLEGRINI, C. A., & HSU, M.-J. (2016) · Medicine & Science in Sports & Exercise · doi:10.1249/mss.0000000000000984 · Cited by 90 · see citing works
Gualtieri, L. N., Rosenbluth, S., & Phillips, J. (2016) · JMIR Research Protocols · doi:10.2196/resprot.6534 · Cited by 86 · see citing works
Alinia, P., Cain, C. R., Fallahzadeh, R., Shahrokni, A., Cook, D. J., & Ghasemzadeh, H. G. (2017) · JMIR mhealth and uhealth · doi:10.2196/mhealth.6321 · Cited by 75 · see citing works
Burton, E., Hill, K., Lautenschlager, N. T., Thøgersen‐Ntoumani, C., Lewin, G. F., Boyle, E., & Howie, E. K. (2018) · BMC Geriatrics · doi:10.1186/s12877-018-0793-4 · Cited by 71 · see citing works
Sartor, F., Gelissen, J., van Dinther, R., Roovers, D., Papini, G. B., & Coppola, G. (2018) · BMC Sports Science, Medicine and Rehabilitation · doi:10.1186/s13102-018-0098-0 · Cited by 65 · see citing works
Validity of wrist-worn consumer products to measure heart rate and energy expenditure
Thiebaud, R. S., Funk, M. D., Patton, J. C., Massey, B. L., Shay, T. E., Schmidt, M. G., & Giovannitti, N. (2018) · Digital Health · doi:10.1177/2055207618770322 · Cited by 56 · see citing works
The bit doesn’t fit: Evaluation of a commercial activity-tracker at slower walking speeds
Wong, C. K., Mentis, H. M., & Kuber, R. (2018) · Gait & Posture · doi:10.1016/j.gaitpost.2017.10.010 · Cited by 46 · see citing works
Comparison of ActiGraph GT3X+ and StepWatch Step Count Accuracy in Geriatric Rehabilitation Patients
Webber, S. C., & John, P. D. S. (2016) · Journal of Aging and Physical Activity · doi:10.1123/japa.2015-0234 · Cited by 39 · see citing works
Bock, A. J., Eisengerich, A. B., Sharapov, D., & George, G. (2015) · SAGE Open · doi:10.1177/2158244015586812 · Cited by 37 · see citing works
A Comparison of Accelerometer Accuracy in Older Adults
Phillips, L. J., Petroski, G. F., & Markis, N. E. (2015) · Research in Gerontological Nursing · doi:10.3928/19404921-20150429-03 · Cited by 34 · see citing works
Human activity recognition for emergency first responders via body-worn inertial sensors
Scheurer, S., Tedesco, S., Brown, K. N., et al. (2017) · IEEE International Conference on Wearable and Implantable Body Sensor Networks (BSN) · doi:10.1109/bsn.2017.7935994 · Cited by 33 · see citing works
Self-citationAccuracy of Consumer Monitors for Estimating Energy Expenditure and Activity Type
WOODMAN, J. A., CROUTER, S. E., BASSETT, D. R., FITZHUGH, E. C., & BOYER, W. R. (2017) · Medicine & Science in Sports & Exercise · doi:10.1249/mss.0000000000001090 · Cited by 29 · see citing works
Step-Count Accuracy of 3 Motion Sensors for Older and Frail Medical Inpatients
McCullagh, R., Dillon, C. B., O'Connell, A. M. U., Horgan, F., & Timmons, S. (2016) · Archives of Physical Medicine and Rehabilitation · doi:10.1016/j.apmr.2016.08.476 · Cited by 27 · see citing works
Self-citationSayed, C. A., Vinches, L., & Hallé, S. (2017) · E-Health Telecommunication Systems and Networks · doi:10.4236/etsn.2017.62002 · Cited by 26 · see citing works
Novel Smart Glove Technology as a Biomechanical Monitoring Tool
O’Flynn, B., Sachez, J., Tedesco, S., et al. (2015) · Arrow@dit (Dublin Institute of Technology) · Cited by 25 · see citing works
Self-citationAssessment of step accuracy using the Consumer Technology Association standard
Bunn, J. A., Jones, C., Oliviera, A., & Webster, M. J. (2018) · Journal of Sports Sciences · doi:10.1080/02640414.2018.1491941 · Cited by 23 · see citing works
Stahl, S. T., & Insana, S. (2013) · Journal of Health Psychology · doi:10.1177/1359105313490771 · Cited by 21 · see citing works
Perceptions, Expectations, and Informal Supports Influence Exercise Activity in Frail Older Adults
Broderick, L., McCullagh, R., White, E. B., et al. (2015) · SAGE Open · doi:10.1177/2158244015580850 · Cited by 19 · see citing works
Wrist-Worn Physical Activity Trackers Tend To Underestimate Steps During Walking
Sears, T., Alvalos, E., Lawson, S., McAlister, I. P., Eschbach, L. C., & Bunn, J. A. (2017) · International journal of exercise science · doi:10.70252/yjjp1345 · Cited by 19 · see citing works
Validity and Reliability Evaluation of Four Commercial Activity Trackers' Step Counting Performance
Tophøj, K. H., Petersen, M. G., Sæbye, C., Baad-Hansen, T., & Wagner, S. (2018) · Telemedicine and e-Health · doi:10.1089/tmj.2017.0264 · Cited by 18 · see citing works
Walking Parameters Estimation Based on a Wrist-Mounted Inertial Sensor for a Walker User
Duong, H. T., & Suh, Y. S. (2017) · IEEE Sensors Journal · doi:10.1109/jsen.2017.2658618 · Cited by 16 · see citing works
Wearable Electronics Sensors : For Safe and Healthy Living
Mukhopadhyay, S. C. (2015) · Cited by 15 · see citing works
Tedesco, S., Urru, A., Clifford, A. M., et al. (2016) · Procedia Engineering · doi:10.1016/j.proeng.2016.06.215 · Cited by 13 · see citing works
Self-citationPerformance analysis of walking of 10,000 regular users of a connected activity tracker
Hello, C. L., Trombert, B., Morel, A., Chieh, A. Y., Brouard, B., & Boissier, C. (2018) · JMV-Journal de Médecine Vasculaire · doi:10.1016/j.jdmv.2018.04.001 · Cited by 11 · see citing works
Gualtieri, L. N., Rosenbluth, S., & Phillips, J. (2016) · Iproceedings · doi:10.2196/iproc.6245 · Cited by 8 · see citing works
Sears, T., Alvalos, E., Lawson, S., McAlister, I. P., Eschbach, L. C., & Bunn, J. A. (2017) · International journal of exercise science · Cited by 8 · see citing works
Tedesco, S. A., Sica, M., Garbay, T., Barton, J. J., & OrFlynn, B. (2018) · IEEE International Conference on Pervasive Computing and Communications Workshops (PerCom Workshops) · doi:10.1109/percomw.2018.8480386 · Cited by 4 · see citing works
Self-citation
Flagged first, then by citations
Cited by
Sorted by citations
Fuller, D., Colwell, E., Low, J., Orychock, K., Tobin, M. A., Simango, B., Buote, R., Van Heerden, D., Luan, H., Cullen, K., et al. (2020) · JMIR mHealth and uHealth · doi:10.2196/18694 · Cited by 715 · see citing works
Home monitoring in interstitial lung diseases
Wijsenbeek, M. S., Moor, C. C., Johannson, K. A., Jackson, P. D., Khor, Y. H., Kondoh, Y., Rajan, S. K., Tabaj, G. C., Varela, B. E., van der Wal, P., et al. (2023) · The Lancet Respiratory Medicine · doi:10.1016/s2213-2600(22)00228-4 · Cited by 98 · see citing works
Jensen, M. T., Treskes, R. W., Caiani, E. G., Casado-Arroyo, R., Cowie, M. R., Dilaveris, P., Duncker, D., Di Rienzo, M., Frederix, I., De Groot, N., et al. (2021) · European Heart Journal - Digital Health · doi:10.1093/ehjdh/ztab011 · Cited by 93 · see citing works
Zhang, Y., Weaver, R. G., Armstrong, B., Burkart, S., Zhang, S., & Beets, M. W. (2020) · Journal of Sports Sciences · doi:10.1080/02640414.2020.1767348 · Cited by 88 · see citing works
The role of wearables in heart failure
Singhal, A., & Cowie, M. R. (2020) · Current Heart Failure Reports · doi:10.1007/s11897-020-00467-x · Cited by 85 · see citing works
Validity of heart rate measurements in wrist-based monitors across skin tones during exercise
Hung, S. H., Serwa, K., Rosenthal, G., & Eng, J. J. (2025) · PLOS ONE · doi:10.1371/journal.pone.0318724 · Cited by 21 · see citing works
- Authors
- Tedesco, S., Sica, M., Ancillao, A., Timmons, S., Barton, J., & O’Flynn, B.
- Affiliations
- University College Cork (IE)
- Corresponding author
- Tedesco, Salvatore
- Venue
- PLOS ONE
- Publisher
- Public Library of Science (PLoS)
- Published
- 2019-05-21
- Volume
- 14
- Issue
- 5
- Pages
- e0216891
- ISSN
- 1932-6203 (ISSN-L)
- PMC
- PMC6529154
- OpenAlex
- W2946778292
- Cited by
- 116
- References
- 54
- Citations by year
- 2026: 8 · 2025: 10 · 2024: 13 · 2023: 18 · 2022: 17 · 2021: 25 · 2020: 23 · 2019: 2
- FWCI
- 11.48
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- PLoS ONE (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- Arrow@dit (Dublin Institute of Technology) (acceptedVersion)
- Lirias (KU Leuven) (submittedVersion, other-oa)
- Cork Open Research Archive (University College Cork, Ireland) (submittedVersion, cc-by)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Figshare (submittedVersion, cc-by)
- Funders
- H2020 Societal Challenges (689996)
- Science Foundation Ireland (13/RC/2077)
- Interreg (SenDOC)
- Topics
- Health Sciences › Medicine › Physiology › Physical Activity and Health
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Context-Aware Activity Recognition Systems
- Physical Sciences › Engineering › Biomedical Engineering › Non-Invasive Vital Sign Monitoring
- Keywords
- wearable activity trackers, older adults, device accuracy, step counting, distance estimation, heart rate monitoring, walking speed, stair climbing, housework, sedentary activity, walking aids, wrist-worn devices, ambulatory monitoring, Fitbit, Garmin, ActiGraph, Omron, ActiGraph GT9X
- MeSH terms
- Wearable Electronic Devices, Activities of Daily Living, Aged, Exercise Test, Female, Heart Rate, Humans, Male, Video Recording, Walking
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review