Evaluation of wearable consumer heart rate monitors based on photopletysmography
Abstract
Wearable monitoring of heart rate (HR) during physical activity and exercising allows real time control of exercise intensity and training effect. Recently, technologies based on pulse plethysmography (PPG) have become available for personal health management for consumers. However, the accuracy of these monitors is poorly known which limits their application. In this study, we evaluated accuracy of two PPG based (wrist i.e. Mio Alpha vs forearm i.e. Schosche Rhythm) commercially available HR monitors during exercise. 21 healthy volunteers (15 male and 6 female) completed an exercise protocol which included sitting, lying, walking, running, cycling, and some daily activities involving hand movements. HR estimation was compared against values from the reference electrocardiogram (ECG) signal. The heart rate estimation reliability scores for <;5% accuracy against reference were following: mio Alpha 77,83% and Scosche Rhytm 76,29%. The estimated results indicate that performance of devices depends on various parameters, including specified activity, sensor type and device placement.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Smartwatches often emit insufficient light for accurate readings on darker-skinned users, leading to inconsistent results and potential misdiagnosis.
“Studies show that smartwatches often emit insufficient light for accurate readings on darker-skinned users, leading to inconsistent results and potential misdiagnosis.”
From Photoplethysmography in Diverse Skin Tones: Evaluating Bias in Smartwatch Health Monitoring (2025) · cites this paper as [21]
PPG sensors generate heart rate measurements by applying LEDs to measure skin-based light reflection through photodetectors that evaluate changes in intensity.
“PPG sensors generate heart rate measurements by applying LEDs to measure skin-based light reflection through photodetectors that evaluate changes in intensity [21].”
From Photoplethysmography in Diverse Skin Tones: Evaluating Bias in Smartwatch Health Monitoring (2025) · cites this paper as [21]
Socioeconomic disparities in access to smartwatches may interact with skin-tone-related bias, raising additional equity concerns.
“However, regional variations may exist, and socioeconomic disparities in access to these devices may further interact with skin-tone-related bias, raising additional equity concerns [17-23].”
From Photoplethysmography in Diverse Skin Tones: Evaluating Bias in Smartwatch Health Monitoring (2025) · cites this paper as [21]
These discrepancies undermine trust in wearable health devices, especially when inaccurate readings affect fitness tracking or miss critical signs like arrhythmias.
“These discrepancies undermine trust in wearable health devices, especially when inaccurate readings affect fitness tracking or miss critical signs like arrhythmias [21,22].”
From Photoplethysmography in Diverse Skin Tones: Evaluating Bias in Smartwatch Health Monitoring (2025) · cites this paper as [21]
Although most consumer-grade wearable devices are designed to measure heart or pulse rate rather than rhythm, their sensitivity and specificity for heart rate and arrhythmia detection are poorly defined, and there is limited information on their agreement with medical-grade lead-based ECG monitors.
“Although most of these devices are designed to measure heart or pulse rate rather than rhythm, the sensitivity and specificity for heart rate, let alone, arrhythmia detection, are poorly defined, and there is limited information on the agreement of these devices with medical-grade lead-based ECG monitors (Parak & Korhonen, 2014).”
From 2017 ISHNE-HRS expert consensus statement on ambulatory ECG and external cardiac monitoring/telemetry (2017) · cites this paper as Parak & Korhonen, 2014
Cites
Kubios HRV–heart rate variability analysis software.
Tarvainen, M. P., Niskanen, J.-P., Lipponen, J. A., Ranta-aho, P. O., & Karjalainen, P. A. (2014) · Computer Methods and Programs in Biomedicine · doi:10.1016/j.cmpb.2013.07.024 · Cited by 2,720 · see citing works
Heart Rate Variability ? A Historical Perspective
Billman, G. E. (2011) · Frontiers in Physiology · doi:10.3389/fphys.2011.00086 · Cited by 786 · see citing works
How accurate is pulse rate variability as an estimate of heart rate variability?
Schäfer, A., & Vagedes, J. (2013) · International Journal of Cardiology · doi:10.1016/j.ijcard.2012.03.119 · Cited by 661 · see citing works
Holter, N. J. (1961) · Science · doi:10.1126/science.134.3486.1214 · Cited by 566 · see citing works
Weippert, M., Kumar, M., Kreuzfeld, S., Arndt, D., Rieger, A., & Stoll, R. (2010) · European Journal of Applied Physiology · doi:10.1007/s00421-010-1415-9 · Cited by 302 · see citing works
Vanderlei, L. C. M., Silva, R. A., Pastre, C. M., de Azevedo, F. M., & de Godoy, M. F. (2008) · Brazilian Journal of Medical and Biological Research · doi:10.1590/s0100-879x2008005000039 · Cited by 296 · see citing works
Analysis of heart rate variability in the presence of ectopic beats using the heart timing signal
Mateo, J., & Laguna, P. (2003) · IEEE Transactions on Biomedical Engineering · doi:10.1109/tbme.2003.808831 · Cited by 287 · see citing works
Kingsley, M., Lewis, M. J., & Marson, R. E. (2005) · International Journal of Sports Medicine · doi:10.1055/s-2004-817878 · Cited by 230 · see citing works
Heart rate monitors: State of the art
Laukkanen, R. M. T., & Virtanen, P. K. (1998) · Journal of Sports Sciences · doi:10.1080/026404198366920 · Cited by 219 · see citing works
Validity of Seven Commercially Available Heart Rate Monitors
Terbizan, D. J., Dolezal, B. A., & Albano, C. B. (2002) · Measurement in Physical Education and Exercise Science · doi:10.1207/s15327841mpee0604_3 · Cited by 147 · see citing works
Porto, L. G. G., & Junqueira, L. F. (2008) · Pacing and Clinical Electrophysiology · doi:10.1111/j.1540-8159.2009.02175.x · Cited by 130 · see citing works
Kristiansen, J., Korshøj, M., Skotte, J. H., Jespersen, T., Søgaard, K., Mortensen, O. S., & Holtermann, A. (2011) · BioMedical Engineering OnLine · doi:10.1186/1475-925x-10-27 · Cited by 63 · see citing works
Validity of the Smarthealth Watch to Measure Heart Rate During Rest and Exercise
Lee, C. M., & Gorelick, M. (2011) · Measurement in Physical Education and Exercise Science · doi:10.1080/1091367x.2011.539089 · Cited by 42 · see citing works
A procedure for evaluating portable heart monitors
Born, D. G., Araujo, J., & Thomas, T. R. (1984) · Behavior Research Methods, Instruments, & Computers · doi:10.3758/bf03201041 · Cited by 2 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
Henriksen, A., Haugen Mikalsen, M., Woldaregay, A. Z., Muzny, M., Hartvigsen, G., Hopstock, L. A., & Grimsgaard, S. (2018) · Journal of Medical Internet Research · doi:10.2196/jmir.9157 · Cited by 542 · see citing works
Accuracy of Heart Rate Watches: Implications for Weight Management
Wallen, M. P., Gomersall, S. R., Keating, S. E., Wisløff, U., & Coombes, J. S. (2016) · PLOS ONE · doi:10.1371/journal.pone.0154420 · Cited by 336 · see citing works
Xie, J., Wen, D., Liang, L., Jia, Y., Gao, L., & Lei, J. (2018) · JMIR mHealth and uHealth · doi:10.2196/mhealth.9754 · Cited by 310 · see citing works
Nelson, B. W., & Allen, N. B. (2019) · JMIR mHealth and uHealth · doi:10.2196/10828 · Cited by 310 · see citing works
Steinberg, J. S., Varma, N., Cygankiewicz, I., Aziz, P., Balsam, P., Baranchuk, A., Cantillon, D. J., Dilaveris, P., Dubner, S. J., El-Sherif, N., et al. (2017) · Heart Rhythm · doi:10.1016/j.hrthm.2017.03.038 · Cited by 303 · see citing works
Stahl, S. E., An, H.-S., Dinkel, D. M., Noble, J. M., & Lee, J.-M. (2016) · BMJ Open Sport & Exercise Medicine · doi:10.1136/bmjsem-2015-000106 · Cited by 276 · see citing works
Guidelines for wrist-worn consumer wearable assessment of heart rate in biobehavioral research
Nelson, B. W., Low, C. A., Jacobson, N., Areán, P., Torous, J., & Allen, N. B. (2020) · npj Digital Medicine · doi:10.1038/s41746-020-0297-4 · Cited by 241 · see citing works
Cao, R., Azimi, I., Sarhaddi, F., Niela-Vilen, H., Axelin, A., Liljeberg, P., & Rahmani, A. M. (2022) · Journal of Medical Internet Research · doi:10.2196/27487 · Cited by 159 · see citing works
Wearable Devices for Precision Medicine and Health State Monitoring
Jeong, I. C., Bychkov, D., & Searson, P. C. (2019) · IEEE Transactions on Biomedical Engineering · doi:10.1109/tbme.2018.2871638 · Cited by 155 · see citing works
Assessment of the Fitbit Charge 2 for monitoring heart rate
Benedetto, S., Caldato, C., Bazzan, E., Greenwood, D. C., Pensabene, V., & Actis, P. (2018) · PLOS ONE · doi:10.1371/journal.pone.0192691 · Cited by 149 · see citing works
Falter, M., Budts, W., Goetschalckx, K., Cornelissen, V., & Buys, R. (2019) · JMIR mHealth and uHealth · doi:10.2196/11889 · Cited by 142 · see citing works
Chow, H.-W., & Yang, C.-C. (2020) · JMIR mHealth and uHealth · doi:10.2196/14707 · Cited by 140 · see citing works
“However, the accuracy might vary across brands [16,31] in terms of activity patterns or speed, exercise intensities [10,14,31], skin tone [10], room temperature [32], placement of sensors [29], or compression-induced and motion-induced artifacts [13,32-34].”
Comparison of Polar M600 Optical Heart Rate and ECG Heart Rate during Exercise
HORTON, J. F., STERGIOU, P., FUNG, T. S., & KATZ, L. (2017) · Medicine & Science in Sports & Exercise · doi:10.1249/mss.0000000000001388 · Cited by 79 · see citing works
Kleiman, E. M., Glenn, C. R., & Liu, R. T. (2019) · Journal of Clinical Child & Adolescent Psychology · doi:10.1080/15374416.2019.1666400 · Cited by 68 · see citing works
Scardulla, F., D’Acquisto, L., Colombarini, R., Hu, S., Pasta, S., & Bellavia, D. (2020) · Sensors · doi:10.3390/s20185052 · Cited by 72 · see citing works
Sartor, F., Gelissen, J., van Dinther, R., Roovers, D., Papini, G. B., & Coppola, G. (2018) · BMC Sports Science, Medicine and Rehabilitation · doi:10.1186/s13102-018-0098-0 · Cited by 65 · see citing works
Validation of a Photoplethysmographic Heart Rate Monitor: Polar OH1
Hermand, E., Cassirame, J., Ennequin, G., & Hue, O. (2019) · International Journal of Sports Medicine · doi:10.1055/a-0875-4033 · Cited by 59 · see citing works
Evaluating the accuracy of heart rate sensors based on photoplethysmography for in-the-wild analysis
Barrios, L., Oldrati, P., Santini, S., & Lutterotti, A. (2019) · Proceedings of the 13th EAI International Conference on Pervasive Computing Technologies for Healthcare · doi:10.1145/3329189.3329215 · Cited by 43 · see citing works
Herkert, C., Kraal, J. J., van Loon, E. M. A., van Hooff, M., & Kemps, H. M. C. (2019) · JMIR mHealth and uHealth · doi:10.2196/15045 · Cited by 19 · see citing works
A novel sensor for wrist based optical heart rate monitor
Mohapatra, P., Preejith, S. P., & Sivaprakasam, M. (2017) · 2017 IEEE International Instrumentation and Measurement Technology Conference (I2MTC) · doi:10.1109/i2mtc.2017.7969842 · Cited by 19 · see citing works
Congruent Accuracy of Wrist-worn Activity Trackers during Controlled and Free-living Conditions
Dondzila, C. J., Lewis, C., Lopez, J. R., & Parker, T. (2018) · International Journal of Exercise Science · doi:10.70252/ubbt6886 · Cited by 16 · see citing works
“No studies exist comparing the FB to the MF (to the authors’ knowledge), yet the MF performed on par with previous research on Mio devices (4, 20), and better than the Mio Alpha in the studies concurrently compared to the FB (24, 28).”
BackgroundMethodResultInfluentialPhotoplethysmography in Diverse Skin Tones: Evaluating Bias in Smartwatch Health Monitoring
Asif, S., AlSaafeen, A., Nadar, S., Nambiar, S., Dannawi, J., Korrapati, H., & Wilkhoo, H. S. (2025) · Cureus · doi:10.7759/cureus.94074 · Cited by 9 · see citing works
- Authors
- Parak, J., & Korhonen, I.
- Affiliations
- Tampere University of Technology (FI)
- ORCID
- Korhonen, Ilkka
- Venue
- 2014 36th Annual International Conference of the IEEE Engineering in Medicine and Biology Society
- Publisher
- IEEE
- Published
- 2014-08
- Volume
- 2014
- Pages
- 3670-3673
- ISSN
- 2375-7477 (ISSN-L)
- OpenAlex
- W2332318080
- Cited by
- 148
- References
- 14
- Citations by year
- 2026: 5 · 2025: 5 · 2024: 4 · 2023: 18 · 2022: 10 · 2021: 12 · 2020: 13 · 2019: 24 · 2018: 25 · 2017: 16 · 2016: 12 · 2015: 4
- FWCI
- 20.72
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC) (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Physical Sciences › Engineering › Biomedical Engineering › Non-Invasive Vital Sign Monitoring
- Health Sciences › Medicine › Cardiology and Cardiovascular Medicine › Heart Rate Variability and Autonomic Control
- Health Sciences › Medicine › Complementary and alternative medicine › Cardiovascular and exercise physiology
- Keywords
- wearable heart rate monitor, photoplethysmography, heart rate accuracy, exercise monitoring, wrist-worn sensors, sensor placement, physical activity
- MeSH terms
- Adult, Electrocardiography, Exercise Test, Female, Heart Rate, Humans, Male, Monitoring, Physiologic, Running, Wrist, Walking, Photoplethysmography, Healthy Volunteers
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review