The DOI matches its Crossref record; 14 of the 14 references it cites were found in a registry or an index.
Validation of the Apple Watch for Heart Rate Variability Measurements during Relax and Mental Stress in Healthy Subjects
Open accessAbstract
Heart rate variability (HRV) analysis is a noninvasive tool widely used to assess autonomic nervous system state. The market for wearable devices that measure the heart rate has grown exponentially, as well as their potential use for healthcare and wellbeing applications. Still, there is a lack of validation of these devices. In particular, this work aims to validate the Apple Watch in terms of HRV derived from the RR interval series provided by the device, both in temporal (HRM (mean heart rate), SDNN, RMSSD and pNN50) and frequency (low and high frequency powers, LF and HF) domain. For this purpose, a database of 20 healthy volunteers subjected to relax and a mild cognitive stress was used. First, RR interval series provided by Apple Watch were validated using as reference the RR interval series provided by a Polar H7 using Bland-Altman plots and reliability and agreement coefficients. Then, HRV parameters derived from both RR interval series were compared and their ability to identify autonomic nervous system (ANS) response to mild cognitive stress was studied. Apple Watch measurements presented very good reliability and agreement (>0.9). RR interval series provided by Apple Watch contain gaps due to missing RR interval values (on average, 5 gaps per recording, lasting 6.5 s per gap). Temporal HRV indices were not significantly affected by the gaps. However, they produced a significant decrease in the LF and HF power. Despite these differences, HRV indices derived from the Apple Watch RR interval series were able to reflect changes induced by a mild mental stress, showing a significant decrease of HF power as well as RMSSD in stress with respect to relax, suggesting the potential use of HRV measurements derived from Apple Watch for stress monitoring.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
STATISTICAL METHODS FOR ASSESSING AGREEMENT BETWEEN TWO METHODS OF CLINICAL MEASUREMENT
Martin Bland, J., & Altman, D. (1986) · The Lancet · doi:10.1016/s0140-6736(86)90837-8 · Cited by 47,965
A concordance correlation coefficient to evaluate reproducibility.
Lin, L. I.-K. (1989) · Biometrics · doi:10.2307/2532051 · Cited by 8,785 · cited 2×
“First, Lin’s concordance correlation coefficient (CCC) determines how far the observed data deviate from the line of perfect concordance line at 45° on a square axis scatter plot [26].”
MethodThayer, J. F., Åhs, F., Fredrikson, M., Sollers, J. J., & Wager, T. D. (2012) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2011.11.009 · Cited by 3,224 · cited 1×
“Its analysis and use are becoming increasingly common, since it is sensitive to both physiological and psychological changes [2].”
BackgroundStress and Heart Rate Variability: A Meta-Analysis and Review of the Literature
Kim, H.-G., Cheon, E.-J., Bai, D.-S., Lee, Y. H., & Koo, B.-H. (2018) · Psychiatry Investigation · doi:10.30773/pi.2017.08.17 · Cited by 2,308
Heart rate variability as a transdiagnostic biomarker of psychopathology
Beauchaine, T. P., & Thayer, J. F. (2015) · International Journal of Psychophysiology · doi:10.1016/j.ijpsycho.2015.08.004 · Cited by 870
Cardiac vagal tone: A physiological index of stress
Porges, S. W. (1995) · Neuroscience & Biobehavioral Reviews · doi:10.1016/0149-7634(94)00066-a · Cited by 870 · cited 1×
“no gaps in the Polar H7 recordings), suggesting the inhibition of parasympathetic stimulation, as already reported in numerous studies [8,39].”
ResultHeart Rate Variability ? A Historical Perspective
Billman, G. E. (2011) · Frontiers in Physiology · doi:10.3389/fphys.2011.00086 · Cited by 786
Shcherbina, A., Mattsson, C., Waggott, D., Salisbury, H., Christle, J., Hastie, T., Wheeler, M., & Ashley, E. (2017) · Journal of Personalized Medicine · doi:10.3390/jpm7020003 · Cited by 625
Plews, D. J., Laursen, P. B., Stanley, J., Kilding, A. E., & Buchheit, M. (2013) · Sports Medicine · doi:10.1007/s40279-013-0071-8 · Cited by 617
Accuracy of Heart Rate Watches: Implications for Weight Management
Wallen, M. P., Gomersall, S. R., Keating, S. E., Wisløff, U., & Coombes, J. S. (2016) · PLOS ONE · doi:10.1371/journal.pone.0154420 · Cited by 336 · cited 1×
“These results agree with other studies for Apple Watch [17,18] and other heart rate watches [13,16,19].”
Result
Cited by
Hickey, B. A., Chalmers, T., Newton, P., Lin, C.-T., Sibbritt, D., McLachlan, C. S., Clifton-Bligh, R., Morley, J., & Lal, S. (2021) · Sensors · doi:10.3390/s21103461 · Cited by 328
Li, K., Cardoso, C., Moctezuma-Ramirez, A., Elgalad, A., & Perin, E. (2023) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph20247146 · Cited by 160
“…differ in the error rates between methodologies [58] Other veri fi cation studies have been conducted for brands such as Oura [59], Whoop [60], and Apple Watch [38], and for assessing the use of di ff erent apps to acquire camera-based HRV, including Well-tory [61] and HRV4 training [62].”
BackgroundCao, R., Azimi, I., Sarhaddi, F., Niela-Vilen, H., Axelin, A., Liljeberg, P., & Rahmani, A. M. (2022) · Journal of Medical Internet Research · doi:10.2196/27487 · Cited by 159
Taj-Eldin, M., Ryan, C., O’Flynn, B., & Galvin, P. (2018) · Sensors · doi:10.3390/s18124271 · Cited by 142
Siddi, S., Bailon, R., Giné-Vázquez, I., Matcham, F., Lamers, F., Kontaxis, S., Laporta, E., Garcia, E., Lombardini, F., Annas, P., et al. (2023) · Psychological Medicine · doi:10.1017/s0033291723001034 · Cited by 31
Electroencephalographic Biomarkers of Relaxation: A Systematic Review and Meta-analysis
Sugimoto, K., Kurashiki, H., Xu, Y., Takemi, M., & Amano, K. (2026) · Journal of Cognitive Neuroscience · doi:10.1162/jocn.a.2392 · Cited by 10
Modeling health risks using neural network ensembles
Smith, B. M., Criminisi, A., Sorek, N., Harari, Y., Sood, N., & Heymsfield, S. B. (2024) · PLOS ONE · doi:10.1371/journal.pone.0308922 · Cited by 5
Metadata
- Authors
- Hernando, D., Roca, S., Sancho, J., Alesanco, Á., & Bailón, R.
- Venue
- Sensors
- Publisher
- MDPI AG
- Published
- 2018-08-10
- Volume
- 18
- Issue
- 8
- Pages
- 2619
- ISSN
- 1424-8220 (ISSN-L)
- OpenAlex
- W2885403181
- Cited by
- 222
- References
- 14
- FWCI
- 11.01
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.