The DOI matches its Crossref record; 79 of the 79 references it cites were found in a registry or an index; 2 of the 99 sources its claims cite were checked for support.
Guidelines for wrist-worn consumer wearable assessment of heart rate in biobehavioral research
Open accessAbstract
Researchers have increasingly begun to use consumer wearables or wrist-worn smartwatches and fitness monitors for measurement of cardiovascular psychophysiological processes related to mental and physical health outcomes. These devices have strong appeal because they allow for continuous, scalable, unobtrusive, and ecologically valid data collection of cardiac activity in “big data” studies. However, replicability and reproducibility may be hampered moving forward due to the lack of standardization of data collection and processing procedures, and inconsistent reporting of technological factors (e.g., device type, firmware versions, and sampling rate), biobehavioral variables (e.g., body mass index, wrist dominance and circumference), and participant demographic characteristics, such as skin tone, that may influence heart rate measurement. These limitations introduce unnecessary noise into measurement, which can cloud interpretation and generalizability of findings. This paper provides a brief overview of research using commercial wearable devices to measure heart rate, reviews literature on device accuracy, and outlines the challenges that non-standardized reporting pose for the field. We also discuss study design, technological, biobehavioral, and demographic factors that can impact the accuracy of the passive sensing of heart rate measurements, and provide guidelines and corresponding checklist handouts for future study data collection and design, data cleaning and processing, analysis, and reporting that may help ameliorate some of these barriers and inconsistencies in the literature.
Overview
AI snapshot
Written from the paper’s full text.
TL;DR
This paper reviews the use of wrist-worn consumer wearables for heart rate measurement in biobehavioral research and argues that lack of standardized data collection, processing, and reporting threatens reproducibility and generalizability. It provides two reporting checklists covering study design, technological factors, participant characteristics, data cleaning, analysis, and transparency.
Key findings
- Wearables using photoplethysmography (PPG) can provide acceptable heart rate accuracy for research, especially with aggregated data and outlier removal, but not for medical settings; devices slightly underestimate absolute HR versus ECG by −0.9 to −7.2 bpm, with Apple Watch at −1.3 bpm and Fitbit at −9.3 bpm.
- Error ranges were 1.20–6.70% for Apple Watch models and 2.38–21.36% for Fitbit models; any single real-time HR observation can deviate substantially from ECG, even when summary statistics are accurate.
- Between 2008 and 2018, there was a 580% increase in articles containing “wearable” and “heart rate.”
- Accuracy is influenced by motion artifacts and activity, with absolute error during activity reported as 30% higher than at rest; darker skin tone and tattoos can reduce green-light PPG accuracy, and larger wrist circumference or higher BMI are associated with reduced accuracy in some but not all studies.
Methods
- Narrative review and guideline paper; no primary data collection, systematic review, or meta-analysis is described.
- Synthesizes literature on commercial wrist-worn wearable HR accuracy and factors affecting measurement, focusing mainly on Apple Watch and Fitbit while noting Garmin, Samsung, and Microsoft.
- Proposes two checklists (Tables 2 and 3) for descriptive reporting and potential covariates, and recommends open science practices such as preregistration, open code, and open data.
Limitations
- The paper states that the field lacks metadata standards and consistent reporting of device type, firmware, sampling rate, biobehavioral variables, and demographic characteristics, which introduces noise and limits reproducibility and generalizability.
- It states that accuracy evidence is mixed for activity intensity, skin tone, BMI, and wrist circumference, and that proprietary algorithms and lack of raw data prevent standardized processing.
- Evident from the text: this is a narrative review without a systematic search or meta-analysis, and the proposed checklists are not empirically validated in the paper.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
51 Not checked yet · 26 Own interpretation · 14 No basis given · 2 Supported
Every source the paper cites for this claim was checked and supports it.
In the paper
“In addition, research has not always reported participant biological sex, but research has found higher device error in males compared to females42, indicating that participant biological sex should be collected and possibly controlled.”
§ Guidelines for wrist-worn consumer wearable assessment of heart rate in biobehavioral research > Study protocol design and data collection: addressing design, biobehavioral, and demographic issues that can influence reproducibility and replicability > Biobehavioral and demographic data
What the sources say
- Supportedcites [42] Shcherbina, A. et al. Accuracy in wrist-worn, sensor-based measurements of heart rate and energy expenditure in a diverse cohort. J. Personalized Med. 7, 3 (2017). source
Results §3.3 reports significantly higher heart-rate measurement error for males than females across the devices tested. It also reports that males had, on average, 4% higher heart-rate error across devices and tasks. (LLM, conf=0.94)
plaincorrelational- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“These limitations introduce unnecessary noise into measurement, which can cloud interpretation and generalizability of findings.”
§ Guidelines for wrist-worn consumer wearable assessment of heart rate in biobehavioral research > Abstract
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: unclear — It is unclear whether it could be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
None of the sources cited for this claim have been checked yet.
In the paper
“Cardiac activity therefore may be a biological factor that serves as a mechanism linking mood and anxiety disorders with cardiovascular and metabolic risk and mortality14,15.”
§ Guidelines for wrist-worn consumer wearable assessment of heart rate in biobehavioral research > Heart rate research in psychology and medicine
What the sources say
- Not checked yetcites [14] Kiecolt-Glaser, J. K. & Wilson, S. J. Psychiatric disorders, morbidity, and mortality: tracing mechanistic pathways to accelerated aging. Psychosom. Med. 78, 772–775 (2016). source
- Not checked yetcites [15] Nemeroff, C. B. & Goldschmidt-Clermont, P. J. Heartache and heartbreak–the link between depression and cardiovascular disease. Nat. Rev. Cardiol. 9, 526–539 (2012). source
hedgedconditional- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
None of the sources cited for this claim have been checked yet.
In the paper
“The law of initial values gives further insight into this issue by highlighting that an initial value has a large impact on the strength and direction of a response, such that a higher pre-stimulus level will lead to a smaller post-stimulus response or, in other words, a smaller response when there is a greater initial value19–21.”
§ Guidelines for wrist-worn consumer wearable assessment of heart rate in biobehavioral research > Current limitations in cardiovascular research
What the sources say
- Not checked yetcites [19] Geenen, R. & Vijver, F. J. R. A simple test of the law of initial values. Psychophysiology 30, 525–530 (1993). source
- Not checked yetcites [20] Pattyn, N., Migeotte, P.-F., Neyt, X., den Nest, A. & van, Cluydts, R. Comparing real-life and laboratory-induced stress reactivity on cardio-respiratory parameters: differentiation of a tonic and a phasic component. Physiol. Behav. 101, 218–223 (2010). source
- Not checked yetcites [21] Wilder, J. Basimetric approach (law of initial value) to biological rhythms. Ann. N. Y. Acad. Sci. 98, 1211–1220 (1962). source
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Overall, PPG devices allow for in vivo examinations of the roles that resting HR and HR dynamics (e.g., reactivity and recovery) have in medical and psychiatric disorders in real-world settings.”
§ Guidelines for wrist-worn consumer wearable assessment of heart rate in biobehavioral research > Wearable technological advancements and the scalability of cardiovascular research
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
None of the sources cited for this claim have been checked yet.
In the paper
“Current research into the HR accuracy of wrist-worn wearable devices attempt to compare the measurement between wearable PPG and a reference method, such as an ECG, in order to determine whether or not measurements between the devices are outside of clinically important limits of agreement, so that devices can supplement, eventually replace, or be used interchangeably37,38.”
§ Guidelines for wrist-worn consumer wearable assessment of heart rate in biobehavioral research > How accurate is HR detection with wrist-worn wearable devices?
What the sources say
- Not checked yetcites [37] Bland, J. M. & Altman, D. G. Measuring agreement in method comparison studies. Stat. Meth. Med. Res 8, 135–160 (1999). source
- Not checked yetcites [38] Nelson, B. W. & Allen, N. B. Accuracy of consumer wearable heart rate measurement during an ecologically valid 24-hour period: intraindividual validation study. JMIR mHealth uHealth 7, e10828 (2019). source
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
None of the sources cited for this claim have been checked yet.
In the paper
“other studies have used suboptimal reference methods, such as the chest straps45–47 or pulse oximeters48, which themselves have a degree of error (varying between 0 and 40 bpm when compared to ECGs44).”
§ Guidelines for wrist-worn consumer wearable assessment of heart rate in biobehavioral research > How accurate is HR detection with wrist-worn wearable devices?
What the sources say
- Not checked yetcites [44] Wang, R. et al. Accuracy of wrist-worn heart rate monitors. JAMA Cardiol. 2, 104–106 (2017). source
- Not checked yetcites [45] Dooley, E. E., Golaszewski, N. M. & Bartholomew, J. B. Estimating accuracy at exercise intensities: a comparative study of self-monitoring heart rate and physical activity wearable devices. JMIR mHealth uHealth 5, e34 (2017). source
- Not checked yetcites [46] Gillinov, S. et al. Variable accuracy of wearable heart rate monitors during aerobic exercise. Med. Sci. Sports Exerc. 49, 1697–1703 (2017). source
- Not checked yetcites [47] Stahl, S. E., An, H.-S., Dinkel, D. M., Noble, J. M. & Lee, J.-M. How accurate are the wrist-based heart rate monitors during walking and running activities? Are they accurate enough? BMJ Open Sport Exerc. Med. 2, e000106 (2016). source
- Not checked yetcites [48] El-Amrawy, F. & Nounou, M. I. Are currently available wearable devices for activity tracking and heart rate monitoring accurate, precise, and medically beneficial? Healthc. Inform. Res. 21, 315–320 (2015). source
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“These preliminary findings suggest that researchers can utilize wearable HR to accurately assess HR, especially resting HR, when using aggregated data across activities and removing outliers.”
§ Guidelines for wrist-worn consumer wearable assessment of heart rate in biobehavioral research > How accurate is HR detection with wrist-worn wearable devices?
hedgedconditional- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“This has the potential to introduce a degree of additional error into wrist-worn wearable HR accuracy research as suboptimal referencing methods can introduce unnecessary measurement error and potentially undermine findings.”
§ Guidelines for wrist-worn consumer wearable assessment of heart rate in biobehavioral research > How accurate is HR detection with wrist-worn wearable devices?
hedgedconditional- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
None of the sources cited for this claim have been checked yet.
In the paper
“Current research verifying wearables to the gold-standard ECG, which uses electrodes to directly measure cardiac muscular contractions from electrical activity of the heart, have shown that on average wearables slightly and negligibly underestimate (−0.9 to −7.2 bpm) absolute HR40,41,44,52”
§ Guidelines for wrist-worn consumer wearable assessment of heart rate in biobehavioral research > How accurate is HR detection with wrist-worn wearable devices?
What the sources say
- Not checked yetcites [40] de Zambotti, M. et al. Measures of sleep and cardiac functioning during sleep using a multi-sensory commercially-available wristband in adolescents. Physiol. Behav. 158, 143–149 (2016). source
- Not checked yetcites [41] Kroll, R. R., Boyd, J. G. & Maslove, D. M. Accuracy of a wrist-worn wearable device for monitoring heart rates in hospital inpatients: a prospective observational study. J. Med. Internet Res. 18, e253 (2016). source
- Not checked yetcites [44] Wang, R. et al. Accuracy of wrist-worn heart rate monitors. JAMA Cardiol. 2, 104–106 (2017). source
- Not checked yetcites [52] Benedetto, S. et al. Assessment of the fitbit charge 2 for monitoring heart rate. PLoS ONE. https://doi.org/10.1371/journal.pone.0192691 (2018). source
boosted- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
None of the sources cited for this claim have been checked yet.
In the paper
“with the Apple Watch having slightly greater accuracy than Fitbit devices (Apple Watch: −1.3 bpm, Fitbit: −9.3 bpm42–44)”
§ Guidelines for wrist-worn consumer wearable assessment of heart rate in biobehavioral research > How accurate is HR detection with wrist-worn wearable devices?
What the sources say
- Not checked yetcites [42] Shcherbina, A. et al. Accuracy in wrist-worn, sensor-based measurements of heart rate and energy expenditure in a diverse cohort. J. Personalized Med. 7, 3 (2017). source
- Not checked yetcites [43] Wallen, M. P., Gomersall, S. R., Keating, S. E., Wisløff, U., & Coombes, J. S. Accuracy of heart rate watches: implications for weight management. PLoS ONE 11, https://doi.org/10.1371/journal.pone.0154420 (2016). source
- Not checked yetcites [44] Wang, R. et al. Accuracy of wrist-worn heart rate monitors. JAMA Cardiol. 2, 104–106 (2017). source
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
In the paper
“any individual HR observation could deviate from ECG by significantly large margins that would be likely be problematic in medical settings38.”
§ Guidelines for wrist-worn consumer wearable assessment of heart rate in biobehavioral research > How accurate is HR detection with wrist-worn wearable devices?
What the sources say
- Not checked yetcites [38] Nelson, B. W. & Allen, N. B. Accuracy of consumer wearable heart rate measurement during an ecologically valid 24-hour period: intraindividual validation study. JMIR mHealth uHealth 7, e10828 (2019). source
hedged- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
None of the sources cited for this claim have been checked yet.
In the paper
“as well as lower overall error with the Apple Watch models ranging from 1.20 to 6.70% error and Fitbit models ranging from 2.38 to 21.36% error39,42,45”
§ Guidelines for wrist-worn consumer wearable assessment of heart rate in biobehavioral research > How accurate is HR detection with wrist-worn wearable devices?
What the sources say
- Not checked yetcites [39] Boudreaux, B. D. et al. Validity of wearable activity monitors during cycling and resistance exercise. Med. Sci. Sports Exerc. 50, 624–633 (2018). source
- Not checked yetcites [42] Shcherbina, A. et al. Accuracy in wrist-worn, sensor-based measurements of heart rate and energy expenditure in a diverse cohort. J. Personalized Med. 7, 3 (2017). source
- Not checked yetcites [45] Dooley, E. E., Golaszewski, N. M. & Bartholomew, J. B. Estimating accuracy at exercise intensities: a comparative study of self-monitoring heart rate and physical activity wearable devices. JMIR mHealth uHealth 5, e34 (2017). source
plaincorrelational- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
In the paper
“which may be due to the fact that greater wearable movement is associated with decreased PPG accuracy as discussed below62.”
§ Guidelines for wrist-worn consumer wearable assessment of heart rate in biobehavioral research > Study protocol design and data collection: addressing design, biobehavioral, and demographic issues that can influence reproducibility and replicability > Protocol design
What the sources say
- Not checked yetcites [62] Menghini, L. et al. Stressing the accuracy: wrist-worn wearable sensor validation over different conditions. Psychophysiology. 56, https://doi.org/10.1111/psyp.13441 (2019). source
hedgedcorrelational- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
None of the sources cited for this claim have been checked yet.
In the paper
“Lastly, from a study design perspective, mHealth research will be particularly susceptible to a number of research practices, which have been shown to degrade the quality, consistency, generalizability, and therefore replicability and reproducibility of findings31 as data sensors in this research field allow for the vast collection of big data samples, which will be vulnerable to some of the “four”
§ Guidelines for wrist-worn consumer wearable assessment of heart rate in biobehavioral research > Study protocol design and data collection: addressing design, biobehavioral, and demographic issues that can influence reproducibility and replicability > Protocol design
What the sources say
- Not checked yetcites [31] Stupple, A., Singerman, D., & Celi, L. A. The reproducibility crisis in the age of digital medicine. npjDigital Med. 2, https://doi.org/10.1038/s41746-019-0079-z (2019). source
- Not checked yetcites [54] Munafò, M. R. et al. A manifesto for reproducible science. Nat. Hum. Behav. 1, https://doi.org/10.1038/s41562-016-0021 (2017). source
- Not checked yetcites [63] Franco, A., Malhotra, N. & Simonovits, G. Publication bias in the social sciences: unlocking the file drawer. Science 345, 1502–1505 (2014). source
- Not checked yetcites [64] Button, K. S. et al. Confidence and precision increase with high statistical power. Nat. Rev. Neurosci. 14, 585–585 (2013). source
hedgeddirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
In the paper
“More specifically, simulation studies with intensive longitudinal data suggest that multiple imputation and full-information maximum likelihood reliably produce better parameter estimates than listwise deletion59.”
§ Guidelines for wrist-worn consumer wearable assessment of heart rate in biobehavioral research > Study protocol design and data collection: addressing design, biobehavioral, and demographic issues that can influence reproducibility and replicability > Protocol design
What the sources say
- Not checked yetcites [59] Ji, L., Chow, S.-M., Schermerhorn, A. C., Jacobson, N. C. & Cummings, E. M. Handling missing data in the modeling of intensive longitudinal. Data. Struct. Equ. Model. Multidiscip. J. 25, 715–736 (2018). source
hedgeddirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
None of the sources cited for this claim have been checked yet.
In the paper
“There are a number of study design features related to the wrist that have been shown to have effects on HR accuracy.”
§ Guidelines for wrist-worn consumer wearable assessment of heart rate in biobehavioral research > Study protocol design and data collection: addressing design, biobehavioral, and demographic issues that can influence reproducibility and replicability > Protocol design
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
In the paper
“Other strategies (e.g. spectral frequency filters), will depend upon the type of the sensor being utilized in the wearable sensor57.”
§ Guidelines for wrist-worn consumer wearable assessment of heart rate in biobehavioral research > Study protocol design and data collection: addressing design, biobehavioral, and demographic issues that can influence reproducibility and replicability > Protocol design
What the sources say
- Not checked yetcites [57] Yang, Z., Zhou, Q., Lei, L., Zheng, K., & Xiang, W. An IoT-cloud based wearable ECG monitoring system for smart healthcare. J. Med. Syst. 40, https://doi.org/10.1007/s10916-016-0644-9 (2016). source
plaincorrelational- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
In the paper
“In addition to wrist circumference, there are a number of other factors including wrist placement, tightness of device, dominant vs non-dominant hand use, and degree of wrist movement that have consistently been shown to influence the accuracy of HR measurement39”
§ Guidelines for wrist-worn consumer wearable assessment of heart rate in biobehavioral research > Study protocol design and data collection: addressing design, biobehavioral, and demographic issues that can influence reproducibility and replicability > Protocol design
What the sources say
- Not checked yetcites [39] Boudreaux, B. D. et al. Validity of wearable activity monitors during cycling and resistance exercise. Med. Sci. Sports Exerc. 50, 624–633 (2018). source
boosteddirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“These are likely some of the most important factors influencing HR accuracy.”
§ Guidelines for wrist-worn consumer wearable assessment of heart rate in biobehavioral research > Study protocol design and data collection: addressing design, biobehavioral, and demographic issues that can influence reproducibility and replicability > Protocol design
hedgedcorrelational- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
In the paper
“Moreover, dynamic models of HR captured in daily life can be effectively estimated even with very large proportions of missing data (e.g. >70% missingness for each subject) using full-information maximum likelihood estimation60.”
§ Guidelines for wrist-worn consumer wearable assessment of heart rate in biobehavioral research > Study protocol design and data collection: addressing design, biobehavioral, and demographic issues that can influence reproducibility and replicability > Protocol design
What the sources say
- Not checked yetcites [60] Jacobson, N. C., Chow, S.-M. & Newman, M. G. The differential time-varying effect model (DTVEM): a tool for diagnosing and modeling time lags in intensive longitudinal data. Behav. Res. Methods 51, 295–315 (2019). source
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
None of the sources cited for this claim have been checked yet.
In the paper
“two related factors identified as influencing wearable HR accuracy are motion artifacts23 and level of physical activity46.”
§ Guidelines for wrist-worn consumer wearable assessment of heart rate in biobehavioral research > Study protocol design and data collection: addressing design, biobehavioral, and demographic issues that can influence reproducibility and replicability > Biobehavioral and demographic data
What the sources say
- Not checked yetcites [23] Mahloko, L. & Adebesin, F. in Responsible Design, Implementation and Use of Information and Communication Technology. Lecture Notes in Computer Science (eds Hattingh, M., et al.) Vol. 12067, 96–107 (Springer International Publishing, Cham, 2020). source
- Not checked yetcites [46] Gillinov, S. et al. Variable accuracy of wearable heart rate monitors during aerobic exercise. Med. Sci. Sports Exerc. 49, 1697–1703 (2017). source
plaincorrelational- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
In the paper
“research has shown that at rest, wearables can perform similarly to an ECG”
§ Guidelines for wrist-worn consumer wearable assessment of heart rate in biobehavioral research > Study protocol design and data collection: addressing design, biobehavioral, and demographic issues that can influence reproducibility and replicability > Biobehavioral and demographic data
What the sources say
- Not checked yetcites [50] Bent, B., Goldstein, B. A., Kibbe, W. A., & Dunn, J. P. Investigating sources of inaccuracy in wearable optical heart rate sensors. npj Digital Med. 3, https://doi.org/10.1038/s41746-020-0226-6 (2020). source
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Individual differences and variability in both biobehavioral and demographic factors have the potential to influence the collection of HR during research studies and should therefore be strongly considered in descriptive reporting as well as statistical modeling in studies using HR measurement collected from wearable devices.”
§ Guidelines for wrist-worn consumer wearable assessment of heart rate in biobehavioral research > Study protocol design and data collection: addressing design, biobehavioral, and demographic issues that can influence reproducibility and replicability > Biobehavioral and demographic data
hedgedconditional- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The current literature indicates that these devices can provide acceptable accuracy for the measurement of HR for research settings, especially when scalability and ecological validity of measurement settings are critical considerations that may outweigh the need to offer gold-standard assessment.”
§ Guidelines for wrist-worn consumer wearable assessment of heart rate in biobehavioral research > Conclusion
hedged- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Not controlling for firmware version may lead to poorer reproducibility and replicability as two studies investigating the same device with two or more different firmware versions might actually come to different conclusions even if all other variables are held constant.”
§ Guidelines for wrist-worn consumer wearable assessment of heart rate in biobehavioral research > Study protocol design and data collection: addressing design, biobehavioral, and demographic issues that can influence reproducibility and replicability > Technological factors that can influence reproducibility and replicability
hedgedconditional- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Rests on an assumption: Wearable algorithms may be altered with firmware updates.
- Rests on an assumption: Most studies fail to report firmware information.
In the paper
“Wearable manufacturers use proprietary algorithms to translate PPG signals to HR measurements, which may influence accuracy23.”
§ Guidelines for wrist-worn consumer wearable assessment of heart rate in biobehavioral research > Study protocol design and data collection: addressing design, biobehavioral, and demographic issues that can influence reproducibility and replicability > Technological factors that can influence reproducibility and replicability
What the sources say
- Not checked yetcites [23] Mahloko, L. & Adebesin, F. in Responsible Design, Implementation and Use of Information and Communication Technology. Lecture Notes in Computer Science (eds Hattingh, M., et al.) Vol. 12067, 96–107 (Springer International Publishing, Cham, 2020). source
hedgedconditional- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“although consumer wearable devices that collect HR likely are not yet advanced enough to be replacing medical-grade ECG anytime soon”
§ Guidelines for wrist-worn consumer wearable assessment of heart rate in biobehavioral research > Conclusion
hedged- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: unclear — It is unclear why the paper says it holds.
In the paper
“a third found that measurement during walking, running, and cycling was more accurate for some devices than during sitting42”
§ Guidelines for wrist-worn consumer wearable assessment of heart rate in biobehavioral research > Study protocol design and data collection: addressing design, biobehavioral, and demographic issues that can influence reproducibility and replicability > Biobehavioral and demographic data
What the sources say
- Not checked yetcites [42] Shcherbina, A. et al. Accuracy in wrist-worn, sensor-based measurements of heart rate and energy expenditure in a diverse cohort. J. Personalized Med. 7, 3 (2017). source
plaincorrelational- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
In the paper
“indicating that wearables that use green PPG or a combination of green and red PPG are likely to perform better during movement and physical activity23.”
§ Guidelines for wrist-worn consumer wearable assessment of heart rate in biobehavioral research > Study protocol design and data collection: addressing design, biobehavioral, and demographic issues that can influence reproducibility and replicability > Biobehavioral and demographic data
What the sources say
- Not checked yetcites [23] Mahloko, L. & Adebesin, F. in Responsible Design, Implementation and Use of Information and Communication Technology. Lecture Notes in Computer Science (eds Hattingh, M., et al.) Vol. 12067, 96–107 (Springer International Publishing, Cham, 2020). source
hedgedcorrelational- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
None of the sources cited for this claim have been checked yet.
In the paper
“a substantial amount of research showing that wearable devices are more accurate during rest and low intensity exercise when compared to higher intensity exercise, when wearable devices can begin to deviate more from ECG recordings38,39,44,46,70–73”
§ Guidelines for wrist-worn consumer wearable assessment of heart rate in biobehavioral research > Study protocol design and data collection: addressing design, biobehavioral, and demographic issues that can influence reproducibility and replicability > Biobehavioral and demographic data
What the sources say
- Not checked yetcites [38] Nelson, B. W. & Allen, N. B. Accuracy of consumer wearable heart rate measurement during an ecologically valid 24-hour period: intraindividual validation study. JMIR mHealth uHealth 7, e10828 (2019). source
- Not checked yetcites [39] Boudreaux, B. D. et al. Validity of wearable activity monitors during cycling and resistance exercise. Med. Sci. Sports Exerc. 50, 624–633 (2018). source
- Not checked yetcites [44] Wang, R. et al. Accuracy of wrist-worn heart rate monitors. JAMA Cardiol. 2, 104–106 (2017). source
plaincorrelational- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
None of the sources cited for this claim have been checked yet.
In the paper
“research has described the “cross-over effect” when repetitive motion and activity causes underlying algorithms to mistake the movement cadence for cardiac activity50,75.”
§ Guidelines for wrist-worn consumer wearable assessment of heart rate in biobehavioral research > Study protocol design and data collection: addressing design, biobehavioral, and demographic issues that can influence reproducibility and replicability > Biobehavioral and demographic data
What the sources say
- Not checked yetcites [50] Bent, B., Goldstein, B. A., Kibbe, W. A., & Dunn, J. P. Investigating sources of inaccuracy in wearable optical heart rate sensors. npj Digital Med. 3, https://doi.org/10.1038/s41746-020-0226-6 (2020). source
- Not checked yetcites [75] Valencell, T. Optical heart rate monitoring: what you need to know. Valencell. https://valencell.com/blog/2015/10/optical-heart-rate-monitoring-what-you-need-to-know/. Accessed 13 April, 2020 (2015).
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“various technological factors have the potential to influence the collection of HR during research studies and should therefore be strongly considered in descriptive as well as statistical modeling when using wearable devices.”
§ Guidelines for wrist-worn consumer wearable assessment of heart rate in biobehavioral research > Study protocol design and data collection: addressing design, biobehavioral, and demographic issues that can influence reproducibility and replicability > Technological factors that can influence reproducibility and replicability
plainconditional- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Rests on an assumption: Various wearable devices and versions on the market may use different hardware, which may introduce differences in heart rate recordings.
- Probably not a substantial claim. 33
- It may state two separate claims as one. 38
Every source the paper cites for this claim was checked and supports it.
In the paper
“Other research found that across four consumer wearables and two research-grade devices all were “reasonably accurate” during rest or during prolonged HR that was elevated and that differences in accuracy tended to arise during changes in activity50.”
§ Guidelines for wrist-worn consumer wearable assessment of heart rate in biobehavioral research > Study protocol design and data collection: addressing design, biobehavioral, and demographic issues that can influence reproducibility and replicability > Biobehavioral and demographic data
What the sources say
- Supportedcites [50] Bent, B., Goldstein, B. A., Kibbe, W. A., & Dunn, J. P. Investigating sources of inaccuracy in wearable optical heart rate sensors. npj Digital Med. 3, https://doi.org/10.1038/s41746-020-0226-6 (2020). source
The Results (Study summary) identify six devices: four consumer-grade and two research-grade. The Abstract states that the wearables were reasonably accurate at rest and at prolonged elevated heart rate, but differed in how they responded to changes in activity. (LLM, conf=0.95)
plaincorrelational- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
- Supported
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“Between 2008 and 2018 there was a 580% increase in total articles published that contained “wearable” and “heart rate”, indicating that this is a burgeoning area of research that may benefit from standardization of procedures to increase generalizability and clinical utility of research findings.”
§ Guidelines for wrist-worn consumer wearable assessment of heart rate in biobehavioral research > Increased popularity of wrist-worn wearable devices
plaincorrelational- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: fails — The paper may give no reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“Researchers have increasingly begun to use consumer wearables or wrist-worn smartwatches and fitness monitors for measurement of cardiovascular psychophysiological processes related to mental and physical health outcomes.”
§ Guidelines for wrist-worn consumer wearable assessment of heart rate in biobehavioral research > Abstract
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: fails — The paper may give no reason why it holds.
Probably not a substantial claim. The paper may give no reason why it holds.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“These devices have strong appeal because they allow for continuous, scalable, unobtrusive, and ecologically valid data collection of cardiac activity in “big data” studies.”
§ Guidelines for wrist-worn consumer wearable assessment of heart rate in biobehavioral research > Abstract
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: fails — The paper may give no reason why it holds.
Probably not a substantial claim. The paper may give no reason why it holds.
In the paper
“HR is predominantly influenced by the coordination of the sympathetic and parasympathetic branches of the autonomic nervous system, which can be modified by biopsychosocial factors including physical and relational stress, diet, physical fitness, medication use, and substance use1; thus, offering a direct and quantifiable connection to the stress diathesis model of health.”
§ Guidelines for wrist-worn consumer wearable assessment of heart rate in biobehavioral research > Heart rate research in psychology and medicine
What the sources say
- Not checked yetcites [1] Cacioppo J. T., Tassinary L. G., & Berntson G. G. (eds) Handbook of Psychophysiology 4th edn. (Cambridge University Press, 2017). source
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
In the paper
“Second, collection of HR data in these environments lacks temporal resolution within and across days as HR is usually collected during a short recording within a single day, which has precluded research from comprehensively investigating the transition from acute to chronic stress22.”
§ Guidelines for wrist-worn consumer wearable assessment of heart rate in biobehavioral research > Current limitations in cardiovascular research
What the sources say
- Not checked yetcites [22] Rohleder, N. Stress and inflammation—the need to address the gap in the transition between acute and chronic stress effects. Psychoneuroendocrinology https://doi.org/10.1016/j.psyneuen.2019.02.021 (2019). source
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“(2) inability to collect temporally detailed and longitudinal HR measurements both within and across time (e.g., hours, days, weeks, months)”
§ Guidelines for wrist-worn consumer wearable assessment of heart rate in biobehavioral research > Current limitations in cardiovascular research
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: fails — The paper may give no reason why it holds.
Probably not a substantial claim. The paper may give no reason why it holds.
None of the sources cited for this claim have been checked yet.
In the paper
“Researchers are increasingly using consumer wearables or wrist-worn smartwatches and fitness monitors for the digital measurement of cardiovascular health and psychophysiological stress as these devices allow for continuous, scalable, and unobtrusive, “big data” collection of overall cardiac activity in real-world conditions with large samples25–30.”
§ Guidelines for wrist-worn consumer wearable assessment of heart rate in biobehavioral research > Increased popularity of wrist-worn wearable devices
What the sources say
- Not checked yetcites [25] Bradshaw, B. et al. Influenza surveillance using wearable mobile health devices. In International Society for Disease Surveillance Conference 2019 (2019).
- Not checked yetcites [26] Natarajan, A., Pantelopoulos, A., Emir-Farinas, H. & Natarajan, P. Heart rate variability with photoplethysmography in 8 million individuals: results and scaling relations with age, gender, and time of day. Preprint at https://www.biorxiv.org/content/10.1101/772285v1 (2019). source
- Not checked yetcites [27] Perez, M. V. et al. Large-scale assessment of a smartwatch to identify atrial fibrillation. N. Engl. J. Med. 381, 1909–1917 (2019). source
- Not checked yetcites [28] Sim, I. Mobile devices and health. N. Engl. J. Med. 381, 956–968 (2019). source
- Not checked yetcites [29] Tison, G. H. et al. Passive detection of atrial fibrillation using a commercially available smartwatch. JAMA Cardiol. 3, 409 (2018). source
- Not checked yetcites [30] Tison, G. H. et al. Cardiovascular Risk Stratification Using Off-the-Shelf Wearables and a Multi-Task Deep Learning Algorithm. In:; 2018. source
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“The latter of these two is the predominant method for data collected with wrist-worn wearable devices, although some more recent wrist-worn wearable devices, such as the Apple Watch Series 4 and 5, have allowed for the collection of HR via electrical impulses on par with a single-lead electrode.”
§ Guidelines for wrist-worn consumer wearable assessment of heart rate in biobehavioral research > Wearable technological advancements and the scalability of cardiovascular research
plaincorrelational- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: fails — The paper may give no reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“In other words, research has been historically limited to collecting data from medical patients and research participants in novel settings that might not generalize to their everyday lives, which creates the potential for inaccurate baselines and therefore inaccurate measurement of HR dynamics (i.e., reactivity/recovery).”
§ Guidelines for wrist-worn consumer wearable assessment of heart rate in biobehavioral research > Current limitations in cardiovascular research
hedgedconditional- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“(3) prohibitive financial cost of devices for everyday use.”
§ Guidelines for wrist-worn consumer wearable assessment of heart rate in biobehavioral research > Current limitations in cardiovascular research
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: fails — The paper may give no reason why it holds.
Probably not a substantial claim. The paper may give no reason why it holds.
In the paper
“Furthermore, PPG can be used to index heart rate variability (HRV), blood pressure, oxygen saturation, and cardiac output24, but as of yet have not be widely rolled out in consumer-use devices and therefore data collection other than HR will not be discussed further.”
§ Guidelines for wrist-worn consumer wearable assessment of heart rate in biobehavioral research > Wearable technological advancements and the scalability of cardiovascular research
What the sources say
- Not checked yetcites [24] Elgendi, M. On the analysis of fingertip photoplethysmogram signals. Curr. Cardiol. Rev. 8, 14–25 (2012). source
plaincorrelational- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“Until recently, the quantification and measurement of HR has been relegated to medical and research settings, which has largely precluded the observation of HR during patient and participant daily life, thereby limiting the generalizability of findings to real-world living conditions.”
§ Guidelines for wrist-worn consumer wearable assessment of heart rate in biobehavioral research > Heart rate research in psychology and medicine
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: fails — The paper may give no reason why it holds.
Probably not a substantial claim. The paper may give no reason why it holds. It may state two separate claims as one.
In the paper
“In contrast, red LEDs, which are more commonly used in medical settings, are not absorbed as well by the skin allowing the light to transmit deeper and allowing for detection of multiple biological measures, but it has a lower signal-to-noise ratio and is more susceptible to motion artifacts23.”
§ Guidelines for wrist-worn consumer wearable assessment of heart rate in biobehavioral research > Wearable technological advancements and the scalability of cardiovascular research
What the sources say
- Not checked yetcites [23] Mahloko, L. & Adebesin, F. in Responsible Design, Implementation and Use of Information and Communication Technology. Lecture Notes in Computer Science (eds Hattingh, M., et al.) Vol. 12067, 96–107 (Springer International Publishing, Cham, 2020). source
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“For example, green LED light is a shorter wave-length and has been shown to be convenient, because it has good signal-to-noise ratio and is resistant to motion artifacts, but is limited by the amount of light that can pass through tissue, especially darker skin tones.”
§ Guidelines for wrist-worn consumer wearable assessment of heart rate in biobehavioral research > Wearable technological advancements and the scalability of cardiovascular research
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Therefore, this novel electrocardiogram (ECG) technology only allows for the discrete, rather than continuous, collection of data, which precludes the ability for temporally detailed longitudinal ECG collection at this time.”
§ Guidelines for wrist-worn consumer wearable assessment of heart rate in biobehavioral research > Wearable technological advancements and the scalability of cardiovascular research
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“In other words, HR may be a transdiagnostic biomarker with clinical utility for psychology, psychiatry, and medicine to improve nosology and increase identification of those at risk for the onset of psychiatric and physical health disorders.”
§ Guidelines for wrist-worn consumer wearable assessment of heart rate in biobehavioral research > Heart rate research in psychology and medicine
hedgedconditional- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“The foundation of HR research has, until recently, been largely constrained due to (1) lack of ecological validity (i.e., the degree to which a laboratory or medical environment represents actual real-world conditions)”
§ Guidelines for wrist-worn consumer wearable assessment of heart rate in biobehavioral research > Current limitations in cardiovascular research
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: fails — The paper may give no reason why it holds.
Probably not a substantial claim. The paper may give no reason why it holds.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“Currently, wrist-worn wearables provide an opportunity to examine HR in real-world environments, across longer periods of time, and with high resolution at a low cost, by using an optical sensor (photoplethysmography; PPG), that allows these devices to collect volumetric changes in blood profusion (i.e., pulse rate) that can serve as a surrogate for HR”
§ Guidelines for wrist-worn consumer wearable assessment of heart rate in biobehavioral research > Wearable technological advancements and the scalability of cardiovascular research
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
In the paper
“Recent information on the reproducibility and replicability crisis has swept the sciences and as such these issues are very important for digital health and mHealth research, which includes wrist-worn HR accuracy and any studies that utilize wearable HR data, as this new field will allow for large data samples31 with various sensors that will increase the ease for p-hacking.”
§ Guidelines for wrist-worn consumer wearable assessment of heart rate in biobehavioral research > Increased popularity of wrist-worn wearable devices
What the sources say
- Not checked yetcites [31] Stupple, A., Singerman, D., & Celi, L. A. The reproducibility crisis in the age of digital medicine. npjDigital Med. 2, https://doi.org/10.1038/s41746-019-0079-z (2019). source
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
None of the sources cited for this claim have been checked yet.
In the paper
“yet questions remain as to the accuracy and validity of data collected from wearables35,36.”
§ Guidelines for wrist-worn consumer wearable assessment of heart rate in biobehavioral research > Increased popularity of wrist-worn wearable devices
What the sources say
- Not checked yetcites [35] Evenson, K. R., Goto, M. M., & Furberg, R. D. Systematic review of the validity and reliability of consumer-wearable activity trackers. Int. J. Behav. Nutr. Phys. Activity. 12, https://doi.org/10.1186/s12966-015-0314-1 (2015). source
- Not checked yetcites [36] Peake, J. M., Kerr, G., & Sullivan, J. P. A critical review of consumer wearables, mobile applications, and equipment for providing biofeedback, monitoring stress, and sleep in physically active populations. Front. Physiol. 9, https://doi.org/10.3389/fphys.2018.00743 (2018). source
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim.
None of the sources cited for this claim have been checked yet.
In the paper
“Although some studies have attempted to address wearable HR accuracy using the gold-standard reference method of ECG, which directly measures HR via electrical impulses from the heart and is used for clinical accuracy38–44”
§ Guidelines for wrist-worn consumer wearable assessment of heart rate in biobehavioral research > How accurate is HR detection with wrist-worn wearable devices?
What the sources say
- Not checked yetcites [38] Nelson, B. W. & Allen, N. B. Accuracy of consumer wearable heart rate measurement during an ecologically valid 24-hour period: intraindividual validation study. JMIR mHealth uHealth 7, e10828 (2019). source
- Not checked yetcites [39] Boudreaux, B. D. et al. Validity of wearable activity monitors during cycling and resistance exercise. Med. Sci. Sports Exerc. 50, 624–633 (2018). source
- Not checked yetcites [40] de Zambotti, M. et al. Measures of sleep and cardiac functioning during sleep using a multi-sensory commercially-available wristband in adolescents. Physiol. Behav. 158, 143–149 (2016). source
- Not checked yetcites [41] Kroll, R. R., Boyd, J. G. & Maslove, D. M. Accuracy of a wrist-worn wearable device for monitoring heart rates in hospital inpatients: a prospective observational study. J. Med. Internet Res. 18, e253 (2016). source
- Not checked yetcites [42] Shcherbina, A. et al. Accuracy in wrist-worn, sensor-based measurements of heart rate and energy expenditure in a diverse cohort. J. Personalized Med. 7, 3 (2017). source
- Not checked yetcites [43] Wallen, M. P., Gomersall, S. R., Keating, S. E., Wisløff, U., & Coombes, J. S. Accuracy of heart rate watches: implications for weight management. PLoS ONE 11, https://doi.org/10.1371/journal.pone.0154420 (2016). source
- Not checked yetcites [44] Wang, R. et al. Accuracy of wrist-worn heart rate monitors. JAMA Cardiol. 2, 104–106 (2017). source
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“This finding indicated that while overall, summary statistics after outlier detection and data cleaning may be very accurate for research purposes, any single observation in real-time may have a large degree of error, which could be significant for moment-to-moment observations in medical settings.”
§ Guidelines for wrist-worn consumer wearable assessment of heart rate in biobehavioral research > How accurate is HR detection with wrist-worn wearable devices?
hedgedconditional- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
In the paper
“Furthermore, some wearable devices, such as the Apple Watch 4 and 5, have gained FDA 510(k) class II clearance for the ECG feature and ability to detect arrhythmias49”
§ Guidelines for wrist-worn consumer wearable assessment of heart rate in biobehavioral research > How accurate is HR detection with wrist-worn wearable devices?
What the sources say
- Not checked yetcites [49] FDA. Electrocardiographsoftware for Over-the-Counter Use. https://www.accessdata.fda.gov/cdrh_docs/pdf18/DEN180044.pdf (FDA, 2018).
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
In the paper
“Furthermore, recent research has indicated that consumer wearables, such as the Apple Watch and Fitbit are more accurate than research-grade wearables, which are much more expensive yet provide the benefit of raw data50.”
§ Guidelines for wrist-worn consumer wearable assessment of heart rate in biobehavioral research > How accurate is HR detection with wrist-worn wearable devices?
What the sources say
- Not checked yetcites [50] Bent, B., Goldstein, B. A., Kibbe, W. A., & Dunn, J. P. Investigating sources of inaccuracy in wearable optical heart rate sensors. npj Digital Med. 3, https://doi.org/10.1038/s41746-020-0226-6 (2020). source
hedged- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
In the paper
“For example, researchers compared the accuracy of ambulatory ECG, Apple Watch 3, and Fitbit Charge 2 data within an individual across 24 h and found that while devices slightly underestimated HR when values were aggregated within and across different daily activities, which indicated high HR accuracy”
§ Guidelines for wrist-worn consumer wearable assessment of heart rate in biobehavioral research > How accurate is HR detection with wrist-worn wearable devices?
What the sources say
- Not checked yetcites [38] Nelson, B. W. & Allen, N. B. Accuracy of consumer wearable heart rate measurement during an ecologically valid 24-hour period: intraindividual validation study. JMIR mHealth uHealth 7, e10828 (2019). source
hedgedSingle case- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
None of the sources cited for this claim have been checked yet.
In the paper
“Therefore, many researchers have begun to push for increased focus on reproducible and open practices in science31,53–55.”
§ Guidelines for wrist-worn consumer wearable assessment of heart rate in biobehavioral research > Disadvantages to non-standard reporting
What the sources say
- Not checked yetcites [31] Stupple, A., Singerman, D., & Celi, L. A. The reproducibility crisis in the age of digital medicine. npjDigital Med. 2, https://doi.org/10.1038/s41746-019-0079-z (2019). source
- Not checked yetcites [53] Bavel, J. J. V., Mende-siedlecki, P., Brady, W. J. & Reinero, D. A. Contextual sensitivity in scientific reproducibility. Proc. Natl Acad. Sci. USA 113, 6454–6459 (2016). source
- Not checked yetcites [54] Munafò, M. R. et al. A manifesto for reproducible science. Nat. Hum. Behav. 1, https://doi.org/10.1038/s41562-016-0021 (2017). source
- Not checked yetcites [55] Tackett, J. L., Brandes, C. M., King, K. M. & Markon, K. E. Psychology’s replication crisis and clinical psychological science. Annu. Rev. Clin. Psychol. 15, 579–604 (2019). source
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
None of the sources cited for this claim have been checked yet.
In the paper
“These findings have led some researchers to conclude that wearables detect HR with acceptable accuracy in both laboratory and real-world settings for research, but importantly not medical settings38,42 as more research needs to be done.”
§ Guidelines for wrist-worn consumer wearable assessment of heart rate in biobehavioral research > How accurate is HR detection with wrist-worn wearable devices?
What the sources say
- Not checked yetcites [38] Nelson, B. W. & Allen, N. B. Accuracy of consumer wearable heart rate measurement during an ecologically valid 24-hour period: intraindividual validation study. JMIR mHealth uHealth 7, e10828 (2019). source
- Not checked yetcites [42] Shcherbina, A. et al. Accuracy in wrist-worn, sensor-based measurements of heart rate and energy expenditure in a diverse cohort. J. Personalized Med. 7, 3 (2017). source
hedged- Asserted: fails — The authors may not put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The authors may not put it forward as true. It may state two separate claims as one.
None of the sources cited for this claim have been checked yet.
In the paper
“lower mean difference standard deviation43, and higher agreement with ECG than Fitbit devices39,44.”
§ Guidelines for wrist-worn consumer wearable assessment of heart rate in biobehavioral research > How accurate is HR detection with wrist-worn wearable devices?
What the sources say
- Not checked yetcites [39] Boudreaux, B. D. et al. Validity of wearable activity monitors during cycling and resistance exercise. Med. Sci. Sports Exerc. 50, 624–633 (2018). source
- Not checked yetcites [43] Wallen, M. P., Gomersall, S. R., Keating, S. E., Wisløff, U., & Coombes, J. S. Accuracy of heart rate watches: implications for weight management. PLoS ONE 11, https://doi.org/10.1371/journal.pone.0154420 (2016). source
- Not checked yetcites [44] Wang, R. et al. Accuracy of wrist-worn heart rate monitors. JAMA Cardiol. 2, 104–106 (2017). source
plaincorrelational- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“Hardware differences between devices determine HR measurement second to second, which has large implications on overall interpretability of the data, such that sampling rate can introduces researcher degrees of freedom for calculating bpm.”
§ Guidelines for wrist-worn consumer wearable assessment of heart rate in biobehavioral research > Study protocol design and data collection: addressing design, biobehavioral, and demographic issues that can influence reproducibility and replicability > Protocol design
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“For long-term field studies, information about participant adherence and wear-time should be considered and reported since these issues can affect data quality.”
§ Guidelines for wrist-worn consumer wearable assessment of heart rate in biobehavioral research > Study protocol design and data collection: addressing design, biobehavioral, and demographic issues that can influence reproducibility and replicability > Protocol design
plainconditional- Asserted: passes — The authors put it forward as true.
- Checkable: fails — It may be too vague to check against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. It may be too vague to check against evidence.
In the paper
“For example, outliers in linear models may strongly impact linear estimators, and some studies may therefore adopt a modeling strategy wherein values are winsorized (e.g., extreme values can be truncated at the 2.5th and 97.5th quantiles56).”
§ Guidelines for wrist-worn consumer wearable assessment of heart rate in biobehavioral research > Study protocol design and data collection: addressing design, biobehavioral, and demographic issues that can influence reproducibility and replicability > Protocol design
What the sources say
- Not checked yetcites [56] Hastings, C. Jr., Mosteller, F., Tukey, J. W. & Winsor, C. P. Low moments for small samples: a comparative study of order statistics. Ann. Math. Stat. 18, 413–426 (1947). source
hedgedconditional- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“For example, Fitbit logs HR data at 1 s intervals during exercise tracking and 5 s intervals at other times, whereas the Apple Watch samples HR data every 10 min, except during workouts, which are continuous.”
§ Guidelines for wrist-worn consumer wearable assessment of heart rate in biobehavioral research > Study protocol design and data collection: addressing design, biobehavioral, and demographic issues that can influence reproducibility and replicability > Protocol design
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: fails — The paper may give no reason why it holds.
Probably not a substantial claim. The paper may give no reason why it holds. It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“There is a strong need to customize the methods of data cleaning to the device being used and the models being adopted, rather than adopting a universal pre-processing pipeline due to device-specific differences and based on the study research questions.”
§ Guidelines for wrist-worn consumer wearable assessment of heart rate in biobehavioral research > Study protocol design and data collection: addressing design, biobehavioral, and demographic issues that can influence reproducibility and replicability > Protocol design
boosted- Asserted: passes — The authors put it forward as true.
- Checkable: fails — It may be too vague to check against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. It may be too vague to check against evidence.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“There are many researcher degrees of freedom when it comes to decisions related to study protocol design and data collection, cleaning, and processing that are important to note as standardizing this process may help ameliorate some barriers and inconsistencies in the literature.”
§ Guidelines for wrist-worn consumer wearable assessment of heart rate in biobehavioral research > Study protocol design and data collection: addressing design, biobehavioral, and demographic issues that can influence reproducibility and replicability
hedgedconditional- Asserted: passes — The authors put it forward as true.
- Checkable: fails — It may be too vague to check against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: fails — The paper may give no reason why it holds.
Probably not a substantial claim. It may be too vague to check against evidence. The paper may give no reason why it holds. It may state two separate claims as one.
In the paper
“The practice of completely removing persons from studies due to proportions of missing data (i.e. listwise deletion) is known to bias estimation and adversely impact the standard error of point estimates across modeling strategies58.”
§ Guidelines for wrist-worn consumer wearable assessment of heart rate in biobehavioral research > Study protocol design and data collection: addressing design, biobehavioral, and demographic issues that can influence reproducibility and replicability > Protocol design
What the sources say
- Not checked yetcites [58] Graham, J. W. Missing data analysis: making it work in the real world. Annu. Rev. Psychol. 60, 549–576 (2009). source
boosteddirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
In the paper
“However, if a study were interested in HR arrythmias using wearable assessments (such as atrial fibrillation), then these extreme values may be of vital interest and should not be removed or altered27.”
§ Guidelines for wrist-worn consumer wearable assessment of heart rate in biobehavioral research > Study protocol design and data collection: addressing design, biobehavioral, and demographic issues that can influence reproducibility and replicability > Protocol design
What the sources say
- Not checked yetcites [27] Perez, M. V. et al. Large-scale assessment of a smartwatch to identify atrial fibrillation. N. Engl. J. Med. 381, 1909–1917 (2019). source
hedged- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“In addition, the methods researchers select to clean and process raw data prior to analyses can also affect results and conclusions and should be reported in detail.”
§ Guidelines for wrist-worn consumer wearable assessment of heart rate in biobehavioral research > Study protocol design and data collection: addressing design, biobehavioral, and demographic issues that can influence reproducibility and replicability > Protocol design
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: fails — The paper may give no reason why it holds.
Probably not a substantial claim. The paper may give no reason why it holds.
None of the sources cited for this claim have been checked yet.
In the paper
“Larger wrist circumference has been shown to be associated with reduced HR accuracy42, although these outcomes have not been found in all studies44,46.”
§ Guidelines for wrist-worn consumer wearable assessment of heart rate in biobehavioral research > Study protocol design and data collection: addressing design, biobehavioral, and demographic issues that can influence reproducibility and replicability > Protocol design
What the sources say
- Not checked yetcites [42] Shcherbina, A. et al. Accuracy in wrist-worn, sensor-based measurements of heart rate and energy expenditure in a diverse cohort. J. Personalized Med. 7, 3 (2017). source
- Not checked yetcites [44] Wang, R. et al. Accuracy of wrist-worn heart rate monitors. JAMA Cardiol. 2, 104–106 (2017). source
- Not checked yetcites [46] Gillinov, S. et al. Variable accuracy of wearable heart rate monitors during aerobic exercise. Med. Sci. Sports Exerc. 49, 1697–1703 (2017). source
hedgedcorrelational- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Moreover, for some, but not all devices will report missing HR data with zero values and these values should be removed and filled in with missing data rather than winsorized (which would otherwise substantially bias parameter estimates unless the degree of missing HR points was trivial).”
§ Guidelines for wrist-worn consumer wearable assessment of heart rate in biobehavioral research > Study protocol design and data collection: addressing design, biobehavioral, and demographic issues that can influence reproducibility and replicability > Protocol design
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. It may state two separate claims as one.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“One issue reported by multiple users on the online Fitbit Community Forum is occasional logging of HR values (often higher and more variable than typical, e.g., 100–150 bpm) when the devices are not being worn, suggesting that supplemental non-wear-time diaries may be required for some devices or protocols.”
§ Guidelines for wrist-worn consumer wearable assessment of heart rate in biobehavioral research > Study protocol design and data collection: addressing design, biobehavioral, and demographic issues that can influence reproducibility and replicability > Protocol design
hedgedconditional- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: fails — The paper may give no reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds. It may state two separate claims as one.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“Relatedly, some devices, such as the Apple Watch can take multiple HR measurements within a minute allowing researchers to use various calculations, such as the mean or median within this minute to calculate bpm, which may alter wearable data values.”
§ Guidelines for wrist-worn consumer wearable assessment of heart rate in biobehavioral research > Study protocol design and data collection: addressing design, biobehavioral, and demographic issues that can influence reproducibility and replicability > Protocol design
hedgedconditional- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
In the paper
“some research showing that absolute error during activity is 30% higher than rest50”
§ Guidelines for wrist-worn consumer wearable assessment of heart rate in biobehavioral research > Study protocol design and data collection: addressing design, biobehavioral, and demographic issues that can influence reproducibility and replicability > Biobehavioral and demographic data
What the sources say
- Not checked yetcites [50] Bent, B., Goldstein, B. A., Kibbe, W. A., & Dunn, J. P. Investigating sources of inaccuracy in wearable optical heart rate sensors. npj Digital Med. 3, https://doi.org/10.1038/s41746-020-0226-6 (2020). source
hedgedcorrelational- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“the last of which likely will not be an issue for mHealth research as large samples sizes will be relatively easy to collect even in samples with low base rates in the population.”
§ Guidelines for wrist-worn consumer wearable assessment of heart rate in biobehavioral research > Study protocol design and data collection: addressing design, biobehavioral, and demographic issues that can influence reproducibility and replicability > Protocol design
hedged- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: fails — The paper may give no reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds. It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Currently, the vast majority of wrist-worn wearable studies incorporating HR measurements do not report or control for participant race and ethnicity, which undermines the ability to look at potentially important group differences in health outcomes and therefore decreases the ability of results to generalize to large segments of the population.”
§ Guidelines for wrist-worn consumer wearable assessment of heart rate in biobehavioral research > Study protocol design and data collection: addressing design, biobehavioral, and demographic issues that can influence reproducibility and replicability > Biobehavioral and demographic data
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
- Rests on an assumption: The vast majority of wrist-worn wearable studies incorporating heart rate measurements do not report or control for participant race and ethnicity.
None of the sources cited for this claim have been checked yet.
In the paper
“Evidence is starting to accumulate on the importance of skin tone when it comes to accuracy and generalizability of wrist-worn wearable studies with darker skin tone (and tattoos) being found to be associated with reduced wrist-worn HR accuracy as they absorb more green light67, yet this is not found in all studies43,50.”
§ Guidelines for wrist-worn consumer wearable assessment of heart rate in biobehavioral research > Study protocol design and data collection: addressing design, biobehavioral, and demographic issues that can influence reproducibility and replicability > Biobehavioral and demographic data
What the sources say
- Not checked yetcites [67] Weiler, D. T., Villajuan, S. O., Edkins, L., Cleary, S. & Saleem, J. J. Wearable heart rate monitor technology accuracy in research: a comparative study between PPG and ECG technology. Proc. Hum. Factors Ergonomics Soc. Annu. Meet. 61, 1292–1296 (2017). source
- Not checked yetcites [43] Wallen, M. P., Gomersall, S. R., Keating, S. E., Wisløff, U., & Coombes, J. S. Accuracy of heart rate watches: implications for weight management. PLoS ONE 11, https://doi.org/10.1371/journal.pone.0154420 (2016). source
- Not checked yetcites [50] Bent, B., Goldstein, B. A., Kibbe, W. A., & Dunn, J. P. Investigating sources of inaccuracy in wearable optical heart rate sensors. npj Digital Med. 3, https://doi.org/10.1038/s41746-020-0226-6 (2020). source
hedgedcorrelational- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
In the paper
“wearables that use red light will likely be more effective on darker skin tones as it is not absorbed by melanin, which may allow for more accurate HR measurements23.”
§ Guidelines for wrist-worn consumer wearable assessment of heart rate in biobehavioral research > Study protocol design and data collection: addressing design, biobehavioral, and demographic issues that can influence reproducibility and replicability > Biobehavioral and demographic data
What the sources say
- Not checked yetcites [23] Mahloko, L. & Adebesin, F. in Responsible Design, Implementation and Use of Information and Communication Technology. Lecture Notes in Computer Science (eds Hattingh, M., et al.) Vol. 12067, 96–107 (Springer International Publishing, Cham, 2020). source
hedgedconditional- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
None of the sources cited for this claim have been checked yet.
In the paper
“Higher body mass index, which likely covaries with larger wrist circumference as described above, has been shown to be associated with reduced HR accuracy42,62, although again these outcomes have not been found in all studies44,46.”
§ Guidelines for wrist-worn consumer wearable assessment of heart rate in biobehavioral research > Study protocol design and data collection: addressing design, biobehavioral, and demographic issues that can influence reproducibility and replicability > Biobehavioral and demographic data
What the sources say
- Not checked yetcites [42] Shcherbina, A. et al. Accuracy in wrist-worn, sensor-based measurements of heart rate and energy expenditure in a diverse cohort. J. Personalized Med. 7, 3 (2017). source
- Not checked yetcites [62] Menghini, L. et al. Stressing the accuracy: wrist-worn wearable sensor validation over different conditions. Psychophysiology. 56, https://doi.org/10.1111/psyp.13441 (2019). source
- Not checked yetcites [44] Wang, R. et al. Accuracy of wrist-worn heart rate monitors. JAMA Cardiol. 2, 104–106 (2017). source
- Not checked yetcites [46] Gillinov, S. et al. Variable accuracy of wearable heart rate monitors during aerobic exercise. Med. Sci. Sports Exerc. 49, 1697–1703 (2017). source
hedgedcorrelational- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
In the paper
“some research indicates that hair follicle density and sweat can influence device measurement69.”
§ Guidelines for wrist-worn consumer wearable assessment of heart rate in biobehavioral research > Study protocol design and data collection: addressing design, biobehavioral, and demographic issues that can influence reproducibility and replicability > Biobehavioral and demographic data
What the sources say
- Not checked yetcites [69] Cosoli, G., Spinsante, S. & Scalise, L. Wrist-worn and chest-strap wearable devices: systematic review on accuracy and metrological characteristics. Measurement 159, 107789 (2020). source
hedgedconditional- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
In the paper
“The importance of this point cannot be overstated as historically, science and medicine have paid less attention to recruiting minority groups68, which has resulted in blunted health gains in these populations”
§ Guidelines for wrist-worn consumer wearable assessment of heart rate in biobehavioral research > Study protocol design and data collection: addressing design, biobehavioral, and demographic issues that can influence reproducibility and replicability > Biobehavioral and demographic data
What the sources say
- Not checked yetcites [68] Hall, G. C. N., Yip, T. & Zárate, M. A. On becoming multicultural in a monocultural research world: a conceptual approach to studying ethnocultural diversity. Am. Psychol. 71, 40–51 (2016). source
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Furthermore, wearables that use red light will likely be more effective on darker skin tones as it is not absorbed by melanin, which may allow for more”
§ Guidelines for wrist-worn consumer wearable assessment of heart rate in biobehavioral research > Study protocol design and data collection: addressing design, biobehavioral, and demographic issues that can influence reproducibility and replicability > Biobehavioral and demographic data
hedgedconditional- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: fails — The paper may give no reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“these devices can be used to supplement medical-grade devices and continuously collect HR data on research subjects when risk for acute cardiac events is not of immediate concern.”
§ Guidelines for wrist-worn consumer wearable assessment of heart rate in biobehavioral research > Conclusion
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: unclear — It is unclear why the paper says it holds.
It may state two separate claims as one.
In the paper
“a second study found that the accuracy of HR measurement was highest during running51”
§ Guidelines for wrist-worn consumer wearable assessment of heart rate in biobehavioral research > Study protocol design and data collection: addressing design, biobehavioral, and demographic issues that can influence reproducibility and replicability > Biobehavioral and demographic data
What the sources say
- Not checked yetcites [51] Xie, J. et al. Evaluating the validity of current mainstream wearable devices in fitness tracking under various physical activities: comparative study. JMIR Mhealth Uhealth 6, e94 (2018). source
plaincorrelational- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“This has the potential to improve the study of cardiovascular health in medicine and psychophysiological stress in psychiatry and psychology.”
§ Guidelines for wrist-worn consumer wearable assessment of heart rate in biobehavioral research > Conclusion
hedgedconditional- Asserted: passes — The authors put it forward as true.
- Checkable: fails — It may be too vague to check against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. It may be too vague to check against evidence.
- Rests on an assumption: Consumer wearables allow continuous, scalable, unobtrusive, big data collection of cardiac activity in real-world conditions with large samples.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“This has the potential to advance research into cardiovascular health and psychophysiological stress in order to better understand how HR influences overall physical and psychological health.”
§ Guidelines for wrist-worn consumer wearable assessment of heart rate in biobehavioral research > Conclusion
hedgedconditional- Asserted: passes — The authors put it forward as true.
- Checkable: fails — It may be too vague to check against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. It may be too vague to check against evidence.
In the paper
“one strength of PPG green light is that it is less susceptible to motion artifacts, whereas PPG red light is more susceptible to motion artifacts”
§ Guidelines for wrist-worn consumer wearable assessment of heart rate in biobehavioral research > Study protocol design and data collection: addressing design, biobehavioral, and demographic issues that can influence reproducibility and replicability > Biobehavioral and demographic data
What the sources say
- Not checked yetcites [23] Mahloko, L. & Adebesin, F. in Responsible Design, Implementation and Use of Information and Communication Technology. Lecture Notes in Computer Science (eds Hattingh, M., et al.) Vol. 12067, 96–107 (Springer International Publishing, Cham, 2020). source
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
In the paper
“although some researchers have worked with industry partners to derive measurements of HRV26.”
§ Guidelines for wrist-worn consumer wearable assessment of heart rate in biobehavioral research > Conclusion
What the sources say
- Not checked yetcites [26] Natarajan, A., Pantelopoulos, A., Emir-Farinas, H. & Natarajan, P. Heart rate variability with photoplethysmography in 8 million individuals: results and scaling relations with age, gender, and time of day. Preprint at https://www.biorxiv.org/content/10.1101/772285v1 (2019). source
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
In the paper
“Therefore, it is possible that activity intensity may be less important to device accuracy than the degree of erratic wrist movements and corresponding position of the wearable device during an activity74, which cause motion artifacts and may or may not co-occur with”
§ Guidelines for wrist-worn consumer wearable assessment of heart rate in biobehavioral research > Study protocol design and data collection: addressing design, biobehavioral, and demographic issues that can influence reproducibility and replicability > Biobehavioral and demographic data
What the sources say
- Not checked yetcites [74] Parak, J. & Korhonen, I. Evaluation of wearable consumer heart rate monitors based on photopletysmography. Conf. Proc. IEEE Eng. Med. Biol. Soc. 3670-3673 2014, 3670–3673 (2014).
hedgedconditional- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
In the paper
“some studies finding that accuracy of HR measurement was comparable across resting baseline or vigorous activity45”
§ Guidelines for wrist-worn consumer wearable assessment of heart rate in biobehavioral research > Study protocol design and data collection: addressing design, biobehavioral, and demographic issues that can influence reproducibility and replicability > Biobehavioral and demographic data
What the sources say
- Not checked yetcites [45] Dooley, E. E., Golaszewski, N. M. & Bartholomew, J. B. Estimating accuracy at exercise intensities: a comparative study of self-monitoring heart rate and physical activity wearable devices. JMIR mHealth uHealth 5, e34 (2017). source
hedged- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Utilizing these guidelines and referencing them in methods sections has the potential to decrease non-standard reporting, increase reproducibility and replicability, while also leading to greater generalizability of results, which may increase the clinical utility of findings in this field.”
§ Guidelines for wrist-worn consumer wearable assessment of heart rate in biobehavioral research > Guidelines
hedgedconditional- Asserted: passes — The authors put it forward as true.
- Checkable: fails — It may be too vague to check against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. It may be too vague to check against evidence. It may state two separate claims as one.
The paper relies on this without support.
There is currently a lack of transparency from manufacturers on underlying algorithms and raw data outputs are often not provided.
“Unfortunately, there is currently a lack of transparency from manufacturers on underlying algorithms and raw data outputs are often times not provided, which prevents researchers from dealing with this issue and creating a standardized protocol for transforming raw data to HR.”
The paper relies on this without support.
The vast majority of wrist-worn wearable studies incorporating heart rate measurements do not report or control for participant race and ethnicity.
“Currently, the vast majority of wrist-worn wearable studies incorporating HR measurements do not report or control for participant race and ethnicity, which undermines the ability to look at potentially important group differences in health outcomes and therefore decreases the ability of results to generalize to large segments of the population.”
The paper relies on this without support.
Various wearable devices and versions on the market may use different hardware, which may introduce differences in heart rate recordings.
“there are currently various wearable devices and versions on the market that have the potential to use different hardware, which may introduce differences in HR recordings.”
The paper relies on this without support.
Wearable algorithms may be altered with firmware updates.
“These algorithms, while often simplistic, may be altered with firmware updates”
The paper relies on this without support.
Most studies fail to report firmware information.
“yet most studies fail to report firmware information.”
The paper relies on this without support.
Consumer wearables allow continuous, scalable, unobtrusive, big data collection of cardiac activity in real-world conditions with large samples.
“The recent introduction of consumer wearables or wrist-worn smartwatches and fitness monitors for the digital measurement of cardiovascular health and psychophysiological stress has allowed for the continuous, scalable, and unobtrusive, “big data” collection of overall cardiac activity in real-world conditions with large samples that allow for the collection of passive, large-scale, and ecolog”
The paper relies on this without support.
PPG technology can be used to index blood pressure, oxygen saturation, and cardiac output.
“It is important to note that PPG technology can be used to index blood pressure, oxygen saturation, and cardiac output, which will likely be slowly rolled out into wearable technology moving forward.”
The paper relies on this without support.
PPG can index heart rate variability, which is derived from beat-to-beat interval calculations in the time-domain.
“In addition, PPG can index HRV, which is derived from beat to beat intervals calculations in the time-domain, such as root mean squared of successive differences or the standard deviation of NN intervals, the latter of which is used in the Apple Watch, but only with sporadic recordings throughout the day.”
The paper relies on this without support.
Many commercial wearables do not provide beat-to-beat interval data to users.
“Currently, many commercial wearables do not provide beat to beat interval data to users”
The paper relies on this without support.
Research is heavily context dependent.
“We do this because research is heavily context dependent.”
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“The accuracy of heart rate measurements affects people with darker skin tones because of algorithm developmental biases that stem from selecting features and adjusting training data composition and model calibrations [23-26].”
From Photoplethysmography in Diverse Skin Tones: Evaluating Bias in Smartwatch Health Monitoring (2025) · cites this paper as [23]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“However, regional variations may exist, and socioeconomic disparities in access to these devices may further interact with skin-tone-related bias, raising additional equity concerns [17-23].”
From Photoplethysmography in Diverse Skin Tones: Evaluating Bias in Smartwatch Health Monitoring (2025) · cites this paper as [23]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“More recent research has also highlighted the potential presence of these biases in research-grade and consumer PPG-based wearable devices [4,27-29]”
From Impact of skin pigmentation on pulse oximetry blood oxygenation and wearable pulse rate accuracy: systematic review and meta-analysis (2024) · cites this paper as [4]
Experimental — accuracy not yet measuredIn the citing paper
“Overall, we have identified a positive trend in wearable studies, underlining the growing interest in wearables in health research, in line with other reviews [3,224-226].”
From The impact of wearable technologies in health research: scoping review (2022) · cites this paper as [226]
In the citing paper
“While safe and inexpensive, the accuracy of PPG is impaired by factors that impede light transmission, such as elevated body mass index, tattoos, and higher hair follicle density [4].”
From Accuracy of heart rate measurement with wrist-worn wearable devices in various skin tones: a systematic review (2023) · cites this paper as [4]
Citations
Cites
Measuring agreement in method comparison studies
Bland, J. M., & Altman, D. G. (1999) · Statistical Methods in Medical Research · doi:10.1177/096228029900800204 · Cited by 9,619
Molecular Mechanisms of Depression: Perspectives on New Treatment Strategies
Lang, U. E., & Borgwardt, S. (2013) · Cellular Physiology and Biochemistry · doi:10.1159/000350094 · Cited by 8,526
Missing data analysis: making it work in the real world
Graham, J. W. (2009) · Annual Review of Psychology · doi:10.1146/annurev.psych.58.110405.085530 · Cited by 6,163
A manifesto for reproducible science
Munafò, M. R., Nosek, B. A., Bishop, D. V. M., Button, K. S., Chambers, C. D., Percie du Sert, N., Simonsohn, U., Wagenmakers, E.-J., Ware, J. J., & Ioannidis, J. P. A. (2017) · Nature Human Behaviour · doi:10.1038/s41562-016-0021 · Cited by 3,397
Walker, E. R., McGee, R. E., & Druss, B. G. (2015) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2014.2502 · Cited by 2,976
Cacioppo, J. T., Tassinary, L. G., Berntson, G. G., Shan, H., Mason, P., Kolb, B., Whishaw, I. Q., Geuter, S., Lindquist, M. A., Wager, T. D., et al. (2016) · Cambridge University Press eBooks · doi:10.1017/9781107415782 · Cited by 2,032
Large-Scale Assessment of a Smartwatch to Identify Atrial Fibrillation
Perez, M. V., Mahaffey, K. W., Hedlin, H., Rumsfeld, J. S., Garcia, A., Ferris, T., Balasubramanian, V., Russo, A. M., Rajmane, A., Cheung, L., et al. (2019) · New England Journal of Medicine · doi:10.1056/nejmoa1901183 · Cited by 1,917
Publication bias in the social sciences: Unlocking the file drawer
Franco, A., Malhotra, N., & Simonovits, G. (2014) · Science · doi:10.1126/science.1255484 · Cited by 1,542
Systematic review of the validity and reliability of consumer-wearable activity trackers
Evenson, K. R., Goto, M. M., & Furberg, R. D. (2015) · International Journal of Behavioral Nutrition and Physical Activity · doi:10.1186/s12966-015-0314-1 · Cited by 1,232
On the Analysis of Fingertip Photoplethysmogram Signals
Elgendi, M. (2012) · Current Cardiology Reviews · doi:10.2174/157340312801215782 · Cited by 1,206
Research works printed but not linked: 1
- Latvala, A. et al. Association of resting heart rate and blood pressure in late adolescence with subsequent mental disorders. JAMA Psychiatry 41, 89–104 (2016).
Cited by
Sorted by citations
The impact of wearable technologies in health research: scoping review
Huhn, S., Axt, M., Gunga, H.-C., Maggioni, M. A., Munga, S., Obor, D., Sié, A., Boudo, V., Bunker, A., Sauerborn, R., et al. (2022) · JMIR mHealth and uHealth · doi:10.2196/34384 · Cited by 379
Machine Learning for Healthcare Wearable Devices: The Big Picture
Sabry, F., Eltaras, T., Labda, W., Alzoubi, K., & Malluhi, Q. (2022) · Journal of Healthcare Engineering · doi:10.1155/2022/4653923 · Cited by 321
Self-Powered Sensing in Wearable Electronics─A Paradigm Shift Technology
Tang, W., Sun, Q., & Wang, Z. L. (2023) · Chemical Reviews · doi:10.1021/acs.chemrev.3c00305 · Cited by 332
Quigley, K. S., Gianaros, P. J., Norman, G. J., Jennings, J. R., Berntson, G. G., & de Geus, E. J. C. (2024) · Psychophysiology · doi:10.1111/psyp.14604 · Cited by 281
Teixeira, E., Fonseca, H., Diniz‐Sousa, F., Veras, L., Boppre, G., de Oliveira, J. J. F., Pinto, D., Alves, A. J., Barbosa, A., Mendes, R., et al. (2021) · Geriatrics · doi:10.3390/geriatrics6020038 · Cited by 179
Metadata
- Authors
- Nelson, B. W., Low, C. A., Jacobson, N., Areán, P., Torous, J., & Allen, N. B.
- Affiliations
- University of Oregon (US)
- University of Pittsburgh (US)
- Dartmouth College (US)
- University of Washington (US)
- Beth Israel Deaconess Medical Center (US)
- Corresponding author
- Nelson, Benjamin W.
- Venue
- npj Digital Medicine
- Published
- 2020-06-26
- Volume
- 3
- Issue
- 1
- Pages
- 90-90
- ISSN
- 2398-6352 (ISSN-L)
- PMC
- PMC7320189
- OpenAlex
- W3037389028
- Semantic Scholar
- 5f08e91b734b990fbd995109628c651537b5b8c5
- Cited by
- 241
- References
- 78
- Citations by year
- 2026: 22 · 2025: 30 · 2024: 54 · 2023: 46 · 2022: 39 · 2021: 42 · 2020: 7
- FWCI
- 2.80
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Locations
- npj Digital Medicine (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- Minerva Access (University of Melbourne) (submittedVersion, cc-by)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Funders
- National Cancer Institute (K07CA204380)
- Topics
- Physical Sciences › Engineering › Biomedical Engineering › Non-Invasive Vital Sign Monitoring
- Health Sciences › Medicine › Cardiology and Cardiovascular Medicine › Heart Rate Variability and Autonomic Control
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Physical Activity and Health
- Keywords
- heart rate measurement, consumer wearable devices, smartwatches, wrist-worn sensors, measurement accuracy, device standardization, reporting guidelines, skin tone, sampling frequency, reproducibility
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
A language model drew the claims from the paper on 2026-10-09, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-09 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
