The DOI matches its Crossref record; 72 of the 72 references it cites were found in a registry or an index.
The reliability of short-term measurements of heart rate variability
Abstract
Short-term assessment of heart rate variability (HRV) is a non-invasive technique to examine ANS function. Within the literature, HRV is commonly referred to as a reliable measurement technique. The aim of this review was to assess the accuracy of this description based upon a comprehensive review of the available data concerning reliability of short-term HRV measures. Reviewing only studies using appropriate statistical analyses, it was determined that reliability coefficients for HRV measures were highly varied. Coefficients of variation ranged from 100%. Similar variation was found in studies using the intraclass correlation coefficient values, and limits of agreement. Reliability coefficients reported displayed some distinct patterns. Firstly, where measurements were made during interventions such as tilt or pharmacological stimulation, reliability was poorer than when HRV was measured at rest. Secondly, clinical populations displayed poorer reliability than healthy subjects. There was little effect of test-retest duration on reliability and although no single HRV measurement appeared less reliable than another, there was evidence that optimal data collection conditions for specific frequency domain measures exist. Describing HRV as a reliable measurement technique appears to be a gross oversimplification, as results of reliability studies are heterogeneous, and dependent on a number of factors. Further studies are required, particularly in clinical populations to assess…
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“there are inconsistencies regarding the reproducibility of HRV measures in a variety of unrelated populations (64–66).”
From Alterations in Heart Rate Variability Associated With Irritable Bowel Syndrome or Inflammatory Bowel Disease: A Systematic Review and Meta-Analysis (2021) · cites this paper as [64]
Citations
Cites
The Measurement of Observer Agreement for Categorical Data
Landis, J. R., & Koch, G. G. (1977) · Biometrics · doi:10.2307/2529310 · Cited by 81,148
STATISTICAL METHODS FOR ASSESSING AGREEMENT BETWEEN TWO METHODS OF CLINICAL MEASUREMENT
Martin Bland, J., & Altman, D. (1986) · The Lancet · doi:10.1016/s0140-6736(86)90837-8 · Cited by 47,965
Heart Rate Variability: Standards of Measurement, Physiological Interpretation, and Clinical Use
Electrophysiology, T. F. O. T. E. S. O. C. T. N. A. (1996) · Circulation · doi:10.1161/01.cir.93.5.1043 · Cited by 17,159
Beckett, A. H., Rowland, M., & TURNER, P. (1965) · The Lancet · doi:10.1016/s0140-6736(65)91037-8 · Cited by 16,917
Heart rate variability: Standards of measurement, physiological interpretation, and clinical use
Malik, M., Bigger, J. T., Camm, A. J., Kleiger, R. E., Malliani, A., Moss, A. J., & Schwartz, P. J. (1996) · European Heart Journal · doi:10.1093/oxfordjournals.eurheartj.a014868 · Cited by 15,289
Methods of Meta-Analysis: Correcting Error and Bias in Research Findings
Schmidt, F. L., & Hunter, J. E. (2015) · doi:10.4135/9781483398105 · Cited by 5,542
Akselrod, S., Gordon, D., Ubel, F. A., Shannon, D. C., Berger, A. C., & Cohen, R. J. (1981) · Science · doi:10.1126/science.6166045 · Cited by 5,079
Measures of Reliability in Sports Medicine and Science
Hopkins, W. G. (2000) · Sports Medicine · doi:10.2165/00007256-200030010-00001 · Cited by 4,635
Pagani, M., Lombardi, F., Guzzetti, S., Rimoldi, O., Furlan, R., Pizzinelli, P., Sandrone, G., Malfatto, G., Dell'Orto, S., & Piccaluga, E. (1986) · Circulation Research · doi:10.1161/01.res.59.2.178 · Cited by 4,130
Kleiger, R. E., Miller, J. P., Bigger, J. T., & Moss, A. J. (1987) · The American Journal of Cardiology · doi:10.1016/0002-9149(87)90795-8 · Cited by 3,995
Atkinson, G., & Nevill, A. M. (1998) · Sports Medicine · doi:10.2165/00007256-199826040-00002 · Cited by 3,817
Methods of Meta-Analysis: Correcting Error and Bias in Research Findings.
Raudenbush, S. W., Hunter, J. E., & Schmidt, F. L. (1991) · Journal of the American Statistical Association · doi:10.2307/2289738 · Cited by 2,368
Impact of Reduced Heart Rate Variability on Risk for Cardiac Events: The Framingham Heart Study
Tsuji, H., Larson, M. G., Venditti, F. J., Manders, E. S., Evans, J. C., Feldman, C. L., & Levy, D. (1996) · Circulation · doi:10.1161/01.cir.94.11.2850 · Cited by 1,762
Nolan, J., Batin, P. D., Andrews, R., Lindsay, S. J., Brooksby, P., Mullen, M., Baig, W., Flapan, A. D., Cowley, A., Prescott, R. J., et al. (1998) · Circulation · doi:10.1161/01.cir.98.15.1510 · Cited by 1,179
Reduced heart rate variability and mortality risk in an elderly cohort. The Framingham Heart Study
Tsuji, H., Venditti, F. J., Manders, E. S., Evans, J. C., Larson, M. G., Feldman, C. L., & Levy, D. (1994) · Circulation · doi:10.1161/01.cir.90.2.878 · Cited by 1,114
Montano, N., Ruscone, T. G., Porta, A., Lombardi, F., Pagani, M., & Malliani, A. (1994) · Circulation · doi:10.1161/01.cir.90.4.1826 · Cited by 1,108
Heart Rate Variability in Athletes
AUBERT, A. E., Seps, B., & Beckers, F. (2003) · Sports Medicine · doi:10.2165/00007256-200333120-00003 · Cited by 981
A critical discussion of intraclass correlation coefficients
Müller, R. M., & Buttner, P. G. (1994) · Statistics in Medicine · doi:10.1002/sim.4780132310 · Cited by 723
Saul, J. P., Arai, Y., Berger, R. D., Lilly, L. S., Colucci, W. S., & Cohen, R. J. (1988) · The American Journal of Cardiology · doi:10.1016/0002-9149(88)91172-1 · Cited by 706
Effect of Endurance Exercise on Autonomic Control of Heart Rate
Carter, J. B., Banister, E. W., & Blaber, A. P. (2003) · Sports Medicine · doi:10.2165/00007256-200333010-00003 · Cited by 556
Statistical evaluation of agreement between two methods for measuring a quantitative variable
Lee, J., Koh, D. S. Q., & Ong, C. N. (1989) · Computers in Biology and Medicine · doi:10.1016/0010-4825(89)90036-x · Cited by 473
Bigger, J. T., Fleiss, J. L., Steinman, R. C., Rolnitzky, L. M., Schneider, W., & Stein, P. K. (1995) · Circulation · doi:10.1161/01.cir.91.7.1936 · Cited by 443
Absence of Low-Frequency Variability of Sympathetic Nerve Activity in Severe Heart Failure
van de Borne, P., Montano, N., Pagani, M., Oren, R. M., & Somers, V. K. (1997) · Circulation · doi:10.1161/01.cir.95.6.1449 · Cited by 376
Coarse-graining spectral analysis: new method for studying heart rate variability
Yamamoto, Y., & Hughson, R. L. (1991) · Journal of Applied Physiology · doi:10.1152/jappl.1991.71.3.1143 · Cited by 357
Decreased spontaneous heart rate variability in congestive heart failure
Casolo, G., Balli, E., Taddei, T., Amuhasi, J., & Gori, C. (1989) · The American Journal of Cardiology · doi:10.1016/0002-9149(89)90871-0 · Cited by 344
Bigger, J. T., Fleiss, J. L., Rolnitzky, L. M., & Steinman, R. C. (1993) · Journal of the American College of Cardiology · doi:10.1016/0735-1097(93)90106-b · Cited by 334
Sinnreich, R., Kark, J. D., Friedlander, Y., Sapoznikov, D., & Luria, M. (1998) · Heart · doi:10.1136/hrt.80.2.156 · Cited by 299
Measurement concepts in physical education and exercise science
(1989) · Choice Reviews Online · doi:10.5860/choice.27-0362 · Cited by 267
Wavelet transform to quantify heart rate variability and to assess its instantaneous changes
Pichot, V., Gaspoz, J., Molliex, S. B., Antoniadis, A., Busso, T., Roche, F., Costes, F., Quintin, L., Lacour, J.-R., & Barthélemy, J. (1999) · Journal of Applied Physiology · doi:10.1152/jappl.1999.86.3.1081 · Cited by 239
Effects of aerobic training on heart rate dynamics in sedentary subjects
Tulppo, M. P., Hautala, A. J., Mäkikallio, T. H., Laukkanen, R. M. T., Nissilä, S., Hughson, R. L., & Huikuri, H. V. (2003) · Journal of Applied Physiology · doi:10.1152/japplphysiol.00751.2002 · Cited by 237
Heart-Rate Variability and Cardiac Autonomic Function in Diabetes
Malpas, S. C., & Tj, M. (1990) · Diabetes · doi:10.2337/diab.39.10.1177 · Cited by 223
Ewing, D. J., Neilson, J. M. M., Shapiro, C. M., Stewart, J. A., & Reid, W. (1991) · Heart · doi:10.1136/hrt.65.5.239 · Cited by 217
The Effect of Age and Gender on Heart Rate Variability after Endurance Training
Carter, J. B., Banister, E. W., & Blaber, A. P. (2003) · Medicine & Science in Sports & Exercise · doi:10.1249/01.mss.0000079046.01763.8f · Cited by 167
Pitzalis, M. V. (1996) · Cardiovascular Research · doi:10.1016/0008-6363(96)00086-7 · Cited by 167
Resting heart rate variability in men varying in habitual physical activity
Melanson, E. L. (2000) · Medicine & Science in Sports & Exercise · doi:10.1097/00005768-200011000-00012 · Cited by 136
Salo, M., Huikuri, H. V., & Seppänen, T. (2001) · Annals of Noninvasive Electrocardiology · doi:10.1111/j.1542-474x.2001.tb00080.x · Cited by 134
Effect of athletic training on heart rate variability
Sacknoff, D. M., Gleim, G. W., Stachenfeld, N. S., & Coplan, N. L. (1994) · American Heart Journal · doi:10.1016/0002-8703(94)90046-9 · Cited by 127
Heart rate variability - a therapeutic target?
Routledge, H., Chowdhary, S., & Townend, J. (2002) · Journal of Clinical Pharmacy and Therapeutics · doi:10.1046/j.1365-2710.2002.00404.x · Cited by 120
Aerobic training and cardiovascular responses at rest and during exercise in older men and women
Perini, R., Fisher, N. M., Veicsteinas, A., & Pendergast, D. R. (2002) · Medicine & Science in Sports & Exercise · doi:10.1097/00005768-200204000-00022 · Cited by 118
Assessment of the primary effect of aging on heart rate variability in humans
Fukusaki, C., Kawakubo, K., & Yamamoto, Y. (2000) · Clinical Autonomic Research · doi:10.1007/bf02278016 · Cited by 112
(1998) · The MIT Press eBooks · doi:10.7551/mitpress/3348.003.0009 · Cited by 89
Determinants of Short-Period Heart Rate Variability in the General Population
Kuch, B., Hense, H. W., Sinnreich, R., Kark, J. D., von Eckardstein, A., Sapoznikov, D., & Bolte, H.-D. (2001) · Cardiology · doi:10.1159/000047359 · Cited by 86
Stability of index of heart rate variability in patients with congestive heart failure
Stein, P. K., Rich, M. W., Rottman, J. N., & Kleiger, R. E. (1995) · American Heart Journal · doi:10.1016/0002-8703(95)90119-1 · Cited by 84
Short-term heart rate variability in young athletes.
Aubert, A., Beckers, F., & Ramaekers, D. (2001) · PubMed · Cited by 81
Boven, A. J. V., Jukema, J. W., Haaksma, J., Zwinderman, A. H., Crijns, H. J. G. M., & Lie, K. I. (1998) · American Heart Journal · doi:10.1016/s0002-8703(98)70269-8 · Cited by 73
Intraindividual Reproducibility of Heart Rate Variability
HOHNLOSER, S. H., Klingenheben, T., Zabel, M., Schröder, F., & Just, H. M. (1992) · Pacing and Clinical Electrophysiology · doi:10.1111/j.1540-8159.1992.tb03049.x · Cited by 71
Nolan, J., Flapan, A. D., Goodfield, N. E. R., Prescott, R. J., Bloomfield, P. M., Neilson, J. M. M., & Ewing, D. J. (1996) · The American Journal of Cardiology · doi:10.1016/s0002-9149(96)90587-1 · Cited by 69
Ziegler, D., Piolot, R., Straßburger, K., Lambeck, H., & Dannehl, K. (1999) · Hormone and Metabolic Research · doi:10.1055/s-2007-978819 · Cited by 68
Forslund, L., Björkander, I., Ericson, M. O., Held, C., Kahan, T., Rehnqvist, N., & Hjemdahl, P. (2002) · Heart · doi:10.1136/heart.87.5.415 · Cited by 67
Lanza, G. A., Pedrotti, P., Rebuzzi, A. G., Pasceri, V., Quaranta, G., & Maseri, A. (1997) · The American Journal of Cardiology · doi:10.1016/s0002-9149(97)00343-3 · Cited by 61
Leicht, A. S., Allen, G. D., & Hoey, A. J. (2003) · Canadian Journal of Applied Physiology · doi:10.1139/h03-033 · Cited by 59
Burger, A. J., Charlamb, M. J., Weinrauch, L. A., & D’Elia, J. A. (1997) · The American Journal of Cardiology · doi:10.1016/s0002-9149(97)00639-5 · Cited by 57
Reproducibility of Resting Heart Rate Variability With Short Sampling Periods
Marks, B. L., & Lightfoot, J. T. (1999) · Canadian Journal of Applied Physiology · doi:10.1139/h99-026 · Cited by 53
LORD, S. W., SENIOR, R. R., Das, M., Whittam, A. M., Murray, A., & McComb, J. M. (2001) · Clinical Science · doi:10.1042/cs20000111 · Cited by 52
Jáuregui‐Renaud, K., Hermosillo, A. G., Márquez, M. F., Ramos-Aguilar, F., Goribar, M. H., & Cárdenas, M. (2001) · Archives of Medical Research · doi:10.1016/s0188-4409(00)00255-1 · Cited by 51
Freed, L. A., Steín, K. M., Gordon, M., Urban, M., & Kligfield, P. (1994) · The American Journal of Cardiology · doi:10.1016/0002-9149(94)90604-1 · Cited by 46
Scalvini, S., Volterrani, M., Zanelli, E., Pagani, M., MAZZUERO, G., Coats, A. J. S., & Giordano, A. (1998) · International Journal of Cardiology · doi:10.1016/s0167-5273(98)00252-6 · Cited by 45
Weber, F. (1999) · European Heart Journal · doi:10.1053/euhj.1998.1272 · Cited by 38
LORD, S. W., SENIOR, R. R., Das, M., Whittam, A. M., Murray, A., & McComb, J. M. (2000) · Clinical Science · doi:10.1042/cs1000043 · Cited by 36
Gerin, W., Rosofsky, M., Pieper, C. F., & Pickering, T. G. (1993) · Journal of Hypertension · doi:10.1097/00004872-199310000-00018 · Cited by 35
Day‐to‐day variability of cardiac autonomic regulation parameters in normal subjects
Töyry, J. P., Mäntysaari, M., Hartikainen, J. E. K., & Länsimies, E. (1995) · Clinical Physiology · doi:10.1111/j.1475-097x.1995.tb00428.x · Cited by 34
Reproducibility of Heart Rate Variability Measures in Patients with Chronic Heart Failure
Ponikowski, P. P., Piepoli, M. F., Amadi, A. A., Chua, T. P., Harrington, D., Volterrani, M., Colombo, R., MAZZUERO, G., Giordano, A., & Coats, A. J. S. (1996) · Clinical Science · doi:10.1042/cs0910391 · Cited by 33
Furlan, R., Dell’Orto, S., Crivellaro, W., Pizzinelli, P., Cerutti, S., Lombardi, F., Pagani, M., & Malliani, A. (1987) · Journal of Hypertension · Cited by 28
Konrady, A. O., Rudomanov, O. G., Oi, Y., & Shlyakhto, E. V. (2001) · PubMed · Cited by 26
Dionne, I. J., WHITE, M., & Tremblay, A. (2002) · Physiology & Behavior · doi:10.1016/s0031-9384(02)00638-8 · Cited by 26
Cloarec-Blanchard, L., Funck‐Brentano, C., Lipski, M., Jaillon, P., & Macquin‐Mavier, I. (1997) · Clinical Science · doi:10.1042/cs0930021 · Cited by 26
Salo, Voipio‐Pulkki, Jalonen, Helenius, Viikari, & Kantola (1999) · Clinical Physiology · doi:10.1046/j.1365-2281.1999.00165.x · Cited by 21
Piepoli, M. F., Radaelli, A., Ponikowski, P. P., Adamopoulos, S. N., Bernardi, L., Sleight, P., & Coats, A. J. S. (1996) · Clinical Science · doi:10.1042/cs0910087supp · Cited by 20
Reproducibility of beat-by-beat blood pressure and heart rate variability
Parati, G., Omboni, S., Villani, A., Glavina, F., Castiglioni, P., Rienzo, M. D., & Mancia, G. (2001) · Blood Pressure Monitoring · doi:10.1097/00126097-200108000-00011 · Cited by 17
Vardas, P. E., KOGHIADAKIS, G., Orfanakis, A. E., KALAITZAKIS, M., & MANIOS, E. (1994) · Pacing and Clinical Electrophysiology · doi:10.1111/j.1540-8159.1994.tb03827.x · Cited by 15
Bootsma, M., Swenne, C. A., & Bruschke, A. V. G. (1996) · Clinical Cardiology · doi:10.1002/clc.4960190112 · Cited by 13
Evaluating agreement between two methods for measuring the same quantity: A response
Lee, J. (1992) · Computers in Biology and Medicine · doi:10.1016/0010-4825(92)90025-i · Cited by 10
Research works printed but not linked: 12
- Lee, 1992, Evaluating agreement between two methods for measuring the same quantity: a response, Comput Biol Med, 22, 369, 10.1016/0010-4825(92)90025-I · DOI
- Atkinson, 1998, Statistical methods for assessing measurement error (reliability) in variables relevant to sports medicine, Sports Med, 26, 217, 10.2165/00007256-199826040-00002 · DOI
- Pitzalis, 1996, Short- and long-term reproducibility of time and frequency domain heart rate variability measurements in normal subjects, Cardiovasc Res, 32, 226, 10.1016/0008-6363(96)00086-7 · DOI
- Piepoli, 1996, Reproducibility of heart rate variability indices during exercise stress testing and inotrope infusion in chronic heart failure patients, Clin Sci (Lond), 91 Suppl, 87, 10.1042/cs0910087supp · DOI
- Toyry, 1995, Day-to-day variability of cardiac autonomic regulation parameters in normal subjects, Clin Physiol, 15, 39, 10.1111/j.1475-097X.1995.tb00428.x · DOI
- Salo, 1999, Reproducibility of abnormal heart rate variability indices: the case of hypertensive sleep apnoea syndrome, Clin Physiol, 19, 258, 10.1046/j.1365-2281.1999.00165.x · DOI
- Cloarec-Blanchard, 1997, Repeatability of spectral components of short-term blood pressure and heart rate variability during acute sympathetic activation in healthy young male subjects, Clin Sci (Lond), 93, 21, 10.1042/cs0930021 · DOI
- Jauregui-Renaud, 2001, Repeatability of heart rate variability during simple cardiovascular reflex tests on healthy subjects, Arch Med Res, 32, 21, 10.1016/S0188-4409(00)00255-1 · DOI
- Freed, 1994, Reproducibility of power spectral measures of heart rate variability obtained from short-term sampling periods, Am J Cardiol, 74, 972, 10.1016/0002-9149(94)90604-1 · DOI
- Marks, 1999, Reproducibility of resting heart rate variability with short sampling periods, Can J Appl Physiol, 24, 337, 10.1139/h99-026 · DOI
- Dionne, 2002, The reproducibility of power spectrum analysis of heart rate variability before and after a standardized meal, Physiol Behav, 75, 267, 10.1016/S0031-9384(02)00638-8 · DOI
- Hohnloser, 1992, Intraindividual reproducibility of heart rate variability, Pacing Clin Electrophysiol, 15, 2211, 10.1111/j.1540-8159.1992.tb03049.x · DOI
Cited by
Sorted by citations
Goldberger, J. J., Cain, M. E., Hohnloser, S. H., Kadish, A. H., Knight, B. P., Lauer, M. S., Maron, B. J., Page, R. L., Passman, R. S., Siscovick, D., et al. (2008) · Circulation · doi:10.1161/circulationaha.107.189375 · Cited by 1,450
Monitoring training status with HR measures: do all roads lead to Rome?
Buchheit, M. (2014) · Frontiers in Physiology · doi:10.3389/fphys.2014.00073 · Cited by 1,016
NUNAN, D., SANDERCOCK, G. R. H., & BRODIE, D. A. (2010) · Pacing and Clinical Electrophysiology · doi:10.1111/j.1540-8159.2010.02841.x · Cited by 874
Self-citationAlvares, G. A., Quintana, D. S., Hickie, I. B., & Guastella, A. J. (2016) · Journal of Psychiatry and Neuroscience · doi:10.1503/jpn.140217 · Cited by 503
Goldberger, J. J., CAIN, M. E., Hohnloser, S. H., Kadish, A. H., Knight, B. P., Lauer, M. S., Maron, B. J., Page, R. L., PASSMAN, R. S., Siscovick, D. S., et al. (2008) · Journal of the American College of Cardiology · doi:10.1016/j.jacc.2008.05.003 · Cited by 432
Metadata
- Authors
- Sandercock, G. R. H., Bromley, P. D., & Brodie, D. A.
- Corresponding author
- Sandercock, Gavin R.H.
- Venue
- International Journal of Cardiology
- Publisher
- Elsevier BV
- Published
- 2005-09
- Volume
- 103
- Issue
- 3
- Pages
- 238-247
- ISSN
- 0167-5273 (ISSN-L)
- OpenAlex
- W2072450200
- Cited by
- 307
- References
- 72
- Citations by year
- 2026: 9 · 2025: 12 · 2024: 18 · 2023: 13 · 2022: 11 · 2021: 15 · 2020: 29 · 2019: 13 · 2018: 11 · 2017: 13 · 2016: 24 · 2015: 12 · 2014: 14 · 2013: 19 · 2012: 22
- FWCI
- 1.93
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- International Journal of Cardiology (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Health Sciences › Medicine › Cardiology and Cardiovascular Medicine › Heart Rate Variability and Autonomic Control
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Reliability and Agreement in Measurement
- Health Sciences › Medicine › Cardiology and Cardiovascular Medicine › Heart rate and cardiovascular health
- Keywords
- heart rate variability, measurement reliability, autonomic function, intraclass correlation coefficient, limits of agreement, test-retest reliability, clinical populations, healthy volunteers, sample size determination
- MeSH terms
- Heart Rate, Humans, Reproducibility of Results
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review