Alternatives to polysomnography (PSG): a validation of wrist actigraphy and a partial-PSG system
Open accessAbstract
The objective of this study was to assess the validity of a sleep/wake activity monitor, an energy expenditure activity monitor, and a partial-polysomnography system at measuring sleep and wake under identical conditions. Secondary aims were to evaluate the sleep/wake thresholds for each activity monitor and to compare the three devices. To achieve these aims, two nights of sleep were recorded simultaneously with polysomnography (PSG), two activity monitors, and a partial-PSG system in a sleep laboratory. Agreement with PSG was evaluated epoch by epoch and with summary measures including total sleep time (TST) and wake after sleep onset (WASO). All of the devices had high agreement rates for identifying sleep and wake, but the partial-PSG system was the best, with an agreement of 91.6% ± 5.1%. At their best thresholds, the sleep/wake monitor (medium threshold, 87.7% ± 7.6%) and the energy expenditure monitor (very low threshold, 86.8% ± 8.6%) had similarly high rates of agreement. The summary measures were similar to those determined by PSG, but the partial-PSG system provided the most consistent estimates. Although the partial-PSG system was the most accurate device, both activity monitors were also valid for sleep estimation, provided that appropriate thresholds were selected. Each device has advantages, so the primary consideration for researchers will be to determine which best suits a given research design.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The use of activity monitors to assess sleep is a valid alternative to the gold-standard method of polysomnography.
“The use of activity monitors to assess sleep is a valid alternative to the goldstandard method of polysomnography, but the devices tend to overestimate sleep duration and underestimate wake duration [90].”
From The effect of caffeine on subsequent sleep: A systematic review and meta-analysis (2023) · cites this paper as [90]
Activity monitors tend to overestimate sleep duration and underestimate wake duration.
“The use of activity monitors to assess sleep is a valid alternative to the goldstandard method of polysomnography, but the devices tend to overestimate sleep duration and underestimate wake duration [90].”
From The effect of caffeine on subsequent sleep: A systematic review and meta-analysis (2023) · cites this paper as [90]
Cites
The Measurement of Observer Agreement for Categorical Data
Landis, J. R., & Koch, G. G. (1977) · Biometrics · doi:10.2307/2529310 · Cited by 81,148 · see citing works
STATISTICAL METHODS FOR ASSESSING AGREEMENT BETWEEN TWO METHODS OF CLINICAL MEASUREMENT
Martin Bland, J., & Altman, D. (1986) · The Lancet · doi:10.1016/s0140-6736(86)90837-8 · Cited by 47,965 · see citing works
Rechtschaffen, A. (1968) · Medical Entomology and Zoology · Cited by 11,772 · see citing works
Hobson, J. A. (1969) · Electroencephalography and Clinical Neurophysiology · doi:10.1016/0013-4694(69)90021-2 · Cited by 5,215 · see citing works
The kappa statistic in reliability studies: use, interpretation, and sample size requirements
Sim, J., & Wright, C. C. (2005) · Physical Therapy · doi:10.1093/ptj/85.3.257 · Cited by 4,093 · see citing works
Automatic sleep/wake identification from wrist activity.
Cole, R., Kripke, D., Gruen, W., Mullaney, D., & Gillin, J. (1992) · Sleep · doi:10.1093/sleep/15.5.461 · Cited by 1,971 · see citing works
Guidelines for the Multiple Sleep Latency Test (MSLT): A Standard Measure of Sleepiness
Carskadon, M. A. (1986) · SLEEP · doi:10.1093/sleep/9.4.519 · Cited by 1,607 · see citing works
Activity-Based Sleep-Wake Identification: An Empirical Test of Methodological Issues
Sadeh, A., Sharkey, M., & Carskadon, M. A. (1994) · Sleep · doi:10.1093/sleep/17.3.201 · Cited by 1,487 · see citing works
Kushida, C. A., Chang, A., Patil, C. G., Guilleminault, C., Carrillo, O., & Dement, W. C. (2001) · Sleep Medicine · doi:10.1016/s1389-9457(00)00098-8 · Cited by 997 · see citing works
Aviation, space, and environmental medicine
(1981) · Journal of Sound and Vibration · doi:10.1016/0022-460x(81)90456-9 · Cited by 933 · see citing works
Further Validation of Actigraphy for Sleep Studies
de Souza, L., Benedito‐Silva, A. A., Pires, M. L. N., Poyares, D. R., Tufik, S., & Calil, H. M. (2003) · SLEEP · doi:10.1093/sleep/26.1.81 · Cited by 587 · see citing works
van de Water, A. T. M., HOLMES, A., & Hurley, D. A. (2010) · Journal of Sleep Research · doi:10.1111/j.1365-2869.2009.00814.x · Cited by 454 · see citing works
Acebo, C., Sadeh, A., Seifer, R., Tzischinsky, O., Hafer, A., & Carskadon, M. A. (2005) · SLEEP · doi:10.1093/sleep/28.12.1568 · Cited by 437 · see citing works
Predicting Activity Energy Expenditure Using the Actical® Activity Monitor
Heil, D. P. (2006) · Research Quarterly for Exercise and Sport · doi:10.1080/02701367.2006.10599333 · Cited by 353 · see citing works
Wake Detection Capacity of Actigraphy During Sleep
Paquet, J., Kawinska, A., & Carrier, J. (2007) · SLEEP · doi:10.1093/sleep/30.10.1362 · Cited by 345 · see citing works
Sleep estimation from wrist movement quantified by different actigraphic modalities
Jean‐Louis, G., Kripke, D. F., Mason, W. J., Elliott, J. A., & Youngstedt, S. D. (2001) · Journal of Neuroscience Methods · doi:10.1016/s0165-0270(00)00364-2 · Cited by 302 · see citing works
Sargent, C., Halson, S. L., & Roach, G. D. (2012) · European Journal of Sport Science · doi:10.1080/17461391.2012.696711 · Cited by 265 · see citing works
Self-citationValidity of Activity-Based Devices to Estimate Sleep
Weiss, A. R., Johnson, N. L., Berger, N. A., & Redline, S. S. (2010) · Journal of Clinical Sleep Medicine · doi:10.5664/jcsm.27874 · Cited by 225 · see citing works
Validation of an automated wireless system to monitor sleep in healthy adults
SHAMBROOM, J. R., FÁBREGAS, S. E., & JOHNSTONE, J. (2012) · Journal of Sleep Research · doi:10.1111/j.1365-2869.2011.00944.x · Cited by 216 · see citing works
Sleep measurement in flight crew: comparing actigraphic and subjective estimates to polysomnography.
Signal, T. L., Gale, J., & Gander, P. H. (2005) · PubMed · Cited by 160 · see citing works
Validation of actigraphy for determining sleep and wake in children with sleep disordered breathing
HYDE, M., O’Driscoll, D. M., BINETTE, S., GALANG, C., TAN, S. K., Verginis, N., Davey, M. J., & Horne, R. S. C. (2007) · Journal of Sleep Research · doi:10.1111/j.1365-2869.2007.00588.x · Cited by 149 · see citing works
Sleep Estimates Using Microelectromechanical Systems (MEMS)
Lindert, B. H. W. T., & Someren, E. J. W. V. (2013) · SLEEP · doi:10.5665/sleep.2648 · Cited by 137 · see citing works
Actigraphic assessment of a polysomnographic-recorded nap: a validation study
Kanady, J. C., Drummond, S. P. A., & Mednick, S. C. (2010) · Journal of Sleep Research · doi:10.1111/j.1365-2869.2010.00858.x · Cited by 101 · see citing works
Rupp, T. L., & Balkin, T. J. (2011) · Behavior Research Methods · doi:10.3758/s13428-011-0098-4 · Cited by 98 · see citing works
Galland, B. C., Kennedy, G., Mitchell, E. A., & Taylor, B. J. (2012) · Sleep Medicine · doi:10.1016/j.sleep.2012.01.018 · Cited by 80 · see citing works
Assessment of a wireless headband for automatic sleep scoring
Griessenberger, H., Heib, D. P. J., Kunz, A. B., Hoedlmoser, K., & Schabus, M. (2012) · Sleep And Breathing · doi:10.1007/s11325-012-0757-4 · Cited by 80 · see citing works
Roach, G. D., Sargent, C., Darwent, D., & Dawson, D. (2012) · Accident Analysis & Prevention · doi:10.1016/j.aap.2011.09.020 · Cited by 62 · see citing works
Reid, K. J., & Dawson, D. E. (1999) · SLEEP · doi:10.1093/sleep/22.3.378 · Cited by 61 · see citing works
Roach, G. D., Petrilli, R. M. A., Dawson, D., & Lamond, N. (2012) · Chronobiology International · doi:10.3109/07420528.2012.675222 · Cited by 54 · see citing works
Self-citationEvans, D. S., Snitker, S., Wu, S.-H., Mody, A., Njajou, O. T., Perlis, M. L., Gehrman, P. R., Shuldiner, A. R., & Hsueh, W.-C. (2011) · SLEEP · doi:10.1093/sleep/34.5.661 · Cited by 53 · see citing works
Carney, C. E., Lajos, L. E., & Waters, W. F. (2004) · Behavioral Sleep Medicine · doi:10.1207/s15402010bsm0203_2 · Cited by 47 · see citing works
Mood Change and Perception of Workload in Australian Midwives
Paterson, J. L., Dorrian, J., Pincombe, J. I., Grech, C., & Dawson, D. E. (2010) · Industrial Health · doi:10.2486/indhealth.mssw-01 · Cited by 29 · see citing works
How well do truck drivers sleep in cabin sleeper berths?
Darwent, D., Roach, G. D., & Dawson, D. E. (2011) · Applied Ergonomics · doi:10.1016/j.apergo.2011.06.019 · Cited by 25 · see citing works
Self-citationActigraph Estimates of the Sleep of Australian Midwives
TREMAINE, R. B., Dorrian, J., Paterson, J. L., Neall, A. M., Piggott, E., Grech, C., & Pincombe, J. I. (2011) · Biological Research For Nursing · doi:10.1177/1099800411422249 · Cited by 21 · see citing works
Measuring sleep–wake patterns with physical activity and energy expenditure monitors
Robillard, R., Lambert, T., & Rogers, N. L. (2011) · Biological Rhythm Research · doi:10.1080/09291016.2011.614794 · Cited by 9 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
Miller, D. J., Sargent, C., & Roach, G. D. (2022) · Sensors · doi:10.3390/s22166317 · Cited by 328 · see citing works
“Low specificity, or high variability in specificity, is a common finding when validating devices that rely predominantly on actigraphy to esti ‐ mate sleep [9,10,21,24].”
Self-citationThe effect of caffeine on subsequent sleep: A systematic review and meta-analysis
Gardiner, C., Weakley, J., Burke, L. M., Roach, G. D., Sargent, C., Maniar, N., Townshend, A., & Halson, S. L. (2023) · Sleep Medicine Reviews · doi:10.1016/j.smrv.2023.101764 · Cited by 315 · see citing works
“The use of activity monitors to assess sleep is a valid alternative to the gold-standard method of polysomnography, but the devices tend to overestimate sleep duration and underestimate wake duration [90].”
MethodSelf-citationMantua, J., Gravel, N., & Spencer, R. (2016) · Sensors · doi:10.3390/s16050646 · Cited by 314 · see citing works
How Much Sleep Does an Elite Athlete Need?
Sargent, C., Lastella, M., Halson, S. L., & Roach, G. D. (2021) · International Journal of Sports Physiology and Performance · doi:10.1123/ijspp.2020-0896 · Cited by 124 · see citing works
Self-citationKatori, M., Shi, S., Ode, K. L., Tomita, Y., & Ueda, H. R. (2022) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2116729119 · Cited by 75 · see citing works
Saner, N. J., Lee, M. J. ‐., Pitchford, N. W., Kuang, J., Roach, G. D., Garnham, A., Stokes, T., Phillips, S. M., Bishop, D. J., & Bartlett, J. D. (2020) · The Journal of Physiology · doi:10.1113/jp278828 · Cited by 68 · see citing works
Self-citationMahloko, L., & Adebesin, F. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-45002-1_9 · Cited by 23 · see citing works
- Authors
- Kosmadopoulos, A., Sargent, C., Darwent, D., Zhou, X., & Roach, G. D.
- Affiliations
- Central Queensland University (AU)
- Corresponding author
- Kosmadopoulos, Anastasi
- Venue
- Behavior Research Methods
- Published
- 2014-01-18
- Volume
- 46
- Issue
- 4
- Pages
- 1032-1041
- ISSN
- 1554-351X (ISSN-L)
- 1554-3528
- OpenAlex
- W2055846540
- Cited by
- 160
- References
- 35
- Citations by year
- 2026: 6 · 2025: 24 · 2024: 13 · 2023: 15 · 2022: 13 · 2021: 17 · 2020: 16 · 2019: 18 · 2018: 12 · 2017: 6 · 2016: 8 · 2015: 10 · 2014: 2
- FWCI
- 12.02
- Type
- journal article
- Language
- en
- Open access
- green
- figshare.com
- Locations
- Behavior Research Methods (publishedVersion)
- PubMed (publishedVersion)
- Acquire (CQUniversity) (submittedVersion)
- Figshare (submittedVersion, cc-by)
- Topics
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Sleep and related disorders
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Context-Aware Activity Recognition Systems
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Sleep and Work-Related Fatigue
- Keywords
- wrist actigraphy, sleep estimation, total sleep time, wake after sleep onset
- MeSH terms
- Activity Cycles, Adult, Energy Metabolism, Female, Humans, Male, Reference Values, Research Design, Sleep, Wrist, Polysomnography, Young Adult, Actigraphy, Wireless Technology
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
