Classifying performance impairment in response to sleep loss using pattern recognition algorithms on single session testing
Open accessAbstract
There is currently no "gold standard" marker of cognitive performance impairment resulting from sleep loss. We utilized pattern recognition algorithms to determine which features of data collected under controlled laboratory conditions could most reliably identify cognitive performance impairment in response to sleep loss using data from only one testing session, such as would occur in the "real world" or field conditions. A training set for testing the pattern recognition algorithms was developed using objective Psychomotor Vigilance Task (PVT) and subjective Karolinska Sleepiness Scale (KSS) data collected from laboratory studies during which subjects were sleep deprived for 26-52h. The algorithm was then tested in data from both laboratory and field experiments. The pattern recognition algorithm was able to identify performance impairment with a single testing session in individuals studied under laboratory conditions using PVT, KSS, length of time awake and time of day information with sensitivity and specificity as high as 82%. When this algorithm was tested on data collected under real-world conditions from individuals whose data were not in the training set, accuracy of predictions for individuals categorized with low performance impairment were as high as 98%. Predictions for medium and severe performance impairment were less accurate. We conclude that pattern recognition algorithms may be a promising method for identifying performance impairment in individuals using only current information about the individual's behavior. Single testing features (e.g., number of PVT lapses) with high correlation with performance impairment in the laboratory setting may not be the best indicators of performance impairment under real-world conditions. Pattern recognition algorithms should be further tested for their ability to be used in conjunction with other assessments of sleepiness in real-world conditions to quantify performance impairment in response to sleep loss.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The Psychomotor Vigilance Task has been used to classify individuals regarding their vulnerability or susceptibility to sleep loss.
“Therefore, the PVT has been used to classify individuals regarding their vulnerability or susceptibility to sleep loss55,56.”
From Effects of total sleep deprivation on performance in a manual spacecraft docking task (2024) · cites this paper as [55]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Van Dongen, H. P. A., Maislin, G., Mullington, J. M., & Dinges, D. F. (2003) · Sleep · doi:10.1093/sleep/26.2.117 · Cited by 3,173 · see citing works
Subjective and objective sleepiness in the active individual
Åkerstedt, T., & Gillberg, M. (1990) · International Journal of Neuroscience · doi:10.3109/00207459008994241 · Cited by 3,088 · see citing works
Belenky, G., Wesensten, N. J., Thorne, D. R., Thomas, M. L., Sing, H. C., Redmond, D. P., Russo, M. B., & Balkin, T. J. (2003) · Journal of Sleep Research · doi:10.1046/j.1365-2869.2003.00337.x · Cited by 1,436 · see citing works
Effect of Reducing Interns' Weekly Work Hours on Sleep and Attentional Failures
Lockley, S. W., Cronin, J. W., Evans, E. E., Cade, B. E., Lee, C. J., Landrigan, C. P., Rothschild, J. M., Katz, J. T., Lilly, C. M., Stone, P. H., et al. (2004) · New England Journal of Medicine · doi:10.1056/nejmoa041404 · Cited by 913 · cited 3× · see citing works
“…level of performance impairment and validate these pattern recognition algorithms on data previously collected in a field study of hospital interns (Lockley et al. 2004, Anderson et al. in press) and in a field study of ground control crews working on a Mars sol (T=24.65 hr) schedule (Barger et…”
InfluentialSelf-citationDijk, D.-J., & Czeisler, C. A. (1994) · Neuroscience Letters · doi:10.1016/0304-3940(94)90841-9 · Cited by 628 · see citing works
Circadian and sleep/wake dependent aspects of subjective alertness and cognitive performance
Dijk, D., Duffy, J. F., & Czeisler, C. A. (1992) · Journal of Sleep Research · doi:10.1111/j.1365-2869.1992.tb00021.x · Cited by 602 · see citing works
Paus, T., Zatorre, R. J., Hofle, N., Caramanos, Z., Gotman, J., Petrides, M., & Evans, A. C. (1997) · Journal of Cognitive Neuroscience · doi:10.1162/jocn.1997.9.3.392 · Cited by 514 · see citing works
Neurobehavioral Performance of Residents After Heavy Night Call vs After Alcohol Ingestion
Arnedt, J. T., Owens, J., Crouch, M., Stahl, J., & Carskadon, M. A. (2005) · JAMA · doi:10.1001/jama.294.9.1025 · Cited by 419 · see citing works
Psychomotor Vigilance Performance: Neurocognitive Assay Sensitive to Sleep Loss
Dorrian, J., Rogers, N. L., & Dinges, D. F. (2004) · CRC Press eBooks · doi:10.3109/9780203998007-4 · Cited by 404 · see citing works
The validity of psychomotor vigilance tasks of less than 10-minute duration
Loh, S., Lamond, N., Dorrian, J., Roach, G. D., & Dawson, D. E. (2004) · Behavior Research Methods, Instruments, & Computers · doi:10.3758/bf03195580 · Cited by 347 · see citing works
Fatigue models for applied research in warfighting.
Hursh, S. R., Redmond, D. P., Johnson, M. L., Thorne, D. R., Belenky, G. L., Balkin, T. J., Storm, W. F., Miller, J. C., & Eddy, D. R. (2004) · PubMed · Cited by 266 · see citing works
Uncovering residual effects of chronic sleep loss on human performance
Cohen, D. A., Wang, W., Wyatt, J. K., Kronauer, R. E., Dijk, D.-J., Czeisler, C. A., & Klerman, E. B. (2010) · Science Translational Medicine · doi:10.1126/scitranslmed.3000458 · Cited by 236 · see citing works
Blatter, K., Graw, P., Münch, M. Y., Knoblauch, V., Wirz‐Justice, A., & Cajochen, C. (2006) · Behavioural Brain Research · doi:10.1016/j.bbr.2005.11.018 · Cited by 235 · see citing works
Interactive Mathematical Models of Subjective Alertness and Cognitive Throughput in Humans
Jewett, M. E., & Kronauer, R. E. (1999) · Journal of Biological Rhythms · doi:10.1177/074873099129000920 · Cited by 212 · see citing works
Summary of the key features of seven biomathematical models of human fatigue and performance.
Mallis, M. M., Mejdal, S., Nguyen, T., & Dinges, D. F. (2004) · PubMed · Cited by 210 · see citing works
Healthy Older Adults Better Tolerate Sleep Deprivation Than Young Adults
Duffy, J. F., Willson, H. J., Wang, W., & Czeisler, C. A. (2009) · Journal of the American Geriatrics Society · doi:10.1111/j.1532-5415.2009.02303.x · Cited by 209 · see citing works
Age-Related Reduction in the Maximal Capacity for Sleep—Implications for Insomnia
Klerman, E. B., & Dijk, D. (2008) · Current Biology · doi:10.1016/j.cub.2008.06.047 · Cited by 193 · see citing works
Self-citationSleep Deprivation: Clinical Issues, Pharmacology, and Sleep Loss Effects
Lee, K. A. (2005) · SLEEP · doi:10.1093/sleep/28.6.769 · Cited by 188 · see citing works
Wyatt, J. K., Cajochen, C., Cecco, A. R.-D., Czeisler, C. A., & Dijk, D. (2004) · SLEEP · doi:10.1093/sleep/27.3.374 · Cited by 182 · see citing works
Comparison of mathematical model predictions to experimental data of fatigue and performance.
Dongen, H. P. A. V. (2004) · PubMed · Cited by 181 · see citing works
Roach, G. D., Dawson, D. E., & Lamond, N. (2006) · Chronobiology International · doi:10.1080/07420520601067931 · Cited by 176 · see citing works
Santhi, N., Horowitz, T. S., Duffy, J. F., & Czeisler, C. A. (2007) · PLoS ONE · doi:10.1371/journal.pone.0001233 · Cited by 152 · see citing works
Fatigue assessment in the field: validation of a hand-held electronic psychomotor vigilance task.
Lamond, N., Dawson, D. E., & Roach, G. D. (2005) · PubMed · Cited by 127 · see citing works
(2004) · PubMed · Cited by 120 · see citing works
Anderson, C., Sullivan, J. P., Flynn‐Evans, E. E., Cade, B. E., Czeisler, C. A., & Lockley, S. W. (2012) · SLEEP · doi:10.5665/sleep.2004 · Cited by 96 · see citing works
Self-citationDongen, H. P. A. V., Mott, C. G., Huang, J.-K., Mollicone, D. J., McKenzie, F. D., & Dinges, D. F. (2007) · SLEEP · doi:10.1093/sleep/30.9.1129 · Cited by 88 · see citing works
Abe, T., Nonomura, T., Komada, Y., Asaoka, S., Sasai, T., Ueno, A., & Inoue, Y. (2011) · International Journal of Psychophysiology · doi:10.1016/j.ijpsycho.2011.09.012 · Cited by 83 · see citing works
PVT Lapses Differ According To Eyes Open, Closed, or Looking Away
Anderson, C., Wales, A., & Home, J. A. (2010) · SLEEP · doi:10.1093/sleep/33.2.197 · Cited by 82 · see citing works
Self-citationLearning to Live on a Mars Day: Fatigue Countermeasures during the Phoenix Mars Lander Mission
Barger, L. K., Sullivan, J. P., Vincent, A. S., Fiedler, E. R., McKenna, L. M., Flynn‐Evans, E. E., Gilliland, K., Sipes, W., Smith, P. H., Brainard, G. C., et al. (2012) · SLEEP · doi:10.5665/sleep.2128 · Cited by 63 · see citing works
Self-citationGrady, S., Aeschbach, D., Wright, K. P., & Czeisler, C. A. (2010) · Neuropsychopharmacology · doi:10.1038/npp.2010.63 · Cited by 56 · see citing works
Individualized performance prediction of sleep-deprived individuals with the two-process model.
Rajaraman, S., Gribok, A., Wesensten, N., Balkin, T., & Reifman, J. (2008) · Journal of applied physiology · doi:10.1152/japplphysiol.00877.2007 · Cited by 45 · see citing works
Tucker, A. M., Basner, R. C., Stern, Y., & Rakitin, B. C. (2009) · SLEEP · doi:10.1093/sleep/32.10.1393 · Cited by 40 · see citing works
Flagged first, then by citations
1 of the 34 references couldn’t be matched to a known paper.
Research works printed but not linked: 1
- Witten IH Frank E Transformations: Engineering the input and output Data Mining: Practical Machine Learning Tool and Techniques, second edition 2005 San Francisco Mogab Kaufmann 285 344
Cited by
Sorted by citations
McMahon, W. R., Ftouni, S., Drummond, S. P. A., Maruff, P. T., Lockley, S. W., Rajaratnam, S. M. W., & Anderson, C. (2018) · SLEEP · doi:10.1093/sleep/zsy148 · Cited by 41 · see citing works
Self-citationChua, E. C.-P., Sullivan, J. P., Duffy, J. F., Klerman, E. B., Lockley, S. W., Kristal, B. S., Czeisler, C. A., & Gooley, J. J. (2019) · Scientific Reports · doi:10.1038/s41598-019-48280-4 · Cited by 35 · see citing works
Self-citationSt. Hilaire, M. A., Kristal, B. S., Rahman, S. A., Sullivan, J. P., Quackenbush, J., Duffy, J. F., Barger, L. K., Gooley, J. J., Czeisler, C. A., & Lockley, S. W. (2019) · Scientific Reports · doi:10.1038/s41598-019-52930-y · Cited by 14 · see citing works
Self-citationEffects of total sleep deprivation on performance in a manual spacecraft docking task
Piechowski, S., Kalkoffen, L. J., Benderoth, S., Wolf, O. T., Rittweger, J., Aeschbach, D., & Mühl, C. (2024) · npj Microgravity · doi:10.1038/s41526-024-00361-z · Cited by 12 · see citing works
Bosurgi, G., Pellegrino, O., Sollazzo, G., & Ruggeri, A. (2025) · Traffic Injury Prevention · doi:10.1080/15389588.2025.2546651 · Cited by 3 · see citing works
Lo, J. C.-Y., Ang, J. W. A., Koa, T. B., Ong, J. L., & Lim, J. (2022) · SLEEP Advances · doi:10.1093/sleepadvances/zpac040 · Cited by 2 · see citing works
Enhancing SLA Reliability in Telco Networks through LSTM-Based Time Series Predictions
Alfarobby, D. F., Edward, I. J. M., & Mustafa, A. (2025) · International Conference on Wireless and Telematics (ICWT) · doi:10.1109/icwt66752.2025.11181700
- Authors
- St. Hilaire, M. A., Sullivan, J. P., Anderson, C., Cohen, D. A., Barger, L. K., Lockley, S. W., & Klerman, E. B.
- Affiliations
- Brigham and Women's Hospital (US)
- Venue
- Accident Analysis & Prevention
- Publisher
- Elsevier BV
- Published
- 2013-01
- Volume
- 50
- Pages
- 992-1002
- ISSN
- 0001-4575 (ISSN-L)
- PMC
- PMC3513628
- OpenAlex
- W2026388100
- Cited by
- 7
- References
- 34
- Citations by year
- 2025: 2 · 2024: 1 · 2022: 1 · 2019: 2 · 2018: 1
- FWCI
- 0.00
- Type
- journal article
- Language
- en
- Open access
- green
- www.ncbi.nlm.nih.gov
- Locations
- Accident Analysis & Prevention (publishedVersion)
- PubMed (publishedVersion)
- PubMed Central (acceptedVersion)
- Surrey Research Insight Open Access (The University of Surrey) (submittedVersion)
- Funders
- National Institutes of Health (P01-AG009975, RC2-HL101340-0)
- Centers for Disease Control and Prevention (R01 OH07567)
- National Center for Research Resources (1 UL1 RR025758, M01 RR02635, NNX08AD66A)
- Harvard Catalyst
- National Space Biomedical Research Institute (HFP01701, NCC 9-58 HPF HFP01603)
- Agency for Healthcare Research and Quality (RO1 HS12032)
- Air Force Office of Scientific Research (FA9550-06-0080/O5NL132)
- Harvard Medical School
- National Aeronautics and Space Administration (K02-HD045459, K24-HL105663, RC2-HL101340, T32-HL07901)
- National Institute for Occupational Safety and Health
- Topics
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Sleep and Work-Related Fatigue
- Social Sciences › Psychology › Social Psychology › Human-Automation Interaction and Safety
- Life Sciences › Neuroscience › Cognitive Neuroscience › Sleep and Wakefulness Research
- Keywords
- sleep deprivation, pattern recognition algorithms, psychomotor vigilance task, Karolinska Sleepiness Scale, sleepiness detection, real-world environments, time of day
- MeSH terms
- Adolescent, Adult, Aged, Algorithms, Arousal, Attention, Female, Humans, Male, Middle Aged, Pattern Recognition, Automated, Predictive Value of Tests, Psychomotor Performance, Reaction Time, Sensitivity and Specificity, Sleep Deprivation, Wakefulness
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
