Using a Single Daytime Performance Test to Identify Most Individuals at High-Risk for Performance Impairment during Extended Wake

Melissa A. St. Hilaire, Bruce S. Kristal, Shadab A. Rahman, Jason P. Sullivan, John Quackenbush, Jeanne F. Duffy, Laura K. Barger, Joshua J. Gooley, Charles A. Czeisler, Steven W. LockleyScientific 2019 · DOI

Abstract

We explored the predictive value of a neurobehavioral performance assessment under rested baseline conditions (evaluated at 8 hours awake following 8 hours of sleep) on neurobehavioral response to moderate sleep loss (evaluated at 20 hours awake two days later) in 151 healthy young participants (18-30 years). We defined each participant's response-to-sleep-loss phenotype based on the number of attentional failures on a 10-min visual psychomotor vigilance task (PVT) taken at 20 hours awake (resilient: less than 6 attentional failures, n = 26; non-resilient: 6 or more attentional failures, n = 125). We observed that 97% of rested participants with 2 or more attentional failures and 100% of rested participants with 3 or more attentional failures were non-resilient after moderate sleep loss. Our approach can accurately identify a significant proportion of individuals who are at high risk for neurobehavioral performance impairment from staying up late with a single neurobehavioral performance assessment conducted during rested conditions.

Introduction

Sleep deprivation significantly impacts productivity and safety, yet individuals exhibit varied neurobehavioral responses to sleep loss. Identifying "vulnerable" individuals—those who show immediate and dangerous cognitive declines—before accidents occur is critical for safety-sensitive industries like medicine, transportation, and aviation. Current predictive models often require extensive laboratory monitoring or complex mathematical modeling, making them impractical for rapid workplace screening. This study investigates whether a simple, fast, and reliable screening tool can identify high-risk individuals under normal, rested conditions.

Methods

The study utilized the Psychomotor Vigilance Task (PVT), a 10-minute test measuring reaction times to visual stimuli. "Attentional failures" or "lapses" were defined as reaction times exceeding 500 milliseconds. Researchers compared four predictive metrics, ranging from simple lapse counts to complex Principal Component Analysis (PCA) of 74 variables across multiple cognitive tests. The primary goal was to determine if performance at 8 hours awake (rested baseline) could predict performance at 20 hours awake (extended wakefulness). The study involved a primary dataset of 151 healthy participants, with validation and prospective datasets to ensure robustness.

Key Insights: Trait-Like Vulnerability

The results reinforce the concept that response to sleep loss is a stable, trait-like characteristic. Individuals with a lower baseline threshold for attentional lapses experience exaggerated impairment as homeostatic sleep pressure increases.

Figure 4: Mean attentional failures for resilient (blue), intermediate (orange), and vulnerable (red) groups across the study days.

Surprisingly, simple lapse counts performed as well as complex mathematical models. This suggests that high-risk individuals can be identified without sophisticated computational resources. However, while the test effectively identifies those likely to fail, a good baseline performance does not guarantee resilience under extreme exhaustion.

Key Results and Predictive Power

The study identified specific thresholds for identifying high-risk individuals. Using a single daytime test, the "2-lapse rule" correctly identified 57% of all non-resilient individuals in the study.

  • 2-Lapse Threshold: 97% of participants with ≥2 lapses while rested were "non-resilient" (≥6 lapses) at 20 hours awake.
  • 3-Lapse Threshold: 100% of participants with ≥3 lapses while rested were non-resilient when sleep-deprived.
Figure 6: Predictive accuracy of the attentional failure threshold for identifying non-resilient individuals.

These findings were robust across different times of day and were validated using independent and prospective datasets, suggesting high practical utility for screening.

Limitations and Future Directions

While promising, the study's focus on healthy 18–30-year-olds necessitates further research to determine if these thresholds apply to older adults or shift workers. Additionally, real-world factors like caffeine use and bright light exposure, which were controlled in the lab, may influence the test's predictive power. Finally, since the test missed approximately 43% of non-resilient individuals who performed well while rested, future work may need to incorporate biological markers to achieve comprehensive screening.

Summary updated

Abstract

We explored the predictive value of a neurobehavioral performance assessment under rested baseline conditions (evaluated at 8 hours awake following 8 hours of sleep) on neurobehavioral response to moderate sleep loss (evaluated at 20 hours awake two days later) in 151 healthy young participants (18-30 years). We defined each participant's response-to-sleep-loss phenotype based on the number of attentional failures on a 10-min visual psychomotor vigilance task taken at 20 hours awake (resilient: less than 6 attentional failures, n = 26 participants; non-resilient: 6 or more attentional failures, n = 125 participants). We observed that 97% of rested participants with 2 or more attentional failures (n = 73 of 151) and 100% of rested participants with 3 or more attentional failures (n = 57 of 151) were non-resilient after moderate sleep loss. Our approach can accurately identify a significant proportion of individuals who are at high risk for neurobehavioral performance impairment from staying up late with a single neurobehavioral performance assessment conducted during rested conditions. Additional methods are needed to predict the future performance of individuals who are not identified as high risk during baseline.
BibTeX
@inproceedings{hilaire2019using,
  author = {Melissa A. St. Hilaire and Bruce S. Kristal and Shadab A. Rahman and Jason P. Sullivan and John Quackenbush and Jeanne F. Duffy and Laura K. Barger and Joshua J. Gooley and Charles A. Czeisler and Steven W. Lockley},
  title = {{Using a Single Daytime Performance Test to Identify Most Individuals at High-Risk for Performance Impairment during Extended Wake}},
  booktitle = {Scientific},
  year = {2019},
  doi = {10.1038/s41598-019-52930-y},
}
Figure