State-of-the-art sleep arousal detection evaluated on a comprehensive clinical dataset

Publikation: Beitrag in FachzeitschriftForschungsartikelBeigetragenBegutachtung

Abstract

Aiming to apply automatic arousal detection to support sleep laboratories, we evaluated an optimized, state-of-the-art approach using data from daily work in our university hospital sleep laboratory. Therefore, a machine learning algorithm was trained and evaluated on 3423 polysomnograms of people with various sleep disorders. The model architecture is a U-net that accepts 50 Hz signals as input. We compared this algorithm with models trained on publicly available datasets, and evaluated these models using our clinical dataset, particularly with regard to the effects of different sleep disorders. In an effort to evaluate clinical relevance, we designed a metric based on the error of the predicted arousal index. Our models achieve an area under the precision recall curve (AUPRC) of up to 0.83 and F1 scores of up to 0.81. The model trained on our data showed no age or gender bias and no significant negative effect regarding sleep disorders on model performance compared to healthy sleep. In contrast, models trained on public datasets showed a small to moderate negative effect (calculated using Cohen's d) of sleep disorders on model performance. Therefore, we conclude that state-of-the-art arousal detection on our clinical data is possible with our model architecture. Thus, our results support the general recommendation to use a clinical dataset for training if the model is to be applied to clinical data.

Details

OriginalspracheEnglisch
Aufsatznummer16239
FachzeitschriftScientific reports
Jahrgang14
Ausgabenummer1
PublikationsstatusVeröffentlicht - 14 Juli 2024
Peer-Review-StatusJa

Externe IDs

PubMed 39004643
ORCID /0000-0003-4012-0608/work/165060476
ORCID /0000-0003-2126-290X/work/165062747
ORCID /0000-0002-9888-8460/work/165063041

Schlagworte

ASJC Scopus Sachgebiete