This paper proposes a deep learning model, named DeepSleepNet, for automatic sleep stage scoring based on raw single-channel EEG. Most of the existing methods rely on hand-engineered features, which require prior knowledge of sleep analysis. Only a few of them encode the temporal information, such as transition rules, which is important for identifying the next sleep stages, into the extracted features. In the proposed model, we utilize convolutional neural networks to extract time-invariant features, and bidirectional-long short-term memory to learn transition rules among sleep stages automatically from EEG epochs. We implement a two-step training algorithm to train our model efficiently. We evaluated our model using different single-channel EEGs (F4-EOG (left), Fpz-Cz, and Pz-Oz) from two public sleep data sets, that have different properties (e.g., sampling rate) and scoring standards (AASM and R&K). The results showed that our model achieved similar overall accuracy and macro F1-score (MASS: 86.2%−81.7, Sleep-EDF: 82.0%−76.9) compared with the state-of-the-art methods (MASS: 85.9%−80.5, Sleep-EDF: 78.9%−73.7) on both data sets. This demonstrated that, without changing the model architecture and the training algorithm, our model could automatically learn features for sleep stage scoring from different raw single-channel EEGs from different data sets without utilizing any hand-engineered features.

DeepSleepNet: A Model for Automatic Sleep Stage Scoring Based on Raw Single-Channel EEG

Objective Electroencephalography (EEG) analysis has been an important tool in neuroscience with applications in neuroscience, neural engineering (e.g. Brain-computer interfaces, BCI's), and even commercial applications. Many of the analytical tools used in EEG studies have used machine learning to uncover relevant information for neural classification and neuroimaging. Recently, the availability of large EEG data sets and advances in machine learning have both led to the deployment of deep learning architectures, especially in the analysis of EEG signals and in understanding the information it may contain for brain functionality. The robust automatic classification of these signals is an important step towards making the use of EEG more practical in many applications and less reliant on trained professionals. Towards this goal, a systematic review of the literature on deep learning applications to EEG classification was performed to address the following critical questions: (1) Which EEG classification tasks have been explored with deep learning? (2) What input formulations have been used for training the deep networks? (3) Are there specific deep learning network structures suitable for specific types of tasks? Approach A systematic literature review of EEG classification using deep learning was performed on Web of Science and PubMed databases, resulting in 90 identified studies. Those studies were analyzed based on type of task, EEG preprocessing methods, input type, and deep learning architecture. Main results For EEG classification tasks, convolutional neural networks, recurrent neural networks, deep belief networks outperform stacked auto-encoders and multi-layer perceptron neural networks in classification accuracy. The tasks that used deep learning fell into five general groups: emotion recognition, motor imagery, mental workload, seizure detection, event related potential detection, and sleep scoring. For each type of task, we describe the specific input formulation, major characteristics, and end classifier recommendations found through this review. Significance This review summarizes the current practices and performance outcomes in the use of deep learning for EEG classification. Practical suggestions on the selection of many hyperparameters are provided in the hope that they will promote or guide the deployment of deep learning to EEG datasets in future research.

https://iopscience.iop.org/article/10.1088/1741-2552/ab0ab5/pdf

Deep learning for electroencephalogram (EEG) classification tasks: a review.

Deep learning for healthcare applications based on physiological signals: A review.

Context Electroencephalography (EEG) is a complex signal and can require several years of training, as well as advanced signal processing and feature extraction methodologies to be correctly interpreted. Recently, deep learning (DL) has shown great promise in helping make sense of EEG signals due to its capacity to learn good feature representations from raw data. Whether DL truly presents advantages as compared to more traditional EEG processing approaches, however, remains an open question. Objective In this work, we review 154 papers that apply DL to EEG, published between January 2010 and July 2018, and spanning different application domains such as epilepsy, sleep, brain-computer interfacing, and cognitive and affective monitoring. We extract trends and highlight interesting approaches from this large body of literature in order to inform future research and formulate recommendations. Methods Major databases spanning the fields of science and engineering were queried to identify relevant studies published in scientific journals, conferences, and electronic preprint repositories. Various data items were extracted for each study pertaining to (1) the data, (2) the preprocessing methodology, (3) the DL design choices, (4) the results, and (5) the reproducibility of the experiments. These items were then analyzed one by one to uncover trends. Results Our analysis reveals that the amount of EEG data used across studies varies from less than ten minutes to thousands of hours, while the number of samples seen during training by a network varies from a few dozens to several millions, depending on how epochs are extracted. Interestingly, we saw that more than half the studies used publicly available data and that there has also been a clear shift from intra-subject to inter-subject approaches over the last few years. About [Formula: see text] of the studies used convolutional neural networks (CNNs), while [Formula: see text] used recurrent neural networks (RNNs), most often with a total of 3-10 layers. Moreover, almost one-half of the studies trained their models on raw or preprocessed EEG time series. Finally, the median gain in accuracy of DL approaches over traditional baselines was [Formula: see text] across all relevant studies. More importantly, however, we noticed studies often suffer from poor reproducibility: a majority of papers would be hard or impossible to reproduce given the unavailability of their data and code. Significance To help the community progress and share work more effectively, we provide a list of recommendations for future studies and emphasize the need for more reproducible research. We also make our summary table of DL and EEG papers available and invite authors of published work to contribute to it directly. A planned follow-up to this work will be an online public benchmarking portal listing reproducible results.

https://iopscience.iop.org/article/10.1088/1741-2552/ab260c/pdf

Deep learning-based electroencephalography analysis: a systematic review.

The existing sleep stages classification methods are mainly based on time or frequency features. This paper classifies the sleep stages based on graph domain features from a single-channel electroencephalogram (EEG) signal. First, each epoch (30 s) EEG signal is mapped into a visibility graph (VG) and a horizontal VG (HVG). Second, a difference VG (DVG) is obtained by subtracting the edges set of the HVG from the edges set of the VG to extract essential degree sequences and to detect the gait-related movement artifact recordings. The mean degrees (MDs) and degree distributions (DDs) P (k) on HVGs and DVGs are analyzed epoch-by-epoch from 14,963 segments of EEG signals. Then, the MDs of each DVG and HVG and seven distinguishable DD values of P (k) from each DVG are extracted. Finally, nine extracted features are forwarded to a support vector machine to classify the sleep stages into two, three, four, five, and six states. The accuracy and kappa coefficients of six-state classification are 87.5% and 0.81, respectively. It was found that the MDs of the VGs on the deep sleep stage are higher than those on the awake and light sleep stages, and the MDs of the HVGs are just the reverse.

Analysis and classification of sleep stages based on difference visibility graphs from a single-channel EEG signal

Increasing depth of sleep corresponds to an increasing gain in the neuronal feedback loops that generate the low-frequency (slow-wave) electroencephalogram (EEG). The authors derived the maximum-likelihood estimator of the feedback gain and applied it to quantify sleep depth. The estimator computes the fraction (0%-100%) of the current slow wave which continues in the near future (0.02 s later) EEG. Therefore, this percentage was dubbed slow-wave microconfinuity (SW%). It is not affected by anatomical parameters such as skull thickness, which can considerably bias the commonly used slow-wave power (SWP). In the authors' study, both of the estimators SW% and SWP were monitored throughout two nights in 22 subjects. Each subject took temazepam (a benzodiazepine) on one of the two nights, Both estimators detected the effects of age, temazepam, and time of night on sleep. Females were found to have twice the SWP of males, but no gender effect on SW% was found. This confirms earlier reports that gender affects SWP but not sleep depth. Subjectively assessed differences in sleep quality between the nights were correlated to differences in SW%, not in SWP. These results demonstrate that slow-wave microcontinuity, being based on a physiological model of sleep, reflects sleep depth more closely than SWP does.

J.J.L. Oberye

Papers

Analysis of a sleep-dependent neuronal feedback loop: the slow-wave microcontinuity of the EEG

Model-based delta plots beat power-based ones.