Classification of Depression Through Resting-State Electroencephalogram as a Novel Practice in Psychiatry: Review
Open accessPublished version of a preprint
The DOI matches its Crossref record; 64 of the 64 references it cites were found in a registry or an index.
Abstract
Background: Machine learning applications in health care have increased considerably in the recent past, and this review focuses on an important application in psychiatry related to the detection of depression. Since the advent of computational psychiatry, research based on functional magnetic resonance imaging has yielded remarkable results, but these tools tend to be too expensive for everyday clinical use. Objective: This review focuses on an affordable data-driven approach based on electroencephalographic recordings. Web-based applications via public or private cloud-based platforms would be a logical next step. We aim to compare several different approaches to the detection of depression from electroencephalographic recordings using various features and machine learning models. Methods: To detect depression, we reviewed published detection studies based on resting-state electroencephalogram with final machine learning, and to predict therapy outcomes, we reviewed a set of interventional studies using some form of stimulation in their methodology. Results: We reviewed 14 detection studies and 12 interventional studies published between 2008 and 2019. As direct comparison was not possible due to the large diversity of theoretical approaches and methods used, we compared them based on the steps in analysis and accuracies yielded. In addition, we compared possible drawbacks in terms of sample size, feature extraction, feature selection, classification, internal and external validation, and possible unwarranted optimism and reproducibility. In addition, we suggested desirable practices to avoid misinterpretation of results and optimism. Conclusions: This review shows the need for larger data sets and more systematic procedures to improve the use of the solution for clinical diagnostics. Therefore, regulation of the pipeline and standard requirements for methodology used should become mandatory to increase the reliability and accuracy of the complete methodology for it to be translated to modern psychiatry.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“On the other hand, biomarkers from genetic/omics-related testing and neuroimaging examinations are expensive and have low patient coordination/coverage in real-world settings55,56.”
From Optimizing multi-domain hematologic biomarkers and clinical features for the differential diagnosis of unipolar depression and bipolar depression (2023) · doi:10.1038/s44184-023-00024-z · cites this paper as [55]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Wu, Y. (1999) · Technometrics · doi:10.1080/00401706.1999.10485951 · Cited by 27,221
Data Mining: Practical Machine Learning Tools and Techniques
(2011) · Elsevier eBooks · doi:10.1016/c2009-0-19715-5 · Cited by 25,437
An Introduction to the Bootstrap
Efron, B., & Tibshirani, R. J. (1993) · doi:10.1007/978-1-4899-4541-9 · Cited by 21,230
Lakens, D. (2013) · Frontiers in Psychology · doi:10.3389/fpsyg.2013.00863 · Cited by 10,303
A simulation study of the number of events per variable in logistic regression analysis
Peduzzi, P., Concato, J., Kemper, E., Holford, T. R., & Feinstein, A. R. (1996) · Journal of Clinical Epidemiology · doi:10.1016/s0895-4356(96)00236-3 · Cited by 9,655 · cited 1×
“Peduzzi et al [66] showed the optimal number of events per variable in logistic regression analysis.”
BackgroundRush, A. J., Trivedi, M. H., Wisniewski, S. R., Nierenberg, A. A., Stewart, J. W., Warden, D., Niederehe, G., Thase, M. E., Lavori, P. W., Lebowitz, B. D., et al. (2006) · American Journal of Psychiatry · doi:10.1176/ajp.2006.163.11.1905 · Cited by 5,643 · cited 1×
“Only 11% to 30% of all patients diagnosed with depression reach remission within their first year of treatment [2,3].”
BackgroundRelaxing the Rule of Ten Events per Variable in Logistic and Cox Regression
Vittinghoff, E., & McCulloch, C. E. (2007) · American Journal of Epidemiology · doi:10.1093/aje/kwk052 · Cited by 4,359 · cited 1×
“A minimum rate of 10 cases per predictor is common [64], although it is not a universal recommendation [67].”
BackgroundDeep learning for electroencephalogram (EEG) classification tasks: a review
Craik, A., He, Y., & Contreras-Vidal, J. L. (2019) · Journal of Neural Engineering · doi:10.1088/1741-2552/ab0ab5 · Cited by 1,758 · cited 1×
“As it contains highly structured data, the EEG (a matrix of voltage values as columns/recorded from different electrode voltage and time) is highly suitable for machine learning [10].”
BackgroundCipriani, A., Furukawa, T. A., Salanti, G., Geddes, J. R., Higgins, J. P., Churchill, R., Watanabe, N., Nakagawa, A., Omori, I. M., McGuire, H., et al. (2009) · The Lancet · doi:10.1016/s0140-6736(09)60046-5 · Cited by 1,654
An Introduction to the Bootstrap.
Kimber, A., Efron, B., & Tibshirani, R. J. (1994) · The Statistician · doi:10.2307/2348146 · Cited by 1,245
What is physiologic complexity and how does it change with aging and disease?
Goldberger, A. L., Peng, C.-K., & Lipsitz, L. A. (2002) · Neurobiology of Aging · doi:10.1016/s0197-4580(01)00266-4 · Cited by 871
Montague, P. R., Dolan, R. J., Friston, K. J., & Dayan, P. (2012) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2011.11.018 · Cited by 809
Machine Learning: The Art and Science of Algorithms that Make Sense of Data
Flach, P. (2012) · doi:10.1017/cbo9780511973000 · Cited by 753
Cross-trial prediction of treatment outcome in depression: a machine learning approach
Chekroud, A. M., Zotti, R. J., Shehzad, Z., Gueorguieva, R., Johnson, M. K., Trivedi, M. H., Cannon, T. D., Krystal, J. H., & Corlett, P. R. (2016) · The Lancet Psychiatry · doi:10.1016/s2215-0366(15)00471-x · Cited by 676 · cited 3×
“The authors declared that neuroimaging researchers who begin to develop such predictive models are typically unaware of some of the required considerations to accurately assess model performance and avoid inflated predictions (so-called unwarranted optimism) [4,55,56,59].”
BackgroundDepression, rumination and the default network
Berman, M. G., Peltier, S., Nee, D. E., Kross, E., Deldin, P. J., & Jonides, J. (2011) · Social Cognitive and Affective Neuroscience · doi:10.1093/scan/nsq080 · Cited by 568
Hosseinifard, B., Moradi, M. H., & Rostami, R. (2013) · Computer Methods and Programs in Biomedicine · doi:10.1016/j.cmpb.2012.10.008 · Cited by 558
Wang, X.-J., & Krystal, J. H. (2014) · Neuron · doi:10.1016/j.neuron.2014.10.018 · Cited by 312
A Pervasive Approach to EEG‐Based Depression Detection
Cai, H., Han, J., Chen, Y., Sha, X., Wang, Z., Hu, B., Yang, J., Feng, L., Ding, Z., Chen, Y., et al. (2018) · Complexity · doi:10.1155/2018/5238028 · Cited by 288
Fractality analysis of frontal brain in major depressive disorder
Ahmadlou, M., Adeli, H., & Adeli, A. (2012) · International Journal of Psychophysiology · doi:10.1016/j.ijpsycho.2012.05.001 · Cited by 286
A Novel Depression Diagnosis Index Using Nonlinear Features in EEG Signals
Acharya, U. R., Sudarshan, V. K., Adeli, H., Santhosh, J., Koh, J. E. W., Puthankatti, S. D., & Adeli, A. (2015) · European Neurology · doi:10.1159/000438457 · Cited by 270
A wavelet-based technique to predict treatment outcome for Major Depressive Disorder
Mumtaz, W., Xia, L., Mohd Yasin, M. A., Azhar Ali, S. S., & Malik, A. S. (2017) · PLOS ONE · doi:10.1371/journal.pone.0171409 · Cited by 268
Marquand, A. F., Wolfers, T., Mennes, M., Buitelaar, J., & Beckmann, C. F. (2016) · Biological Psychiatry: Cognitive Neuroscience and Neuroimaging · doi:10.1016/j.bpsc.2016.04.002 · Cited by 263
Mumtaz, W., Xia, L., Ali, S. S. A., Yasin, M. A. M., Hussain, M., & Malik, A. S. (2017) · Biomedical Signal Processing and Control · doi:10.1016/j.bspc.2016.07.006 · Cited by 233
Methods for classifying depression in single channel EEG using linear and nonlinear signal analysis
Bachmann, M., Päeske, L., Kalev, K., Aarma, K., Lehtmets, A., Ööpik, P., Lass, J., & Hinrikus, H. (2018) · Computer Methods and Programs in Biomedicine · doi:10.1016/j.cmpb.2017.11.023 · Cited by 230
Relation Between Structural and Functional Connectivity in Major Depressive Disorder
de Kwaasteniet, B., Ruhe, E., Caan, M., Rive, M., Olabarriaga, S., Groefsema, M., Heesink, L., van Wingen, G., & Denys, D. (2013) · Biological Psychiatry · doi:10.1016/j.biopsych.2012.12.024 · Cited by 229
A meta-analysis of whole-brain diffusion tensor imaging studies in bipolar disorder
Vederine, F.-E., Wessa, M., Leboyer, M., & Houenou, J. (2011) · Progress in Neuro-Psychopharmacology and Biological Psychiatry · doi:10.1016/j.pnpbp.2011.05.009 · Cited by 220
When Optimism Hurts: Inflated Predictions in Psychiatric Neuroimaging
Whelan, R., & Garavan, H. (2014) · Biological Psychiatry · doi:10.1016/j.biopsych.2013.05.014 · Cited by 209
Mumtaz, W., Ali, S. S. A., Yasin, M. A. M., & Malik, A. S. (2018) · Medical & Biological Engineering & Computing · doi:10.1007/s11517-017-1685-z · Cited by 208
Moons, K. G. M., Donders, A. R. T., Steyerberg, E. W., & Harrell, F. E. (2004) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2004.01.020 · Cited by 178
Major Depression Detection from EEG Signals Using Kernel Eigen-Filter-Bank Common Spatial Patterns
Liao, S.-C., Wu, C.-T., Huang, H.-C., Cheng, W.-T., & Liu, Y.-H. (2017) · Sensors · doi:10.3390/s17061385 · Cited by 164
Khodayari-Rostamabad, A., Reilly, J. P., Hasey, G. M., de Bruin, H., & MacCrimmon, D. J. (2013) · Clinical Neurophysiology · doi:10.1016/j.clinph.2013.04.010 · Cited by 161
Ahmadlou, M., Adeli, H., & Adeli, A. (2013) · Clinical EEG and Neuroscience · doi:10.1177/1550059413480504 · Cited by 150
Etkin, A., Patenaude, B., Song, Y. J. C., Usherwood, T., Rekshan, W. R., Schatzberg, A. F., Rush, A. J., & Williams, L. M. (2014) · Neuropsychopharmacology · doi:10.1038/npp.2014.333 · Cited by 143
Disturbed resting state eeg synchronization in bipolar disorder: A graph-theoretic analysis
Kim, D.-J., Bolbecker, A. R., Howell, J., Rass, O., Sporns, O., Hetrick, W. P., Breier, A., & O'Donnell, B. F. (2013) · NeuroImage Clinical · doi:10.1016/j.nicl.2013.03.007 · Cited by 141
Identification of depression subtypes and relevant brain regions using a data-driven approach
Tokuda, T., Yoshimoto, J., Shimizu, Y., Okada, G., Takamura, M., Okamoto, Y., Yamawaki, S., & Doya, K. (2018) · Scientific Reports · doi:10.1038/s41598-018-32521-z · Cited by 136
Taking Psychiatry Research Online
Gillan, C. M., & Daw, N. D. (2016) · Neuron · doi:10.1016/j.neuron.2016.06.002 · Cited by 131
Čukić, M., Stokić, M., Simić, S., & Pokrajac, D. (2020) · Cognitive Neurodynamics · doi:10.1007/s11571-020-09581-x · Cited by 130
Self-citationWhat big data can do for treatment in psychiatry
Gillan, C. M., & Whelan, R. (2017) · Current Opinion in Behavioral Sciences · doi:10.1016/j.cobeha.2017.07.003 · Cited by 127
DEPRESSION DIAGNOSIS SUPPORT SYSTEM BASED ON EEG SIGNAL ENTROPIES
FAUST, O., ANG, P. C. A., PUTHANKATTIL, S. D., & JOSEPH, P. K. (2014) · Journal of Mechanics in Medicine and Biology · doi:10.1142/s0219519414500353 · Cited by 124
Klonowski, W. (2007) · Nonlinear Biomedical Physics · doi:10.1186/1753-4631-1-5 · Cited by 117
PUTHANKATTIL, S. D., & JOSEPH, P. K. (2012) · Journal of Mechanics in Medicine and Biology · doi:10.1142/s0219519412400192 · Cited by 112
Data mining EEG signals in depression for their diagnostic value
Mohammadi, M., Al-Azab, F., Raahemi, B., Richards, G., Jaworska, N., Smith, D., de la Salle, S., Blier, P., & Knott, V. (2015) · BMC Medical Informatics and Decision Making · doi:10.1186/s12911-015-0227-6 · Cited by 111
Computational neuroscience approach to biomarkers and treatments for mental disorders
Yahata, N., Kasai, K., & Kawato, M. (2017) · Psychiatry and Clinical Neurosciences · doi:10.1111/pcn.12502 · Cited by 111
Al-Kaysi, A. M., Al-Ani, A., Loo, C. K., Powell, T. Y., Martin, D. M., Breakspear, M., & Boonstra, T. W. (2017) · Journal of Affective Disorders · doi:10.1016/j.jad.2016.10.021 · Cited by 103
Spectral Asymmetry and Higuchi’s Fractal Dimension Measures of Depression Electroencephalogram
Bachmann, M., Lass, J., Suhhova, A., & Hinrikus, H. (2013) · Computational and Mathematical Methods in Medicine · doi:10.1155/2013/251638 · Cited by 102
Jaworska, N., de la Salle, S., Ibrahim, M.-H., Blier, P., & Knott, V. (2019) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2018.00768 · Cited by 99
Brain’s alpha activity is highly reduced in euthymic bipolar disorder patients
Başar, E., Güntekin, B., Atagün, M. İ., GÖLBAŞI, B. T., Tülay, E. E., & Özerdem, A. (2011) · Cognitive Neurodynamics · doi:10.1007/s11571-011-9172-y · Cited by 95
Khodayari-Rostamabad, A., Hasey, G., MacCrimmon, D. J., Reilly, J. P., & de Bruin, H. (2010) · Clinical Neurophysiology · doi:10.1016/j.clinph.2010.05.009 · Cited by 95
Decrease of complexity in EEG as a symptom of depression
Nandrino, J.-L., Pezard, L., Martinerie, J., El Massioui, F., Renault, B., Jouvent, R., Allilaire, J.-F., & Widlöcher, D. (1994) · NeuroReport · doi:10.1097/00001756-199401120-00042 · Cited by 85
Nonlinear analysis of EEG complexity in episode and remission phase of recurrent depression
Čukić, M., Stokić, M., Radenković, S., Ljubisavljević, M., Simić, S., & Savić, D. (2019) · International Journal of Methods in Psychiatric Research · doi:10.1002/mpr.1816 · Cited by 85
Self-citationKalatzis, I. K., Piliouras, N., Ventouras, E.-C., Papageorgiou, C., Rabavilas, A. D., & Cavouras, D. A. (2003) · Computer Methods and Programs in Biomedicine · doi:10.1016/j.cmpb.2003.09.003 · Cited by 80
Larger Error Signals in Major Depression are Associated with Better Avoidance Learning
Cavanagh, J. F., Bismark, A. J., Frank, M. J., & Allen, J. J. B. (2011) · Frontiers in Psychology · doi:10.3389/fpsyg.2011.00331 · Cited by 79
Erguzel, T. T., Özekes, S., Tan, O., & Gultekin, S. (2014) · Clinical EEG and Neuroscience · doi:10.1177/1550059414523764 · Cited by 78
Lee, T., Wu, Y., Yu, Y. W. ‐., Chen, M., & Chen, T.-J. (2011) · Psychiatry Research Neuroimaging · doi:10.1016/j.pscychresns.2011.02.009 · Cited by 65
Pre-treatment EEG signal variability is associated with treatment success in depression
Jaworska, N., Wang, H., Smith, D., Blier, P., Knott, V., & Protzner, A. B. (2017) · NeuroImage Clinical · doi:10.1016/j.nicl.2017.10.035 · Cited by 61
Non-linear EEG analyses predict non-response to rTMS treatment in major depressive disorder
Arns, M., Cerquera, A., Gutiérrez, R. M., Hasselman, F., & Freund, J. A. (2013) · Clinical Neurophysiology · doi:10.1016/j.clinph.2013.11.022 · Cited by 54
Neural complexity in patients with poststroke depression: A resting EEG study
Zhang, Y., Wang, C., Sun, C., Zhang, X., Wang, Y., Qi, H., He, F., Zhao, X., Wan, B., Du, J., et al. (2015) · Journal of Affective Disorders · doi:10.1016/j.jad.2015.09.017 · Cited by 42
Brain activity of women is more fractal than men
Ahmadi, K., Ahmadlou, M., Rezazade, M., Azad-Marzabadi, E., & Sajedi, F. (2013) · Neuroscience Letters · doi:10.1016/j.neulet.2012.12.043 · Cited by 38
Combining complexity measures of EEG data: multiplying measures reveal previously hidden information
Burns, T., & Rajan, R. (2015) · F1000Research · doi:10.12688/f1000research.6590.1 · Cited by 34
Shahaf, G., Yariv, S., Bloch, B., Nitzan, U., Segev, A., Reshef, A., & Bloch, Y. (2017) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2017.00128 · Cited by 32
Kalauzi, A. J., Bojić, T., & Vučković, A. (2012) · Medical & Biological Engineering & Computing · doi:10.1007/s11517-012-0913-9 · Cited by 31
Bairy, G. M., Bhat, S., Eugene, L. W. J., Niranjan, U. C., Puthankattil, S. D., & Joseph, P. K. (2015) · Journal of Medical Imaging and Health Informatics · doi:10.1166/jmihi.2015.1418 · Cited by 30
Complexity and Irregularity in the Brain Oscillations of Depressive Patients: A Systematic Review
Luque, A. D. L. T., & Bornas, X. (2017) · Neuropsychiatry · doi:10.4172/neuropsychiatry.1000238 · Cited by 28
Combining complexity measures of EEG data: multiplying measures reveal previously hidden informationPreprint
Burns, T. F. (2015) · doi:10.7287/peerj.preprints.1121 · Cited by 1
Research works printed but not linked: 6
- LlamoccaPPJunestrandMCukicMUrgelesDLopezVData Source Analysis in Mood Disorder ResearchXVIII Conference of the Spanish Association of Artificial Intelligence2018CAEPIAOctober 23-27, 2018Granada, Spain
- Puthankattil, SD, 2014, Int J Medical Heal Biomed Bioeng Pharm Eng, 8, 424
- Čukić, M, 2018, arXiv, -
- Efron, R, 2020, J Am Stat Assoc, 548
- NgAYPreventing overfitting of cross-validation dataProceedings of the 14th International Conference on Machine Learning1997ICML'97July 23, 1997Nashville, Tennessee
- KohaviRA Study of Cross-Validation and Bootstrap for Accuracy Estimation and Model Selecti1995International Joint Conference on Artificial Intelligence1995Montreal, Quebec, Canada113743
Cited by
Wu, C., Huang, H.-C., Huang, S., Chen, I., Liao, S., Chen, C., Lin, C., Lee, S., Chen, M., Tsai, C.-F., et al. (2021) · Biosensors · doi:10.3390/bios11120499 · Cited by 100
Khosla, A., Khandnor, P., & Chand, T. (2021) · Journal of Applied Biomedicine · doi:10.1016/j.bbe.2021.12.005 · Cited by 98
An insight into diagnosis of depression using machine learning techniques: a systematic review
Bhadra, S., & Kumar, C. J. (2022) · Current Medical Research and Opinion · doi:10.1080/03007995.2022.2038487 · Cited by 90
Discriminative Power of EEG-Based Biomarkers in Major Depressive Disorder: A Systematic Review
Greco, C., Matarazzo, O., Cordasco, G., Vinciarelli, A., Callejas, Z., & Esposito, A. A. (2021) · IEEE Access · doi:10.1109/access.2021.3103047 · Cited by 84
Machine learning approaches for diagnosing depression using EEG: A review
Liu, Y., Pu, C., Xia, S., Deng, D., Wang, X., & Li, M. (2022) · Translational Neuroscience · doi:10.1515/tnsci-2022-0234 · Cited by 50
Metadata
- Authors
- Čukić, M., López, V., & Pavón, J.
- Affiliations
- Amsterdam health & technology institute (NL)
- Universidad Complutense de Madrid (ES)
- Corresponding author
- Čukić, Milena
- Venue
- Journal of Medical Internet Research
- Publisher
- JMIR Publications Inc.
- Published
- 2020-11-03
- Volume
- 22
- Issue
- 11
- Pages
- e19548
- ISSN
- 1438-8871 (ISSN-L)
- PMC
- PMC7671839
- OpenAlex
- W3083716192
- Cited by
- 45
- References
- 64
- Citations by year
- 2026: 6 · 2025: 3 · 2024: 7 · 2023: 9 · 2022: 15 · 2021: 5
- FWCI
- 0.98
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by
- Locations
- Journal of Medical Internet Research (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Funders
- Horizon 2020 Framework Programme (H2020-MSCA, H2020-MSCA-RISE, 690874, H2020-MSCA-RISE-2015)
- Topics
- Life Sciences › Neuroscience › Cognitive Neuroscience › EEG and Brain-Computer Interfaces
- Physical Sciences › Computer Science › Artificial Intelligence › Emotion and Mood Recognition
- Health Sciences › Medicine › Pharmacology (medical) › Treatment of Major Depression
- Keywords
- depression detection, machine learning classification, computational psychiatry, EEG features, feature selection, treatment outcome prediction, non-invasive brain stimulation, diagnosis, reproducibility, optimism bias
- MeSH terms
- Machine Learning, Depression, Electroencephalography, Humans, Psychiatry, Reproducibility of Results
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.
