The DOI matches its Crossref record; 47 of the 47 references it cites were found in a registry or an index.
Machine Learning and Neurosurgical Outcome Prediction: A Systematic Review
Open accessAbstract
Objective Accurate measurement of surgical outcomes is highly desirable to optimize surgical decision-making. An important element of surgical decision making is identification of the patient cohort that will benefit from surgery before the intervention. Machine learning (ML) enables computers to learn from previous data to make accurate predictions on new data. In this systematic review, we evaluate the potential of ML for neurosurgical outcome prediction.Methods A systematic search in the PubMed and Embase databases was performed to identify all potential relevant studies up to January 1, 2017.Results Thirty studies were identified that evaluated ML algorithms used as prediction models for survival, recurrence, symptom improvement, and adverse events in patients undergoing surgery for epilepsy, brain tumor, spinal lesions, neurovascular disease, movement disorders, traumatic brain injury, and hydrocephalus. Depending on the specific prediction task evaluated and the type of input features included, ML models predicted outcomes after neurosurgery with a median accuracy and area under the receiver operating curve of 94.5% and 0.83, respectively. Compared with logistic regression, ML models performed significantly better and showed a median absolute improvement in accuracy and area under the receiver operating curve of 15% and 0.06, respectively. Some studies also demonstrated a better performance in ML models compared with established prognostic indices and clinical experts.Conclusions In the research setting, ML has been studied extensively, demonstrating an excellent performance in outcome prediction for a wide range of neurosurgical conditions. However, future studies should investigate how ML can be implemented as a practical tool supporting neurosurgical care.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“ML tools for optimizing care outcomes have been used in various settings, including critical care for optimizing sepsis management (27), management of chronic conditions (28), and optimizing surgical outcomes (29).”
From Accessing Artificial Intelligence for Clinical Decision-Making (2021) · cites this paper as [29]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Machine learning: Trends, perspectives, and prospects
Jordan, M. I., & Mitchell, T. M. (2015) · Science · doi:10.1126/science.aaa8415 · Cited by 9,955
Statistical Modeling: The Two Cultures (with comments and a rejoinder by the author)
Breiman, L. (2001) · Statistical Science · doi:10.1214/ss/1009213726 · Cited by 4,340
Predicting the future - big data, machine learning, and clinical medicine
Obermeyer, Z., & Emanuel, E. J. (2016) · New England Journal of Medicine · doi:10.1056/nejmp1606181 · Cited by 3,652
Deo, R. C. (2015) · Circulation · doi:10.1161/circulationaha.115.001593 · Cited by 3,466
Machine Learning Applications in Cancer Prognosis and Prediction
Kourou, K., Exarchos, T. P., Exarchos, K. P., Karamouzis, M. V., & Fotiadis, D. I. (2015) · Computational and Structural Biotechnology Journal · doi:10.1016/j.csbj.2014.11.005 · Cited by 3,338
Probabilistic machine learning and artificial intelligence
Ghahramani, Z. (2015) · Nature · doi:10.1038/nature14541 · Cited by 1,995
Applications of Machine Learning in Cancer Prediction and Prognosis
Cruz, J. A., & Wishart, D. S. (2006) · Cancer Informatics · doi:10.1177/117693510600200030 · Cited by 1,371
Applications of machine learning in cancer prediction and prognosis.
Cruz, J. A., & Wishart, D. S. (2007) · PubMed Central · Cited by 879
Natural and Artificial Intelligence in Neurosurgery: A Systematic Review
Senders, J. T., Arnaout, O. M., Karhade, A. V., Dasenbrock, H. H., Gormley, W. B., Broekman, M. L. D., & Smith, T. R. (2017) · Neurosurgery · doi:10.1093/neuros/nyx384 · Cited by 271
Self-citationMachine Learning Approaches for Predicting Radiation Therapy Outcomes: A Clinician's Perspective
Kang, J., Schwartz, R. S., Flíckinger, J. C., & Beriwal, S. (2015) · International Journal of Radiation Oncology*Biology*Physics · doi:10.1016/j.ijrobp.2015.07.2286 · Cited by 227
Artificial neural networks for diagnosis and survival prediction in colon cancer
Ahmed, F. (2005) · Molecular Cancer · doi:10.1186/1476-4598-4-29 · Cited by 223
Akbari, H., Macyszyn, L. J., Da, X., Bilello, M., Wolf, R. L., Martinez‐Lage, M., Biros, G., Alonso‐Basanta, M., O’Rourke, D. M., & Davatzikos, C. A. (2016) · Neurosurgery · doi:10.1227/neu.0000000000001202 · Cited by 164
Munsell, B. C., Chong-yaw Wee, A., Keller, S. S., Weber, B., Elger, C. E., da Silva, L. A. T., Nesland, T., Styner, M. A., Shen, D. G., & Bonilha, L. (2015) · NeuroImage · doi:10.1016/j.neuroimage.2015.06.008 · Cited by 163
Bernhardt, B. C., Hong, S., Bernasconi, A., & Bernasconi, N. (2014) · Annals of Neurology · doi:10.1002/ana.24341 · Cited by 154
Oermann, E. K., Rubinsteyn, A., Ding, D., Mascitelli, J. R., Starke, R. M., Bederson, J. B., Kano, H., Lunsford, L. D., Sheehan, J. P., Hammerbacher, J., et al. (2016) · Scientific Reports · doi:10.1038/srep21161 · Cited by 122
Application of Artificial Intelligence to the Management of Urological Cancer
Abbod, M., Catto, J. W. F., Linkens, D. A., & Hamdy, F. C. (2007) · The Journal of Urology · doi:10.1016/j.juro.2007.05.122 · Cited by 113
A Generic Support Vector Machine Model for Preoperative Glioma Survival Associations
Emblem, K. E., Pinho, M. C., Zöllner, F. G., Due‐Tønnessen, P., Hald, J. K., Schad, L. R., Meling, T. R., Rapalino, O., & Bjørnerud, A. (2014) · Radiology · doi:10.1148/radiol.14140770 · Cited by 112
Clinical epidemiology in the era of big data: new opportunities, familiar challenges
Ehrenstein, V., Nielsen, H., Pedersen, A., Johnsen, S. P., & Pedersen, L. (2017) · Clinical Epidemiology · doi:10.2147/clep.s129779 · Cited by 110
Memarian, N., Kim, S., Dewar, S. R., Engel, J., & Staba, R. J. (2015) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2015.06.008 · Cited by 109
Akbari, H., Macyszyn, L. J., Da, X., Wolf, R. L., Bilello, M., Verma, R., O’Rourke, D. M., & Davatzikos, C. A. (2014) · Radiology · doi:10.1148/radiol.14132458 · Cited by 99
Shi, H., Hwang, S., Lee, K., & Lin, C. (2013) · Journal of neurosurgery · doi:10.3171/2013.1.jns121130 · Cited by 97
Antony, A. R., Alexopoulos, A. V., Gonzalez-Martinez, J. A., Mosher, J. C., Jehi, L. E., Burgess, R. C., So, N. K., & Galán, R. F. (2013) · PLoS ONE · doi:10.1371/journal.pone.0077916 · Cited by 90
Shamir, R. R., Dolber, T., Noecker, A. M., Walter, B. L., & McIntyre, C. C. (2015) · Brain stimulation · doi:10.1016/j.brs.2015.06.003 · Cited by 85
Artificial neural networks in neurosurgery
Azimi, P., Mohammadi, H. R., Benzel, E. C., Shahzadi, S., Azhari, S., & Montazeri, A. (2014) · Journal of Neurology Neurosurgery & Psychiatry · doi:10.1136/jnnp-2014-307807 · Cited by 81
Emblem, K. E., Nedregaard, B., Hald, J. K., Nome, T., Due‐Tønnessen, P., & Bjørnerud, A. (2009) · Journal of Magnetic Resonance Imaging · doi:10.1002/jmri.21815 · Cited by 73
Asadi, H., Kok, H. K., Looby, S., Brennan, P., O'Hare, A., & Thornton, J. (2016) · World Neurosurgery · doi:10.1016/j.wneu.2016.09.086 · Cited by 67
Dumont, T. M., Rughani, A. I., & Tranmer, B. I. (2011) · World Neurosurgery · doi:10.1016/j.wneu.2010.07.007 · Cited by 66
Machine Learning Approach for the Outcome Prediction of Temporal Lobe Epilepsy Surgery
Armañanzas, R., Alonso‐Nanclares, L., Oroquieta, J. D. F., Kastanauskaite, A., de Sola, R. G., DeFelipe, J., Bielza, C., & Larrañaga, P. (2013) · PLoS ONE · doi:10.1371/journal.pone.0062819 · Cited by 65
Azimi, P., Benzel, E. C., Shahzadi, S., Azhari, S., & Mohammadi, H. R. (2014) · Journal of Neurosurgery Spine · doi:10.3171/2013.12.spine13674 · Cited by 61
Abouzari, M., Rashidi, A., Zandi‐Toghani, M., Behzadi, M., & Asadollahi, M. (2009) · Neurosurgical Review · doi:10.1007/s10143-009-0215-3 · Cited by 57
Azimi, P., & Mohammadi, H. R. (2014) · Journal of Neurosurgery Pediatrics · doi:10.3171/2013.12.peds13423 · Cited by 55
Kostoglou, K., Michmizos, K. P., Stathis, P. G., Sakas, D. E., Nikita, K. S., & Mitsis, G. D. (2016) · IEEE Transactions on Biomedical Engineering · doi:10.1109/tbme.2016.2591827 · Cited by 53
Predicting Outcome of Anterior Temporal Lobectomy Using Simulated Neural Networks
Grigsby, J., Kramer, R. E., Schneiders, J. L., Gates, J. R., & Smith, W. B. (1998) · Epilepsia · doi:10.1111/j.1528-1157.1998.tb01275.x · Cited by 49
Hoffman, H., Lee, S. I., Garst, J. H., Lu, D. S., Li, C. H., Nagasawa, D. T., Ghalehsari, N., Jahanforouz, N., Razaghy, M., Espinal, M., et al. (2015) · Journal of Clinical Neuroscience · doi:10.1016/j.jocn.2015.04.002 · Cited by 45
Njiwa, J. Y., Gray, K. R., Costes, N., Mauguı̀ere, F., Ryvlin, P., & Hammers, A. (2014) · NeuroImage Clinical · doi:10.1016/j.nicl.2014.11.013 · Cited by 44
Neural network analysis of preoperative variables and outcome in epilepsy surgery
Arle, J. E., Perrine, K. R., Devinsky, O., & Doyle, W. (1999) · Journal of neurosurgery · doi:10.3171/jns.1999.90.6.0998 · Cited by 43
Prediction of post-surgical seizure outcome in left mesial temporal lobe epilepsy
Feis, D., Schoene‐Bake, J., Elger, C. E., Wagner, J., Tittgemeyer, M., & Weber, B. (2013) · NeuroImage Clinical · doi:10.1016/j.nicl.2013.06.010 · Cited by 42
Emblem, K. E., Due‐Tønnessen, P., Hald, J. K., Bjørnerud, A., Pinho, M. C., Scheie, D., Schad, L. R., Meling, T. R., & Zöllner, F. G. (2013) · Journal of Magnetic Resonance Imaging · doi:10.1002/jmri.24390 · Cited by 42
Lo, B., Macdonald, R. L., BAKER, A. J., & Levine, M. (2013) · Computational and Mathematical Methods in Medicine · doi:10.1155/2013/904860 · Cited by 41
Habibi, Z., Ertiaei, A., Nikdad, M., Mirmohseni, A. S., Afarideh, M., Heidari, V., Saberi, H., Rezai, A. S., & Nejat, F. (2016) · Child s Nervous System · doi:10.1007/s00381-016-3248-2 · Cited by 41
Use of Artificial Neural Networks to Predict Recurrent Lumbar Disk Herniation
Azimi, P., Mohammadi, H. R., Benzel, E. C., Shahzadi, S., & Azhari, S. (2014) · Journal of Spinal Disorders & Techniques · doi:10.1097/bsd.0000000000000200 · Cited by 39
Shamim, M. S., Enam, S. A., & Qidwai, U. A. (2009) · Surgical Neurology · doi:10.1016/j.surneu.2009.07.012 · Cited by 30
Survival of Patients With Multiple Intracranial Metastases Treated With Stereotactic Radiosurgery
Knoll, M. A., Oermann, E. K., Yang, A. I., Paydar, I., Steinberger, J. M., Collins, B. T., Collins, S., Ewend, M. G., & Kondziolka, D. S. (2016) · American Journal of Clinical Oncology · doi:10.1097/coc.0000000000000299 · Cited by 29
Azimi, P., Benzel, E. C., Shahzadi, S., Azhari, S., & Mohammadi, H. R. (2016) · PubMed · Cited by 24
Bullet Fragment of the Lumbar Spine: The Decision is More Important than the Incision
Moisi, M. D., Page, J., Gahramanov, S., & Oskouian, R. J. (2015) · Global Spine Journal · doi:10.1055/s-0035-1566231 · Cited by 17
Azimi, P., Shahzadi, S., & Sadeghi, S. (2020) · Journal of Neurosurgical Sciences · doi:10.23736/s0390-5616.16.03479-2 · Cited by 13
Sousa, F. S., Hummel, A. D., Maciel, R. F., Cohrs, F. M., Falcão, A. E. J., Teixeira, F. O., Baptista, R., Mancini, F., Costa, T. M., Alves, D., et al. (2011) · Transplantation Proceedings · doi:10.1016/j.transproceed.2011.02.028 · Cited by 8
Cited by
Sorted by citations
Logistic regression was as good as machine learning for predicting major chronic diseases
Nusinovici, S., Tham, Y. C., Yan, M. Y. C., Ting, D. S. W., Li, J., Sabanayagam, C., Wong, T. Y., & Cheng, C. (2020) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2020.03.002 · Cited by 597
Accessing Artificial Intelligence for Clinical Decision-Making
Giordano, C., Brennan, M., Mohamed, B., Rashidi, P., Modave, F., & Tighe, P. (2021) · Frontiers in Digital Health · doi:10.3389/fdgth.2021.645232 · Cited by 326
“ML tools for optimizing care outcomes have been used in various settings, including critical care for optimizing sepsis management (27), management of chronic conditions (28), and optimizing surgical outcomes (29).”
MethodBuchlak, Q. D., Esmaili, N., Leveque, J., Farrokhi, F. R., Bennett, C. C., Piccardi, M., & Sethi, R. K. (2019) · Neurosurgical Review · doi:10.1007/s10143-019-01163-8 · Cited by 234
“These statistics allow the comparison of the performance of different forms of supervised learning models and allow the researcher to determine the applicability of the model to clinical practice [36, 98].”
BackgroundThe impact of machine learning on patient care: A systematic review
Ben-Israel, D., Jacobs, W. B., Casha, S., Lang, S., Ryu, W. H. A., de Lotbiniere-Bassett, M., & Cadotte, D. W. (2020) · Artificial Intelligence in Medicine · doi:10.1016/j.artmed.2019.101785 · Cited by 207
Wang, W., Kiik, M., Peek, N. B., Ćurčin, V., Marshall, I. J., Rudd, A. G., Wang, Y., Douiri, A., Wolfe, C. D. A., & Bray, B. (2020) · PLoS ONE · doi:10.1371/journal.pone.0234722 · Cited by 205
“We combined published PubMed search filters for stroke [8], ML [9], and prediction models [10].”
Method
Metadata
- Authors
- Senders, J. T., Staples, P. C., Karhade, A. V., Zaki, M. M., Gormley, W. B., Broekman, M. L. D., Smith, T. R., & Arnaout, O.
- Affiliations
- Brigham and Women's Hospital (US)
- Harvard University (US)
- Corresponding author
- Arnaout, Omar
- ORCID
- Venue
- World Neurosurgery
- Publisher
- Elsevier BV
- Published
- 2018-01
- Volume
- 109
- Pages
- 476-486.e1
- ISSN
- 1878-8750 (ISSN-L)
- OpenAlex
- W2761529114
- Cited by
- 486
- References
- 47
- Citations by year
- 2026: 49 · 2025: 51 · 2024: 63 · 2023: 68 · 2022: 85 · 2021: 67 · 2020: 58 · 2019: 31 · 2018: 13
- FWCI
- 4.10
- Type
- journal article
- Language
- en
- Open access
- Locations
- World Neurosurgery (publishedVersion)
- PubMed (publishedVersion)
- Leiden Repository (Leiden University) (submittedVersion)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Machine Learning in Healthcare
- Health Sciences › Health Professions › Health Information Management › Artificial Intelligence in Healthcare
- Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
- Keywords
- machine learning, surgical decision-making, epilepsy surgery, brain tumor surgery, spinal lesions, neurovascular disease, movement disorders, traumatic brain injury, hydrocephalus, survival prediction, recurrence prediction, adverse events, prognostic score, clinical decision support
- MeSH terms
- Machine Learning, Computer Simulation, Decision Support Techniques, Humans, Nervous System Diseases, Prognosis, Outcome Assessment, Health Care, Neurosurgical Procedures
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
