The Virtual Operative Assistant: An explainable artificial intelligence tool for simulation-based training in surgery and medicine
Open accessThe DOI matches its Crossref record; 48 of the 49 references it cites were found in a registry or an index, and 1 are not checked yet.
Abstract
Simulation-based training is increasingly being used for assessment and training of psychomotor skills involved in medicine. The application of artificial intelligence and machine learning technologies has provided new methodologies to utilize large amounts of data for educational purposes. A significant criticism of the use of artificial intelligence in education has been a lack of transparency in the algorithms' decision-making processes. This study aims to 1) introduce a new framework using explainable artificial intelligence for simulation-based training in surgery, and 2) validate the framework by creating the Virtual Operative Assistant, an automated educational feedback platform. Twenty-eight skilled participants (14 staff neurosurgeons, 4 fellows, 10 PGY 4-6 residents) and 22 novice participants (10 PGY 1-3 residents, 12 medical students) took part in this study. Participants performed a virtual reality subpial brain tumor resection task on the NeuroVR simulator using a simulated ultrasonic aspirator and bipolar. Metrics of performance were developed, and leave-one-out cross validation was employed to train and validate a support vector machine in Matlab. The classifier was combined with a unique educational system to build the Virtual Operative Assistant which provides users with automated feedback on their metric performance with regards to expert proficiency performance benchmarks. The Virtual Operative Assistant successfully classified skilled and novice participants using 4 metrics with an accuracy, specificity and sensitivity of 92, 82 and 100%, respectively. A 2-step feedback system was developed to provide participants with an immediate visual representation of their standing related to expert proficiency performance benchmarks. The educational system outlined establishes a basis for the potential role of integrating artificial intelligence and virtual reality simulation into surgical educational teaching. The potential of linking expertise classification, objective feedback based on proficiency benchmarks, and instructor input creates a novel educational tool by integrating these three components into a formative educational paradigm.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures




Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“Various uses were described, including surgical simulation with a virtual operative assistant [132], simulated patient physician medical interviews [120–123, 130], and interactions with avatars as standardized patients during clinical interviews [124–126].”
From Artificial intelligence in undergraduate medical education: an updated scoping review (2025) · cites this paper as [132]
The check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“Simulation-based GenAI learning has been shown to enhance AI readiness and reinforce core nursing concepts [18].”
From Effects of generative artificial intelligence (GenAI) patient simulation on perceived clinical competency among global nursing undergraduates: a cross-over randomised controlled trial (2025) · cites this paper as [18]
Experimental — accuracy not yet measuredIn the citing paper
“AI simulations can adapt to a learner's performance, providing personalized, dynamic feedback that helps students practice clinical skills, refine decision-making, and improve their diagnostic reasoning in a controlled, risk-free environment [107].”
From Formative assessment and feedback in medical education: A practical guide: AMEE Guide No. 189 (2026) · cites this paper as [107]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep learning in neural networks: an overview
Schmidhuber, J. (2015) · Neural Networks · doi:10.1016/j.neunet.2014.09.003 · Cited by 18,570
The perceptron: A probabilistic model for information storage and organization in the brain.
Rosenblatt, F. (1958) · Psychological Review · doi:10.1037/h0042519 · Cited by 12,280 · cited 1×
“The system relies on a single processing unit known as the perceptron.[19] Building from this, the authors outline the rationale for employing the perceptron (also known as the linear Support Vector Machine) in this study in the S1 Appendix in S1 File.”
MethodSupervised Machine Learning: A Review of Classification Techniques
Kotsiantis, S. B. (2007) · Informatica · Cited by 6,007
Large-Scale Machine Learning with Stochastic Gradient Descent
Bottou, L. (2010) · Proceedings of COMPSTAT'2010 · doi:10.1007/978-3-7908-2604-3_16 · Cited by 5,795 · cited 1×
“[24, 25] An iterative cost reduction approach is employed during training,[26] whereby the algorithm alters values of the weights (θ) for each metric in order to reach the greatest predictive accuracy.”
MethodA guide to deep learning in healthcare
Esteva, A., Robicquet, A., Ramsundar, B., Kuleshov, V., DePristo, M., Chou, K., Cui, C., Corrado, G., Thrun, S., & Dean, J. (2019) · Nature Medicine · doi:10.1038/s41591-018-0316-z · Cited by 5,312
Cognitive load theory, learning difficulty, and instructional design
Sweller, J. (1994) · Learning and Instruction · doi:10.1016/0959-4752(94)90003-5 · Cited by 3,801 · cited 1×
“Following the principles of cognitive load theory,[31] the Virtual Operative Assistant aims to limit the amount of information immediately provided to the user to facilitate learning.”
MethodDeo, R. C. (2015) · Circulation · doi:10.1161/circulationaha.115.001593 · Cited by 3,466
Toward integrating feature selection algorithms for classification and clustering
Liu, H., & Yu, L. (2005) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2005.66 · Cited by 2,706
Feature Selection: A Data Perspective
Li, J., Cheng, K., Wang, S., Morstatter, F., Trevino, R. P., Tang, J., & Liu, H. (2018) · ACM Computing Surveys · doi:10.1145/3136625 · Cited by 2,442
Score normalization in multimodal biometric systems
Jain, A., Nandakumar, K., & Ross, A. (2005) · Pattern Recognition · doi:10.1016/j.patcog.2005.01.012 · Cited by 2,154
A Proposal for the Dartmouth Summer Research Project on Artificial Intelligence, August 31, 1955
McCarthy, J., Minsky, M., Rochester, N., et al. (2006) · The AI Magazine · doi:10.1609/aimag.v27i4.1904 · Cited by 2,029 · cited 1×
“The application of artificial intelligence (AI) and machine learning in various fields has substantially facilitated the evaluation of large and multivariate datasets.[2, 3] Several types of algorithms fit under the umbrella of machine learning.”
BackgroundEfficient Feature Selection via Analysis of Relevance and Redundancy
Yu, L., & Liu, H. (2004) · doi:10.5555/1005332.1044700 · Cited by 1,983
Machine learning: a review of classification and combining techniques
Kotsiantis, S. B., Zaharakis, I. D., & Pintelas, P. E. (2006) · Artificial Intelligence Review · doi:10.1007/s10462-007-9052-3 · Cited by 1,582
Feedback in Clinical Medical Education
Ende, J. (1983) · JAMA: The Journal of the American Medical Association · doi:10.1001/jama.1983.03340060055026 · Cited by 1,329
Chunking mechanisms in human learning
GOBET, F., LANE, P., CROKER, S., CHENG, P., JONES, G., OLIVER, I., & PINE, J. (2001) · Trends in Cognitive Sciences · doi:10.1016/s1364-6613(00)01662-4 · Cited by 1,157
Feature Selection: A Data Perspective
Li, J., Cheng, K., Wang, S., Morstatter, F., Treviño, R. P., Tang, J., & Liu, H. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1601.07996 · Cited by 739
Drug design by machine learning: support vector machines for pharmaceutical data analysis
Burbidge, R., Trotter, M., Buxton, B., & Holden, S. (2001) · Computers & Chemistry · doi:10.1016/s0097-8485(01)00094-8 · Cited by 687 · cited 1×
“The bias is a weight without a corresponding metric.[45] Hence although the bias alters the decision boundary of the Virtual Operative Assistant, it is left out of metric-wise assessment.”
BackgroundBlock, J. H., & Burns, R. B. (1976) · Review of Research in Education · doi:10.3102/0091732x004001003 · Cited by 549
Williamson, B. (2016) · Journal of Education Policy · doi:10.1080/02680939.2015.1035758 · Cited by 522 · cited 1×
“[34] However, research involving the use of technology in higher education has identified neglect, frustration, uncertainty, need for confirmation and discomfort to be the primary negative emotions experienced by students.”
BackgroundPositive Computing: Technology for Wellbeing and Human Potential
Calvo, R. A., & Peters, D. (2014) · doi:10.7551/mitpress/9764.001.0001 · Cited by 376 · cited 1×
“The Virtual Operative Assistant addresses the behavioural level by providing feedback, and the reflective level by mimicking familiar feedback through audition and visual components.[9, 42] Studies across a variety of fields have proven the benefit of feedback to enhance skill acquisition and overall performance.”
BackgroundSlowing Down When You Should: A New Model of Expert Judgment
Moulton, C.-A. E., Regehr, G., Mylopoulos, M., & MacRae, H. M. (2007) · Academic Medicine · doi:10.1097/acm.0b013e3181405a76 · Cited by 314
Improving fuzzy c-means clustering based on feature-weight learning
Wang, X., Wang, Y., & Wang, L. (2004) · Pattern Recognition Letters · doi:10.1016/j.patrec.2004.03.008 · Cited by 312
Winkler-Schwartz, A., Bissonnette, V., Mirchi, N., Ponnudurai, N., Yilmaz, R., Ledwos, N., Siyar, S., Azarnoush, H., Karlik, B., & Del Maestro, R. F. (2019) · Journal of Surgical Education · doi:10.1016/j.jsurg.2019.05.015 · Cited by 295 · cited 1×
“practices guidelines for utilizing AI in surgical simulation studies based on systematic literature search.[18] The Virtual Operative Assistant outlined in this study offers objective and automated feedback for the learner based on performance metrics from virtual reality simulators, allowing for an enhanced understan…”
MethodSelf-citationPositive computing: technology for wellbeing and human potential
(2015) · Choice Reviews Online · doi:10.5860/choice.189530 · Cited by 283
Feature Selection Methods and Algorithms
Sasikala, S., Renuka, D. D., & Kumar, R. (2023) · Research Practitioner's Handbook on Big Data Analytics · doi:10.1201/9781003284543-3 · Cited by 243
Rise of Deep Learning for Genomic, Proteomic, and Metabolomic Data Integration in Precision Medicine
Grapov, D., Fahrmann, J., Wanichthanarak, K., & Khoomrung, S. (2018) · OMICS: A Journal of Integrative Biology · doi:10.1089/omi.2018.0097 · Cited by 226 · cited 1×
“[4–7] Although these models have shown significant potential in economics, finance, and medical applications, a common criticism of deep learning is that its decision-making process is a “black box”.[6] Basically, this means that it is difficult to understand how an algorithm makes a particular decision.”
BackgroundOrienting Teaching Toward the Learning Process
ten Cate, O., Snell, L., Mann, K., & Vermunt, J. (2004) · Academic Medicine · doi:10.1097/00001888-200403000-00005 · Cited by 221 · cited 1×
“Research indicates that feedback can be ineffective or occasionally detrimental to skill acquisition if the learner feels disconnected from the instructor or the feedback is not disseminated appropriately.[46] While automated feedback may provide more objective and standardized training, human-to-human connection is a…”
BackgroundNeuroTouch: A Physics-Based Virtual Simulator for Cranial Microneurosurgery Training
Delorme, S., Laroche, D., DiRaddo, R., & F. Del Maestro, R. (2012) · Operative Neurosurgery · doi:10.1227/neu.0b013e318249c744 · Cited by 206 · cited 2×
“Although a number of virtual reality surgical training simulator platforms such as the Neu- roVR (previously known as the NeuroTouch)[13] and SimOrtho[14] have been developed, progress in the implementation of simulator feedback platforms has been problematic.”
BackgroundThe Roles Of Artificial Intelligence In Education: Current Progress And Future Prospects
Rand 1700 Main St, S. M., McArthur, D., Lewis, M., Rand 1700 Main St, S. M., Bishary, M., & Rand 1700 Main St, S. M. (2005) · i-manager's Journal of Educational Technology · doi:10.26634/jet.1.4.972 · Cited by 187 · cited 1×
“The use of these technologies allows automation of traditional forms of teaching while also re-defining valued educational goals.[1] Digital technologies can quantitate skill performance, which, when analysed with artificial intelligence can result in new perspectives on psychomotor expertise and its composites.”
BackgroundThe benefit of force feedback in surgery: Examination of blunt dissection
Wagner, C. R., Stylopoulos, N., Jackson, P. G., & Howe, R. D. (2007) · Presence: Teleoperators and Virtual Environments · doi:10.1162/pres.16.3.252 · Cited by 169
Winkler-Schwartz, A., Yilmaz, R., Mirchi, N., Bissonnette, V., Ledwos, N., Siyar, S., Azarnoush, H., Karlik, B., & Del Maestro, R. (2019) · JAMA Network Open · doi:10.1001/jamanetworkopen.2019.8363 · Cited by 168
Self-citationArtificial Intelligence Distinguishes Surgical Training Levels in a Virtual Reality Spinal Task
Bissonnette, V., Mirchi, N., Ledwos, N., Alsidieri, G., Winkler-Schwartz, A., Del Maestro, R. F., & on behalf of the Neurosurgical Simulation & Artificial Intelligence Learning Centre (2019) · Journal of Bone and Joint Surgery · doi:10.2106/jbjs.18.01197 · Cited by 151 · cited 2×
“This not only provides an efficient way to understand expertise, but it can also uncover unique features of skill that may have gone previously unrecognized.[5, 11, 12] In this study, we outline an educational platform (The Virtual Operative Assistant) for complex technical task enhancement based on explainable machin…”
BackgroundSelf-citationSurgical skills assessment: A blinded examination of obstetrics and gynecology residents
Goff, B. A., Nielsen, P. E., Lentz, G. M., Chow, G. E., Chalmers, R. W., Fenner, D. E., & Mandel, L. S. (2002) · American Journal of Obstetrics and Gynecology · doi:10.1067/mob.2002.122145 · Cited by 136 · cited 1×
“[15] While this method has been shown to be valid and reliable for some surgical tasks,[16] it relies on the presence of examiners, and is thus prone to subjectivity and it is highly resource dependent.”
MethodAssessing Technical Competence in Surgical Trainees: A Systematic Review
Szász, P., Louridas, M., Harris, K. A., Aggarwal, R., & Grantcharov, T. (2014) · Annals of Surgery · doi:10.1097/sla.0000000000000866 · Cited by 124 · cited 1×
“[15] While this method has been shown to be valid and reliable for some surgical tasks,[16] it relies on the presence of examiners, and is thus prone to subjectivity and it is highly resource dependent.”
MethodA Systematic Review on Orthopedic Simulators for Psycho-Motor Skill and Surgical Procedure Training
Ruikar, D. D., Hegadi, R. S., & Santosh, K. (2018) · Journal of Medical Systems · doi:10.1007/s10916-018-1019-1 · Cited by 95 · cited 2×
“Although a number of virtual reality surgical training simulator platforms such as the Neu- roVR (previously known as the NeuroTouch)[13] and SimOrtho[14] have been developed, progress in the implementation of simulator feedback platforms has been problematic.”
BackgroundPutri, E. S., Wati, R., & Fera, D. (2020) · Journal of Nutrition Science · doi:10.35308/jns.v1i1.2218 · Cited by 92
Artificial Neural Networks to Assess Virtual Reality Anterior Cervical Discectomy Performance
Mirchi, N., Bissonnette, V., Ledwos, N., Winkler-Schwartz, A., Yilmaz, R., Karlik, B., & Del Maestro, R. F. (2020) · Operative Neurosurgery · doi:10.1093/ons/opz359 · Cited by 58 · cited 4×
“[12, 44] Studies are presently ongoing to adapt the framework to multi-layered perceptron such as artificial neural networks and to modify the framework for multiclass classification.[5] Second, the machine learning model is composed of metrics, weights, and a bias (extensively discussion in the S1 Appendix in S1 File…”
BackgroundInfluentialSelf-citationAI in Education needs interpretable machine learning: Lessons from Open Learner Modelling
Conati, C., Porayska‐Pomsta, K., & Mavrikis, M. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1807.00154 · Cited by 50 · cited 2×
“This is problematic in the context of education because transparency and trust are vital components of ensuring a successful connection between teacher and learner.[8] Transparency is also important for developing and implementing appropriate grading schemes and feedback mechanisms.”
BackgroundMethodAzarnoush, H., Siyar, S., Sawaya, R., AlZhrani, G. A., Winkler-Schwartz, A., Alotaibi, F. E., Bugdadi, A., Bajunaid, K. M., Marwa, I., Sabbagh, A. J., et al. (2016) · Journal of neurosurgery · doi:10.3171/2016.7.jns16322 · Cited by 42 · cited 1×
“operative environment nor provide verbal, visual and auditory feedback which may enhance the learning opportunities for the trainee.[10, 21, 40]”
BackgroundSelf-citationVirtual Reality Tumor Resection: The Force Pyramid Approach
Sawaya, R., Bugdadi, A., Azarnoush, H., Winkler-Schwartz, A., Alotaibi, F. E., Bajunaid, K. M., AlZhrani, G. A., Alsideiri, G., Sabbagh, A. J., & Maestro, R. F. D. (2017) · Operative Neurosurgery · doi:10.1093/ons/opx189 · Cited by 29 · cited 2×
“Computer platforms are capable of extracting both positional and quality components of trainee force utilization [20, 21] allowing quantification of these novel surgical performance metrics.”
BackgroundSelf-citationDevelopment of a performance model for virtual reality tumor resections
Sawaya, R., Alsideiri, G., Bugdadi, A., Winkler-Schwartz, A., Azarnoush, H., Bajunaid, K. M., Sabbagh, A. J., & Maestro, R. F. D. (2018) · Journal of neurosurgery · doi:10.3171/2018.2.jns172327 · Cited by 26 · cited 2×
“operative environment nor provide verbal, visual and auditory feedback which may enhance the learning opportunities for the trainee.[10, 21, 40]”
BackgroundSelf-citationSi, W., Liao, X., Wang, Q., & Heng, P. (2018) · IEEE Conference on Virtual Reality and 3D User Interfaces (VR) · doi:10.1109/vr.2018.8446450 · Cited by 24 · cited 1×
“Studies have utilized machine learning to assess 2D visual images of operative procedures[38] and neuroanatomy.[39] However these systems do not allow for an assessment of quantitative instrument force application and instrument movements in a 3D XAI in surgical simulation training”
MethodWinkler-Schwartz, A., Marwa, I., Bajunaid, K. M., Mullah, M. A. S., Alotaibi, F. E., Bugdadi, A., Sawaya, R., Sabbagh, A. J., & Maestro, R. F. D. (2019) · World Neurosurgery · doi:10.1016/j.wneu.2019.03.059 · Cited by 15 · cited 1×
“Our group has demonstrated that performance metrics from a virtual reality simulator correlate with current visual rating scales (like the OSATS), while offering additional advantages such as the assessment of force application which cannot be assessed visually.[17] Our group has also developed best XAI in surgical si…”
BackgroundSelf-citationDiana, S., Jo, H., & Zada, P. (2018) · Studies in Health Technology and Informatics · doi:10.3233/978-1-61499-923-2-421 · Cited by 15
Alotaibi, F. E. (2015) · SOJ Neurology · doi:10.15226/2374-6858/2/1/00116 · Cited by 14 · cited 1×
“[35] Teaching in surgery is largely reliant on the apprenticeship model whereby the knowledge of a skill (know-how) is assumed to be learned through observation and graduated active responsibility in the operating room.[36] Therefore, a significant part of knowledge and skill acquisition also occurs through experienti…”
BackgroundSupplementary Educational Models in Canadian Neurosurgery Residency Programs
Ryu, W. H. A., Chan, S., & Sutherland, G. R. (2016) · Canadian Journal of Neurological Sciences / Journal Canadien des Sciences Neurologiques · doi:10.1017/cjn.2016.315 · Cited by 11 · cited 1×
“This was done to ensure that the Virtual Operative Assistant resembled the current focus of neurosurgical education.[30]”
BackgroundRaskin, J. S., Liu, J. J., Holste, K. G., Brown, S. N., Hardaway, F. A., Pang, P. S., & Raslan, A. M. (2017) · Operative Neurosurgery · doi:10.1093/ons/opx072 · Cited by 9 · cited 1×
“The complexity of surgery makes it an ideal educational paradigm to apply these systems.[35] Teaching in surgery is largely reliant on the apprenticeship model whereby the knowledge of a skill (know-how) is assumed to be learned through observation and graduated active responsibility in the operating room.”
BackgroundUsing fuzzy set theory to objectively evaluate performance on minimally invasive surgical simulators
Hajshirmohammadi, I. (2006) · Summit (Simon Fraser University) · Cited by 4
Endoscopic Image Classification Based on DWT-CM and Improved BNN for Surgical Tool Appearances
Yuan, Z., Zhang, D., Yin, Q., Liu, Q., Shi, D.-C., & Sun, M. (2007) · International Conference on Machine Learning and Cybernetics · doi:10.1109/icmlc.2007.4370176 · Cited by 1 · cited 1×
“Studies have utilized machine learning to assess 2D visual images of operative procedures[38] and neuroanatomy.”
Method
Research works printed but not linked: 1
- Norman D. The design of everyday things: Revised and expanded edition: Constellation; 2013.
Cited by
A scoping review of artificial intelligence in medical education: BEME Guide No. 84
Gordon, M., Daniel, M., Ajiboye, A., Uraiby, H., Xu, N. Y., Bartlett, R., Hanson, J., Haas, M., Spadafore, M., Grafton-Clarke, C., et al. (2024) · Medical Teacher · doi:10.1080/0142159x.2024.2314198 · Cited by 679
Artificial Intelligence for Student Assessment: A Systematic Review
González-Calatayud, V., Prendes-Espinosa, P., & Roig-Vila, R. (2021) · Applied Sciences · doi:10.3390/app11125467 · Cited by 503
“[11] used AI for simulation-based training in medicine, and they created a Virtual Operative Assistant to give automatic feedback to students based on metrics of”
MethodOkunlaya, R. O., Syed Abdullah, N., & Alias, R. A. (2022) · Library Hi Tech · doi:10.1108/lht-07-2021-0242 · Cited by 333
Applications of Explainable Artificial Intelligence in Diagnosis and Surgery
Zhang, Y., Weng, Y., & Lund, J. (2022) · Diagnostics · doi:10.3390/diagnostics12020237 · Cited by 368
“24 [49] 2020 Surgery training SVM Accuracy: 92% Sensitivity: 100% Specificity: 82% Virtual operative assistant Feature relevance No”
BackgroundAlmasri, F. (2024) · Research in Science Education · doi:10.1007/s11165-024-10176-3 · Cited by 361
“…2014; Nasution & Education, 2023), scoring and providing personalized feedback on stu - dents’ assignments (Azcona et al., 2019; Maestrales et al., 2021; Mirchi et al., 2020), and predicting student performance (Blikstein et al., 2014; Buenaño-Fernández et al., 2019; Jiao et al., 2022a, b).”
Metadata
- Authors
- Mirchi, N., Bissonnette, V., Yilmaz, R., Ledwos, N., Winkler-Schwartz, A., & Del Maestro, R. F.
- Affiliations
- Montreal Neurological Institute and Hospital (CA)
- Corresponding author
- Mirchi, Nykan
- Venue
- PLOS ONE
- Publisher
- Public Library of Science (PLoS)
- Published
- 2020-02-27
- Volume
- 15
- Issue
- 2
- Pages
- e0229596
- ISSN
- 1932-6203 (ISSN-L)
- PMC
- PMC7046231
- OpenAlex
- W3007803772
- Cited by
- 296
- References
- 48
- Citations by year
- 2026: 39 · 2025: 63 · 2024: 67 · 2023: 39 · 2022: 47 · 2021: 29 · 2020: 12
- FWCI
- 29.02
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- PLoS ONE (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Figshare (submittedVersion, cc-by)
- Funders
- Di Giovanni Foundation
- Topics
- Health Sciences › Medicine › Surgery › Surgical Simulation and Training
- Social Sciences › Education › Simulation-Based Education in Healthcare
- Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
- Keywords
- explainable AI, surgical simulation training, virtual surgery, neurosurgical training, brain tumor resection, support vector machine, formative assessment
- MeSH terms
- Simulation Training, Virtual Reality, Algorithms, Artificial Intelligence, Brain Neoplasms, Computer Simulation, Education, Medical, Female, Humans, Male, Neurosurgery, Surgery, Computer-Assisted, Support Vector Machine
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.