The DOI matches its Crossref record; 120 of the 120 references it cites were found in a registry or an index.
Artificial Intelligence for Response Assessment in Neuro Oncology (AI-RANO), part 2: recommendations for standardisation, validation, and good clinical practice
Open accessAbstract
Technological advancements have enabled the extended investigation, development, and application of computational approaches in various domains, including health care. A burgeoning number of diagnostic, predictive, prognostic, and monitoring biomarkers are continuously being explored to improve clinical decision making in neuro-oncology. These advancements describe the increasing incorporation of artificial intelligence (AI) algorithms, including the use of radiomics. However, the broad applicability and clinical translation of AI are restricted by concerns about generalisability, reproducibility, scalability, and validation. This Policy Review intends to serve as the leading resource of recommendations for the standardisation and good clinical practice of AI approaches in health care, particularly in neuro-oncology. To this end, we investigate the repeatability, reproducibility, and stability of AI in response assessment in neuro-oncology in studies on factors affecting such computational approaches, and in publicly available open-source data and computational software tools facilitating these goals. The pathway for standardisation and validation of these approaches is discussed with the view of trustworthy AI enabling the next generation of clinical trials. We conclude with an outlook on the future of AI-enabled neuro-oncology.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“The fundamental criterion for evaluating a medical AI agent is its precision in generating diagnostic and treatment recommendations.80,100,118,119,120”
From A foundational architecture for AI agents in healthcare (2025) · cites this paper as [118]
Citations
Cites
Radiotherapy Plus Concomitant and Adjuvant Temozolomide for Glioblastoma
Stupp, R., Mason, W. P., van den Bent, M. J., Weller, M., Fisher, B., Taphoorn, M. J. B., Belanger, K., Brandes, A. A., Marosi, C., Bogdahn, U., et al. (2005) · New England Journal of Medicine · doi:10.1056/nejmoa043330 · Cited by 21,807
The 2016 World Health Organization Classification of Tumors of the Central Nervous System: a summary
Louis, D. N., Perry, A., Reifenberger, G., von Deimling, A., Figarella-Branger, D., Cavenee, W. K., Ohgaki, H., Wiestler, O. D., Kleihues, P., & Ellison, D. W. (2016) · Acta Neuropathologica · doi:10.1007/s00401-016-1545-1 · Cited by 15,657
A survey on deep learning in medical image analysis
Litjens, G., Kooi, T., Bejnordi, B. E., Setio, A. A. A., Ciompi, F., Ghafoorian, M., van der Laak, J. A. W. M., van Ginneken, B., & Sánchez, C. I. (2017) · Medical Image Analysis · doi:10.1016/j.media.2017.07.005 · Cited by 15,332
The 2021 WHO classification of tumors of the central nervous system: a summary
Louis, D. N., Perry, A., Wesseling, P., Brat, D. J., Cree, I. A., Figarella-Branger, D., Hawkins, C., Ng, H. K., Pfister, S. M., Reifenberger, G., et al. (2021) · Neuro-Oncology · doi:10.1093/neuonc/noab106 · Cited by 12,273
Adjusting batch effects in microarray expression data using empirical Bayes methods
Johnson, W. E., Li, C., & Rabinovic, A. (2007) · Biostatistics · doi:10.1093/biostatistics/kxj037 · Cited by 8,658
The multimodal brain tumor image segmentation benchmark (BRATS)
Menze, B. H., Jakab, A., Bauer, S., Kalpathy-Cramer, J., Farahani, K., Kirby, J., Burren, Y., Porz, N., Slotboom, J., Wiest, R., et al. (2015) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2014.2377694 · Cited by 6,781
Radiomics: extracting more information from medical images using advanced feature analysis
Lambin, P., Rios-Velazquez, E., Leijenaar, R., Carvalho, S., van Stiphout, R. G. P. M., Granton, P., Zegers, C. M. L., Gillies, R., Boellard, R., Dekker, A., et al. (2012) · European Journal of Cancer · doi:10.1016/j.ejca.2011.11.036 · Cited by 6,084
Self-citationThe Somatic Genomic Landscape of Glioblastoma
Brennan, C. W., Verhaak, R. G. W., McKenna, A., Campos, B., Noushmehr, H., Salama, S. R., Zheng, S., Chakravarty, D., Sanborn, J. Z., Berman, S. H., et al. (2013) · Cell · doi:10.1016/j.cell.2013.09.034 · Cited by 5,016
The Cancer Imaging Archive (TCIA): Maintaining and Operating a Public Information Repository
Clark, K., Vendt, B., Smith, K., Freymann, J., Kirby, J., Koppel, P., Moore, S., Phillips, S., Maffitt, D., Pringle, M., et al. (2013) · Journal of Digital Imaging · doi:10.1007/s10278-013-9622-7 · Cited by 4,599
Zwanenburg, A., Vallières, M., Abdalah, M. A., Aerts, H. J. W. L., Andrearczyk, V., Apte, A., Ashrafinia, S., Bakas, S., Beukinga, R. J., Boellaard, R., et al. (2020) · Radiology · doi:10.1148/radiol.2020191145 · Cited by 4,177
Self-citation
Research works printed but not linked: 1
- Baheti, 2021, The Brain Tumor Sequence Registration Challenge (BraTS-Reg): Establishing Correspondence between Pre-Operative and Follow-up MRI scans of diffuse glioma patients, arXiv
Cited by
Wen, P. Y., Weller, M., Lee, E. Q., Touat, M., Khasraw, M., Rahman, R. M., Platten, M., Lim, M. K., Winkler, F., Horbinski, C., et al. (2025) · Neuro-Oncology · doi:10.1093/neuonc/noaf177 · Cited by 133
Self-citationHuang, J., Xiang, Y., Gan, S., Wu, L., Yan, J., Dong, Y., & Zhang, J. (2025) · Discover Oncology · doi:10.1007/s12672-025-03307-3 · Cited by 81
“This case underscores the necessity of addressing data heterogeneity and conducting cross-domain validation early in the model development lifecycle [80].”
Galldiks, N., Lohmann, P., Aboian, M., Barajas, R., Breen, W. G., Ivanidze, J., Johnson, D. R., Kaufmann, T. J., Kim, M. M., Mair, M. J., et al. (2025) · The Lancet Oncology · doi:10.1016/s1470-2045(25)00193-7 · Cited by 63
Self-citationLeptomeningeal metastatic disease: new frontiers and future directions
Ozair, A., Wilding, H. E., Bhanja, D., Mikolajewicz, N., Glantz, M., Grossman, S. A., Sahgal, A., Rhun, É. L., Weller, M., Weiß, T., et al. (2024) · Nature Reviews Clinical Oncology · doi:10.1038/s41571-024-00970-3 · Cited by 48
“The AI-RANO group has provided recommendations for standardization, validation and optimized clinical implementation of artificial intelligence in neuro-oncology 69 .”
Self-citationA foundational architecture for AI agents in healthcare
Liu, F., Niu, Y., Zhang, Q., Wang, K., Dong, Z., Wong, I. N., Cheng, L., Li, T., Duan, L., Li, K., et al. (2025) · Cell Reports Medicine · doi:10.1016/j.xcrm.2025.102374 · Cited by 41
“118–120 This can be assessed by comparing the agent’s outputs with those of experienced clinicians, particularly in the context of complex or rare conditions where human expertise is paramount.”
Metadata
- Authors
- Bakas, S., Vollmuth, P., Galldiks, N., Booth, T. C., Aerts, H. J. W. L., Bi, W. L., Wiestler, B., Tiwari, P., Pati, S., Baid, U., Calabrese, E., Lohmann, P., Nowosielski, M., Jain, R., Colen, R., Ismail, M., Rasool, G., Lupo, J. M., Akbari, H., Tonn, J. C., Macdonald, D., Vogelbaum, M., Chang, S. M., Davatzikos, C., Villanueva-Meyer, J. E., & Huang, R. Y.
- Affiliations
- Indiana University Indianapolis (US)
- University of Bonn (DE)
- Forschungszentrum Jülich (DE)
- King's College London (GB)
- Brigham and Women's Hospital (US)
- Technical University of Munich (DE)
- University of Wisconsin–Madison (US)
- Duke University (US)
- Universitätsklinikum Aachen (DE)
- Innsbruck Medical University (AT)
- New York University (US)
- University of Pittsburgh (US)
- Moffitt Cancer Center (US)
- University of California, San Francisco (US)
- Santa Clara University (US)
- Ludwig-Maximilians-Universität München (DE)
- University of Pennsylvania (US)
- Corresponding author
- Bakas, Spyridon
- ORCID
- Bakas, Spyridon
- Galldiks, Norbert
- Booth, Thomas C
- Aerts, Hugo J W L
- Bi, Wenya Linda
- Wiestler, Benedikt
- Tiwari, Pallavi
- Pati, Sarthak
- Baid, Ujjwal
- Calabrese, Evan
- Lohmann, Philipp
- Nowosielski, Martha
- Jain, Rajan
- Colen, Rivka
- Ismail, Marwa
- Rasool, Ghulam
- Lupo, Janine M
- Akbari, Hamed
- Tonn, Joerg C
- Vogelbaum, Michael
- Chang, Susan M
- Davatzikos, Christos
- Villanueva-Meyer, Javier E
- Huang, Raymond Y
- Venue
- The Lancet Oncology
- Publisher
- Elsevier BV
- Published
- 2024-11
- Volume
- 25
- Issue
- 11
- Pages
- e589-e601
- ISSN
- 1470-2045 (ISSN-L)
- PMC
- PMC12007431
- OpenAlex
- W4403855186
- Cited by
- 36
- References
- 119
- Citations by year
- 2026: 17 · 2025: 17 · 2024: 2
- FWCI
- 0.82
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Licence
- www.elsevier.com/tdm/userlicense/1.0/ (tdm)
- www.elsevier.com/legal/tdmrep-license (tdm)
- www.elsevier.com/open-access/userlicense/1.0/ (am, 178 d)
- doi.org/10.15223/policy-017 (stm-asf)
- doi.org/10.15223/policy-037 (stm-asf)
- doi.org/10.15223/policy-012 (stm-asf)
- doi.org/10.15223/policy-029 (stm-asf)
- doi.org/10.15223/policy-004 (stm-asf)
- Locations
- The Lancet Oncology (acceptedVersion)
- PubMed (publishedVersion)
- Research Publications (Maastricht University) (publishedVersion)
- PubMed Central (acceptedVersion)
- IUScholarWorks (Indiana University) (submittedVersion, other-oa)
- mediaTUM – the media and publications repository of the Technical University Munich (Technical University Munich) (submittedVersion)
- Funders
- Musella Foundation For Brain Tumor Research and Information
- Deutsche Forschungsgemeinschaft (428090865/SPP 2177)
- University of Pennsylvania
- European Research Council (866504)
- U.S. Department of Defense
- Perelman School of Medicine, University of Pennsylvania
- U.S. Department of Veterans Affairs (1I01BX005842\u201301A2)
- Wellcome Trust
- Dana Foundation
- National Institutes of Health
- University of Wisconsin-Madison
- Department of Radiology, Weill Cornell Medicine
- NINDS (R01NS042645)
- National Center for Advancing Translational Sciences (UL1TR001878)
- Instituto Tecnológico de Costa Rica
- European Commission
- Medical Research Council (MR/W021684/1)
- DOD Peer Reviewed Cancer Research Program (W81XWH-18\u20131-0404)
- National Cancer Institute
- Topics
- Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
- Health Sciences › Medicine › Radiology, Nuclear Medicine and Imaging › Radiomics and Machine Learning in Medical Imaging
- Health Sciences › Medicine › Oncology › Glioma Diagnosis and Treatment
- Keywords
- artificial intelligence, neuro-oncology, treatment response assessment, radiomics, AI validation, reproducibility, generalizability, trustworthy AI, clinical trials, good clinical practice, open source tools, clinical translation
- MeSH terms
- Artificial Intelligence, Brain Neoplasms, Humans, Medical Oncology, Reproducibility of Results
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Artificial Intelligence for Response Assessment in Neuro Oncology (AI-RANO), part 2: recommendations for standardisation, validation, and good clinical practice. https://app.cochat.ai/papers/10.1016/s1470-2045(24)00315-2
- The paper
- Bakas, S., Vollmuth, P., Galldiks, N., Booth, T. C., Aerts, H. J. W. L., Bi, W. L., Wiestler, B., Tiwari, P., Pati, S., Baid, U., Calabrese, E., Lohmann, P., Nowosielski, M., Jain, R., Colen, R., Ismail, M., Rasool, G., Lupo, J. M., Akbari, H., . . . Huang, R. Y. (2024). Artificial Intelligence for Response Assessment in Neuro Oncology (AI-RANO), part 2: recommendations for standardisation, validation, and good clinical practice. The Lancet Oncology. https://doi.org/10.1016/s1470-2045(24)00315-2
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.