The DOI matches its Crossref record.
Abstract S6-07: double blinded validation study to assess performance of IBM artificial intelligence platform, Watson for oncology in comparison with manipal multidisciplinary tumour board ? first study of 638 breast Cancer cases
Abstract
Background: IBM Watson for Oncology (WFO) developed in collaboration with Memorial Sloan Kettering Cancer Centre is a cognitive computing system able to extract structured data from free text documents using natural language processing (NLP). It is a technology platform that uses NLP and machine learning to reveal insights from large amounts of unstructured data. Currently WFO provides treatment options only for breast, lung and colorectal cancers. In the present study we try to evaluate concordance of WFO treatment recommendations with Manipal multidisciplinary tumor board (MMDT),a quaternary health care centre for 638 breast cancer cases. Materials and Methods: MMDT treatment recommendation and relevant clinic-pathological data of 638 breast cancer cases both localised (514) and metastatic (124) disease which were treated in last 3 years was collected and the collected data of all the patients was entered in WFO. The treatment recommendations & the time required to enter the data and the time taken by WFO to give recommendations after analyzing the data was recorded. Treatment recommendation by WFO came in three categories with colour coding green, orange and red . Green is the RECommended standard treatment (REC), Orange is For Consideration (FC) and Red is Not RECommended (NREC). Concordance between MMDT and WFO was analysed for all cases as per stage and receptor status. Results: Of the treatment recommendations given by MMDT, WFO provided 46.4% in REC, 26.1% in FC, 21.5% in NREC. Nearly 73% of the MMDT treatment recommendations were in WFO REC and WFO-FC group. However 6% of the treatment provided by MMDT was not available with WFO. Treatment recommendations from WFO were concordant with MMDT in nearly 80% of time in non-metastatic and 45% in metastatic disease. In subset analysis of breast cancer with respect to receptor status the WFO-REC treatment was high with triple negative disease with 67.9% and least with Her 2neu negative disease with 35%. Across all subsets with respect to receptor status concordance was better with non-metastatic disease over metastatic disease which was statistically significant. The mean time taken to collect the data and enter was 20 minutes which gradually decreased with acquaintance after 10 cases to 12 minutes. Metastatic disease took longer time (5-7 minutes more) over localized disease in all the groups. WFO took a median of 40 seconds to capture, analyze and give the treatment recommendations. Conclusions: WFO-REC and WFO-FC together were in 73 % of time concordant with the MMDT treatment recommendations. However with respect to metastatic disease and harmone positive Her 2 neu –ve disease there still needs to be lots of improvement from WFO. WFO is a step towards personalized medicine. It should be kept in mind that WFO will be only an assisting tool and it will never be able to replace the patient-doctor relationship which is a very essential component of treating a patient suffering with cancer. WFO will be a reliable artificial intelligence tool for every cancer center and its multidisciplinary tumor board and will change the quality of care in oncology. Citation Format: Somashekhar SP, Kumarc R, Rauthan A, Arun KR, Patil P, Ramya YE. Double blinded validation study to assess performance of IBM artificial intelligence platform, Watson for oncology in comparison with Manipal multidisciplinary tumour board – First study of 638 breast cancer cases [abstract]. In: Proceedings of the 2016 San Antonio Breast Cancer Symposium; 2016 Dec 6-10; San Antonio, TX. Philadelphia (PA): AACR; Cancer Res 2017;77(4 Suppl):Abstract nr S6-07.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Somashekhar et al demonstrated that the IBM Watson for oncology would be a reliable AI system for assisting the diagnosis of cancer through a doubleblinded validation study.19”
From Artificial intelligence in healthcare: past, present and future (2017) · cites this paper as [19]
Citations
Cites
Still being checked.
Cited by
Artificial intelligence in healthcare: past, present and future
Jiang, F., Jiang, Y., Zhi, H., Dong, Y., Li, H., Ma, S., Wang, Y., Dong, Q., Shen, H., & Wang, Y. (2017) · Stroke and Vascular Neurology · doi:10.1136/svn-2017-000101 · Cited by 4,837
Vollmer, S., Mateen, B. A., Bohner, G., Király, F. J., Ghani, R., Jonsson, P., Cumbers, S., Jonas, A., McAllister, K. S. L., Myles, P., et al. (2020) · BMJ · doi:10.1136/bmj.l6927 · Cited by 497
Artificial intelligence for clinical oncology
Kann, B. H., Hosny, A., & Aerts, H. J. W. L. (2021) · Cancer Cell · doi:10.1016/j.ccell.2021.04.002 · Cited by 370
Metadata
- Authors
- Somashekhar, S., Kumarc, R., Rauthan, A., Arun, K., Patil, P., & Ramya, Y.
- Affiliations
- Manipal Hospital (IN)
- Venue
- Cancer Research
- Published
- 2017-02-15
- Volume
- 77
- Issue
- 4_Supplement
- Pages
- S6-07-S6-07
- ISSN
- 0008-5472 (ISSN-L)
- 1538-7445
- OpenAlex
- W2593415505
- Cited by
- 56
- References
- 0
- Citations by year
- 2026: 3 · 2025: 5 · 2024: 7 · 2023: 5 · 2022: 10 · 2021: 10 · 2020: 6 · 2019: 6 · 2018: 3 · 2017: 1
- Type
- conference abstract
- Language
- en
- Open access
- closed
- Locations
- Cancer Research (publishedVersion)
- Topics
- Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
- Physical Sciences › Computer Science › Artificial Intelligence › AI in cancer detection
- Health Sciences › Health Professions › Health Information Management › Artificial Intelligence in Healthcare
- Keywords
- IBM Watson for Oncology, breast cancer, multidisciplinary tumor board, natural language processing, cognitive computing, triple-negative breast cancer, HER2-negative breast cancer, metastatic breast cancer, breast cancer subtypes, artificial intelligence in oncology, unstructured clinical data
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Abstract S6-07: double blinded validation study to assess performance of IBM artificial intelligence platform, Watson for oncology in comparison with manipal multidisciplinary tumour board ? first study of 638 breast Cancer cases. https://app.cochat.ai/papers/10.1158/1538-7445.sabcs16-s6-07
- The paper
- Somashekhar, S., Kumarc, R., Rauthan, A., Arun, K., Patil, P., & Ramya, Y. (2017). Abstract S6-07: double blinded validation study to assess performance of IBM artificial intelligence platform, Watson for oncology in comparison with manipal multidisciplinary tumour board ? first study of 638 breast Cancer cases. Cancer Research. https://doi.org/10.1158/1538-7445.sabcs16-s6-07
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.