Concordance Study Between IBM Watson for Oncology and Clinical Practice for Patients with Cancer in China
Open accessThe DOI matches its Crossref record; 1 of the 1 references it cites were found in a registry or an index.
Abstract
Background: IBM Watson for Oncology (WFO), which can use natural language processing to evaluate data in structured and unstructured formats, has begun to be used in China. It provides physicians with evidence-based treatment options and ranks them in three categories for treatment decision support. This study was designed to examine the concordance between the treatment recommendation proposed by WFO and actual clinical decisions by oncologists in our cancer center, which would reflect the differences of cancer treatment between China and the U.S. Patients and Methods: Retrospective data from 362 patients with cancer were ingested into WFO from April 2017 to October 2017. WFO recommendations were provided in three categories: recommended, for consideration, and not recommended. Concordance was analyzed by comparing the treatment decisions proposed by WFO with those of the multidisciplinary tumor board. Concordance was achieved when the oncologists' treatment decisions were in the recommended or for consideration categories in WFO. Results: Ovarian cancer showed the highest concordance, which was 96%. Lung cancer and breast cancer obtained a concordance of slightly above 80%. The concordance of rectal cancer was 74%, whereas colon cancer and cervical cancer showed the same concordance of 64%. In particular, the concordance of gastric cancer was very low, only 12%, and 88% of cases were under physicians choice. Conclusion: Different cancer types showed different concordances, and only gastric cancers were significantly less likely to be concordant. Incidence and pharmaceuticals may be the major cause of discordance. To be comprehensively and rapidly applied in China, WFO needs to accelerate localization. ClinicalTrials.gov Identifier: NCT03400514.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Dilsizian, S. E., & Siegel, E. L. (2014) · Current Cardiology Reports · doi:10.1007/s11886-013-0441-8 · Cited by 579
Cited by
The Ethics of Artificial Intelligence: Principles, Challenges, and Opportunities
Floridi, L. (2023) · doi:10.1093/oso/9780198883098.001.0001 · Cited by 507
Artificial Intelligence and Personalized Medicine
Schork, N. J. (2019) · Cancer Treatment and Research · doi:10.1007/978-3-030-16391-4_11 · Cited by 488
The ethics of algorithms: key problems and solutions
Tsamados, A., Aggarwal, N., Cowls, J., Morley, J., Roberts, H., Taddeo, M., & Floridi, L. (2022) · AI & SOCIETY · doi:10.1007/s00146-021-01154-8 · Cited by 384
Ciecierski-Holmes, T., Singh, R., Axt, M., Brenner, S., & Barteit, S. (2022) · npj Digital Medicine · doi:10.1038/s41746-022-00700-y · Cited by 343
Xie, Y., Seth, I., Hunter-Smith, D. J., Rozen, W. M., Ross, R., & Lee, M. (2023) · Aesthetic Plastic Surgery · doi:10.1007/s00266-023-03338-7 · Cited by 198
Metadata
- Authors
- Zhou, N., Zhang, C.-T., Lv, H.-Y., Hao, C.-X., Li, T.-J., Zhu, J.-J., Zhu, H., Jiang, M., Liu, K.-W., Hou, H.-L., Liu, D., Li, A.-Q., Zhang, G.-Q., Tian, Z.-B., & Zhang, X.-C.
- Venue
- The Oncologist
- Publisher
- Oxford University Press (OUP)
- Published
- 2018-09-04
- Volume
- 24
- Issue
- 6
- Pages
- 812-819
- ISSN
- 1083-7159 (ISSN-L)
- 1549-490X
- OpenAlex
- W2889905270
- Cited by
- 211
- References
- 1
- FWCI
- 1.79
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Concordance Study Between IBM Watson for Oncology and Clinical Practice for Patients with Cancer in China. https://app.cochat.ai/papers/10.1634/theoncologist.2018-0255
- The paper
- Zhou, N., Zhang, C.-T., Lv, H.-Y., Hao, C.-X., Li, T.-J., Zhu, J.-J., Zhu, H., Jiang, M., Liu, K.-W., Hou, H.-L., Liu, D., Li, A.-Q., Zhang, G.-Q., Tian, Z.-B., & Zhang, X.-C. (2019). Concordance Study Between IBM Watson for Oncology and Clinical Practice for Patients with Cancer in China. The Oncologist. https://doi.org/10.1634/theoncologist.2018-0255
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.