Automated Real-World Data Integration Improves Cancer Outcome Prediction
Open accessAbstract
The digitization of health records and growing availability of tumour DNA sequencing provide an opportunity to study the determinants of cancer outcomes with unprecedented richness. Patient data are often stored in unstructured text and siloed datasets. Here we combine natural language processing annotations1,2 with structured medication, patient-reported demographic, tumour registry and tumour genomic data from 24,950 patients at Memorial Sloan Kettering Cancer Center to generate a clinicogenomic, harmonized oncologic real-world dataset (MSK-CHORD). MSK-CHORD includes data for non-small-cell lung (n = 7,809), breast (n = 5,368), colorectal (n = 5,543), prostate (n = 3,211) and pancreatic (n = 3,109) cancers and enables discovery of clinicogenomic relationships not apparent in smaller datasets. Leveraging MSK-CHORD to train machine learning models to predict overall survival, we find that models including features derived from natural language processing, such as sites of disease, outperform those based on genomic data or stage alone as tested by cross-validation and an external, multi-institution dataset. By annotating 705,241 radiology reports, MSK-CHORD also uncovers predictors of metastasis to specific organ sites, including a relationship between SETD2 mutation and lower metastatic potential in immunotherapy-treated lung adenocarcinoma corroborated in independent datasets. We demonstrate the feasibility of automated annotation from unstructured notes and its utility in predicting patient outcomes. The resulting data are provided as a public resource for real-world oncologic research. A study generates a clinicogenomics dataset resource, MSK-CHORD, that combines natural language processing-derived clinical annotations with patient medical data from various sources to improve models of cancer outcome.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Natural language processing increases productivity in clinical oncology by converting unstructured text into analyzable data and standardizing documentation.
“Natural language processing (NLP) increases productivity in clinical oncology by converting unstructured text into analyzable data and standardizing documentation [41,42,43,44,45,46].”
From Artificial Intelligence in Clinical Oncology: From Productivity Enhancement to Creative Discovery (2025) · cites this paper as [46]
Medically specialized LLMs such as Med-PaLM, Clinical-T5, and GatorTron show stronger understanding of clinical text than general-purpose models.
“Models such as Med-PaLM, Clinical-T5, and GatorTron are trained on medical corpora and show stronger understanding of clinical text than general-purpose models [46,47,48,49].”
From Artificial Intelligence in Clinical Oncology: From Productivity Enhancement to Creative Discovery (2025) · cites this paper as [46]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
The citation lists haven’t been fetched yet
References 60 · Cited by 188
Research works printed but not linked: 6
- [3]Vaswani, A. et al. Attention is all you need. Adv. Neural Inf. Process. Syst.30, 6000–6010 (2017)
- [48]Loshchilov, I. & Hutter, F. Decoupled weight decay regularization. in 7thInternational Conference on Learning Representations (ICLR, 2019).
- [52]Devlin, J., Chang, M.-W., Lee, K. & Toutanova, K. BERT: pre-training of deep bidirectional transformers for language understanding. In Proc. 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies Vol. 1 (Long and Short Papers) 4171–4186 (Association for Computational Linguistics, 2019).
- [53]Devlin, J., Chang, M.-W., Lee, K. & Toutanova, K. BERT: pre-training of deep bidirectional transformers for language understanding. in Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies Vol. 1 (Long and Short Papers) 4171–4186 (Association for Computational Linguistics, 2019).
- [54]Li, Y, Wehbe, R. M., Ahmad, F. S., Wang, H. & Luo, Y. A comparative study of pretrained language models for long clinical text. J. Am. Med. Inform. Assoc.30, 340–347 (2023). PMC9846675 36451266
- [55]Beltagy, I., Peters, M. E. & Cohan, A. Longformer: the long-document transformer. Preprint at https://arxiv.org/abs/2004.05150 (2020). · arXiv
- Authors
- Jee, J., Fong, C., Pichotta, K., Tran, T. N., Luthra, A., Waters, M., Fu, C., Altoe, M., Liu, S.-Y., Maron, S. B., Ahmed, M., Kim, S., Pirun, M., Chatila, W. K., de Bruijn, I., Pasha, A., Kundra, R., Gross, B., Mastrogiacomo, B., Aprati, T. J., Liu, D., Gao, J., Capelletti, M., Pekala, K., Loudon, L., Perry, M., Bandlamudi, C., Donoghue, M., Satravada, B. A., Martin, A., Shen, R., Chen, Y., Brannon, A. R., Chang, J., Braunstein, L., Li, A., Safonov, A., Stonestrom, A., Sanchez-Vela, P., Wilhelm, C., Robson, M., Scher, H., Ladanyi, M., Reis-Filho, J. S., Solit, D. B., Jones, D. R., Gomez, D., Yu, H., Chakravarty, D., Yaeger, R., Abida, W., Park, W., O’Reilly, E. M., Garcia-Aguilar, J., Socci, N., Sanchez-Vega, F., Carrot-Zhang, J., Stetson, P. D., Levine, R., Rudin, C. M., Berger, M. F., Shah, S. P., Schrag, D., Razavi, P., Kehl, K. L., Li, B. T., Riely, G. J., Schultz, N., MSK Cancer Data Science Initiative Group, Lisman, A., Zhao, G., de Bruijn, I., Chatila, W. K., Li, X., Kohli, A., Moore, D., Lim, R., Pollard, T., Sheridan, R., Wang, A., Chennault, C., Wilson, M., Zhang, H., Pimienta, R., Rangavajhala, S., Subramanian, G., Garcia, J., Rachuri, N., Boehm, K., Parker, M., Walch, H., Nandakumar, S., Eichholz, J., Kris, A., Manca, P., Bai, X., Agbamu, T., U, J., & Bi, X.
- Affiliations
- Memorial Sloan Kettering Cancer Center (US)
- Dana-Farber Cancer Institute (US)
- Caris Life Sciences (United States) (US)
- Corresponding author
- Schultz, Nikolaus
- ORCID
- Jee, Justin
- Fong, Christopher
- Pichotta, Karl
- Tran, Thinh Ngoc
- Luthra, Anisha
- Waters, Michele
- Fu, Chenlian
- Maron, Steven B.
- Kim, Susie
- Pirun, Mono
- Kundra, Ritika
- Gross, Benjamin
- Mastrogiacomo, Brooke
- Aprati, Tyler J.
- Liu, David
- Gao, JianJiong
- Capelletti, Marzia
- Pekala, Kelly
- Perry, Maria
- Bandlamudi, Chaitanya
- Donoghue, Mark
- Satravada, Baby Anusha
- Martin, Axel
- Shen, Ronglai
- Chen, Yuan
- Brannon, A. Rose
- Chang, Jason
- Braunstein, Lior
- Li, Anyi
- Safonov, Anton
- Stonestrom, Aaron
- Sanchez-Vela, Pablo
- Wilhelm, Clare
- Robson, Mark
- Scher, Howard
- Ladanyi, Marc
- Reis-Filho, Jorge S.
- Solit, David B.
- Jones, David R.
- Gomez, Daniel
- Yu, Helena
- Chakravarty, Debyani
- Yaeger, Rona
- Abida, Wassim
- Park, Wungki
- O’Reilly, Eileen M.
- Garcia-Aguilar, Julio
- Socci, Nicholas
- Sanchez-Vega, Francisco
- Carrot-Zhang, Jian
- Stetson, Peter D.
- Levine, Ross
- Rudin, Charles M.
- Berger, Michael F.
- Shah, Sohrab P.
- Schrag, Deborah
- Razavi, Pedram
- Kehl, Kenneth L.
- Li, Bob T.
- Riely, Gregory J.
- Schultz, Nikolaus
- Lisman, Aaron
- Zhao, Gaofei
- Li, Xiang
- Pollard, Tom
- Wang, Avery
- Chennault, Calla
- Wilson, Manda
- Zhang, Hongxin
- Boehm, Kevin
- Parker, Mitchell
- Walch, Henry
- Nandakumar, Subhiksha
- Eichholz, Jordan
- Manca, Paolo
- Bai, Xuechun
- Venue
- Nature
- Published
- 2024-11-06
- Volume
- 636
- Issue
- 8043
- Pages
- 728-736
- ISSN
- 0028-0836 (ISSN-L)
- 1476-4687
- PMC
- PMC11655358
- OpenAlex
- W4404105438
- Cited by
- 188
- References
- 60
- Citations by year
- 2026: 99 · 2025: 88 · 2024: 1
- FWCI
- 27.57
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- Locations
- Nature (publishedVersion, cc-by-nc-nd)
- PubMed Central (publishedVersion, cc-by-nc-nd)
- PubMed (publishedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- Funders
- National Institutes of Health (5u24ca274633-03)
- National Cancer Institute (R01CA234361, R01CA240472, P01CA228696, R01CA217169, P30CA008748, K08CA286842, K12CA184746, T32CA009207, P50CA092629, P01CA275746)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Machine Learning in Healthcare
- Life Sciences › Biochemistry, Genetics and Molecular Biology › Cancer Research › Cancer Genomics and Diagnostics
- Health Sciences › Medicine › Radiology, Nuclear Medicine and Imaging › Radiomics and Machine Learning in Medical Imaging
- Keywords
- clinicogenomics, real-world data integration, cancer outcome prediction, overall survival, metastasis prediction, SETD2 mutation, immunotherapy, lung adenocarcinoma, radiology reports, unstructured clinical notes, data harmonization, non-small cell lung cancer, breast cancer, colorectal cancer, prostate cancer, pancreatic cancer
- MeSH terms
- Machine Learning, Automation, Female, Humans, Immunotherapy, Male, Models, Biological, Natural Language Processing, Neoplasm Metastasis, Neoplasms, Prognosis, Histone-Lysine N-Methyltransferase, Registries, Genomics, Electronic Health Records, Datasets as Topic
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review