Cited by 188Machine Learning in HealthcareCancer Genomics and DiagnosticsRadiomics and Machine Learning in Medical Imaging

Automated Real-World Data Integration Improves Cancer Outcome Prediction

Open access
Jee, Justin, Fong, Christopher, Pichotta, Karl, Tran, Thinh Ngoc, Luthra, Anisha, Waters, Michele, Fu, Chenlian, Altoe, Mirella +91 more·2024·Nature

Abstract

The digitization of health records and growing availability of tumour DNA sequencing provide an opportunity to study the determinants of cancer outcomes with unprecedented richness. Patient data are often stored in unstructured text and siloed datasets. Here we combine natural language processing annotations1,2 with structured medication, patient-reported demographic, tumour registry and tumour genomic data from 24,950 patients at Memorial Sloan Kettering Cancer Center to generate a clinicogenomic, harmonized oncologic real-world dataset (MSK-CHORD). MSK-CHORD includes data for non-small-cell lung (n = 7,809), breast (n = 5,368), colorectal (n = 5,543), prostate (n = 3,211) and pancreatic (n = 3,109) cancers and enables discovery of clinicogenomic relationships not apparent in smaller datasets. Leveraging MSK-CHORD to train machine learning models to predict overall survival, we find that models including features derived from natural language processing, such as sites of disease, outperform those based on genomic data or stage alone as tested by cross-validation and an external, multi-institution dataset. By annotating 705,241 radiology reports, MSK-CHORD also uncovers predictors of metastasis to specific organ sites, including a relationship between SETD2 mutation and lower metastatic potential in immunotherapy-treated lung adenocarcinoma corroborated in independent datasets. We demonstrate the feasibility of automated annotation from unstructured notes and its utility in predicting patient outcomes. The resulting data are provided as a public resource for real-world oncologic research. A study generates a clinicogenomics dataset resource, MSK-CHORD, that combines natural language processing-derived clinical annotations with patient medical data from various sources to improve models of cancer outcome.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1038/s41586-024-08167-5

Cites

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

The citation lists haven’t been fetched yet

References 60 · Cited by 188

Research works printed but not linked: 6

  1. [3]Vaswani, A. et al. Attention is all you need. Adv. Neural Inf. Process. Syst.30, 6000–6010 (2017)
  2. [48]Loshchilov, I. & Hutter, F. Decoupled weight decay regularization. in 7thInternational Conference on Learning Representations (ICLR, 2019).
  3. [52]Devlin, J., Chang, M.-W., Lee, K. & Toutanova, K. BERT: pre-training of deep bidirectional transformers for language understanding. In Proc. 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies Vol. 1 (Long and Short Papers) 4171–4186 (Association for Computational Linguistics, 2019).
  4. [53]Devlin, J., Chang, M.-W., Lee, K. & Toutanova, K. BERT: pre-training of deep bidirectional transformers for language understanding. in Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies Vol. 1 (Long and Short Papers) 4171–4186 (Association for Computational Linguistics, 2019).
  5. [54]Li, Y, Wehbe, R. M., Ahmad, F. S., Wang, H. & Luo, Y. A comparative study of pretrained language models for long clinical text. J. Am. Med. Inform. Assoc.30, 340–347 (2023). PMC9846675 36451266
  6. [55]Beltagy, I., Peters, M. E. & Cohan, A. Longformer: the long-document transformer. Preprint at https://arxiv.org/abs/2004.05150 (2020). · arXiv

Authors
Jee, J., Fong, C., Pichotta, K., Tran, T. N., Luthra, A., Waters, M., Fu, C., Altoe, M., Liu, S.-Y., Maron, S. B., Ahmed, M., Kim, S., Pirun, M., Chatila, W. K., de Bruijn, I., Pasha, A., Kundra, R., Gross, B., Mastrogiacomo, B., Aprati, T. J., Liu, D., Gao, J., Capelletti, M., Pekala, K., Loudon, L., Perry, M., Bandlamudi, C., Donoghue, M., Satravada, B. A., Martin, A., Shen, R., Chen, Y., Brannon, A. R., Chang, J., Braunstein, L., Li, A., Safonov, A., Stonestrom, A., Sanchez-Vela, P., Wilhelm, C., Robson, M., Scher, H., Ladanyi, M., Reis-Filho, J. S., Solit, D. B., Jones, D. R., Gomez, D., Yu, H., Chakravarty, D., Yaeger, R., Abida, W., Park, W., O’Reilly, E. M., Garcia-Aguilar, J., Socci, N., Sanchez-Vega, F., Carrot-Zhang, J., Stetson, P. D., Levine, R., Rudin, C. M., Berger, M. F., Shah, S. P., Schrag, D., Razavi, P., Kehl, K. L., Li, B. T., Riely, G. J., Schultz, N., MSK Cancer Data Science Initiative Group, Lisman, A., Zhao, G., de Bruijn, I., Chatila, W. K., Li, X., Kohli, A., Moore, D., Lim, R., Pollard, T., Sheridan, R., Wang, A., Chennault, C., Wilson, M., Zhang, H., Pimienta, R., Rangavajhala, S., Subramanian, G., Garcia, J., Rachuri, N., Boehm, K., Parker, M., Walch, H., Nandakumar, S., Eichholz, J., Kris, A., Manca, P., Bai, X., Agbamu, T., U, J., & Bi, X.
Affiliations
  • Memorial Sloan Kettering Cancer Center (US)
  • Dana-Farber Cancer Institute (US)
  • Caris Life Sciences (United States) (US)
Corresponding author
Schultz, Nikolaus
Venue
Nature
Published
2024-11-06
Volume
636
Issue
8043
Pages
728-736
ISSN
  • 0028-0836 (ISSN-L)
  • 1476-4687
OpenAlex
W4404105438
Cited by
188
References
60
Citations by year
2026: 99 · 2025: 88 · 2024: 1
FWCI
27.57
Type
journal article
Language
en
Open access
Locations
  • Nature (publishedVersion, cc-by-nc-nd)
  • PubMed Central (publishedVersion, cc-by-nc-nd)
  • PubMed (publishedVersion)
  • RePEc: Research Papers in Economics (submittedVersion)
Funders
  • National Institutes of Health (5u24ca274633-03)
  • National Cancer Institute (R01CA234361, R01CA240472, P01CA228696, R01CA217169, P30CA008748, K08CA286842, K12CA184746, T32CA009207, P50CA092629, P01CA275746)
Topics
  • Physical Sciences › Computer Science › Artificial Intelligence › Machine Learning in Healthcare
  • Life Sciences › Biochemistry, Genetics and Molecular Biology › Cancer Research › Cancer Genomics and Diagnostics
  • Health Sciences › Medicine › Radiology, Nuclear Medicine and Imaging › Radiomics and Machine Learning in Medical Imaging
Keywords
clinicogenomics, real-world data integration, cancer outcome prediction, overall survival, metastasis prediction, SETD2 mutation, immunotherapy, lung adenocarcinoma, radiology reports, unstructured clinical notes, data harmonization, non-small cell lung cancer, breast cancer, colorectal cancer, prostate cancer, pancreatic cancer
MeSH terms
Machine Learning, Automation, Female, Humans, Immunotherapy, Male, Models, Biological, Natural Language Processing, Neoplasm Metastasis, Neoplasms, Prognosis, Histone-Lysine N-Methyltransferase, Registries, Genomics, Electronic Health Records, Datasets as Topic

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review