Abstract 5721: Automated annotation for large-scale clinicogenomic models of lung cancer treatment response and overall survival
Abstract
The digitization of health records and prompt availability of tumor DNA sequencing results offer a chance to study the determinants of cancer outcomes with unprecedented richness; however, abstraction of key attributes from free text presents a major limitation to large-scale analyses. Using natural language processing (NLP), we derived sites of metastasis, prior treatment at outside institutions, programmed death ligand 1 (PD-L1) levels, and smoking status from records of patients with tumor sequencing to create a richly annotated clinicogenomic cohort. We sought to define whether combining features would improve models of overall survival (OS) and treatment response as validated in a multi-institution, manually curated cohort. We leveraged the manually curated AACR GENIE Biopharma Collaborative (BPC) dataset to train NLP algorithms to abstract the aforementioned features from overlapping records available at Memorial Sloan Kettering (MSK). All models achieved precision and recall > 0.85. We deployed these algorithms to records of all MSK patients with non-small cell lung cancer (NSCLC) and tumor profiling with our FDA-authorized institutional targeted sequencing platform (N=7,015). These labels were combined with genomic, demographic, histopathologic, internal treatment and staging data to train random survival forests (RSF) to predict OS and time-to-next-treatment (TTNT) for molecularly targeted and immunotherapies. RSFs trained on the MSK NSCLC cohort were validated with the curated, non-MSK BPC NSCLC cohort (N=977). The addition of NLP-derived variables to genomic features enhanced RSF predictive power for OS (c-index, 10x bootstrap 95%CI: 0.58, 0.57-0.59 vs 0.75, 0.74-0.76 combined) and targeted and immunotherapy TTNT. The size of the MSK NSCLC cohort enabled discovery of associations between metastatic sites, PD-L1 status, genomics, and TTNTs not apparent in the smaller BPC cohort. We measured the added predictive value of variables not available in BPC with MSK-only cross-validation analyses. White blood cell differential counts and additional tissue genomic features including tumor mutational burden and fraction genome altered added minimally, while circulating tumor DNA sequencing added prognostic power for OS over other factors including disease burden Using NLP we present a large NSCLC cohort with rich clinicoradiographic annotation, leading to superior models of patient outcomes. Our data uncovers associations not observed in smaller, manually curated cohorts and provides a foundation for further research in therapy choice and prognostication. Citation Format: Justin Jee, Chris Fong, Karl Pichotta, Thinh Tran, Anisha Luthra, Mirella Altoe, Steven Maron, Ronglai Shen, Si-Yang Liu, Michele Waters, Joseph Kholodenko, Brooke Mastrogiacomo, Susie Kim, A Rose Brannon, Michael F. Berger, Axel Martin, Jason Chang, Anton Safonov, Jorge S. Reis-Filho, Deborah Schrag, Sohrab P. Shah, Pedram Razavi, Bob T. Li, Gregory J. Riely, Nikolaus Schultz. Automated annotation for large-scale clinicogenomic models of lung cancer treatment response and overall survival. [abstract]. In: Proceedings of the American Association for Cancer Research Annual Meeting 2023; Part 1 (Regular and Invited Abstracts); 2023 Apr 14-19; Orlando, FL. Philadelphia (PA): AACR; Cancer Res 2023;83(7_Suppl):Abstract nr 5721.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The MSK radiology impressions were thoroughly reviewed and labeled by radiologists into five categories indicating cancer progression.
“These radiology impressions, gathered from MSK30, were thoroughly reviewed and labeled by radiologists with five categories indicating cancer progression”
From Large language model trained on clinical oncology data predicts cancer progression (2025) · cites this paper as [30]
Cites
Still being checked.
Cited by
Sorted by citations
Large language model trained on clinical oncology data predicts cancer progression
Zhu, M., Lin, H., Jiang, J., Jinia, A. J., Jee, J., Pichotta, K., Waters, M., Rose, D., Schultz, N., Chalise, S., et al. (2025) · npj Digital Medicine · doi:10.1038/s41746-025-01780-2 · Cited by 30 · see citing works
Self-citationKehl, K. L., Jee, J., Pichotta, K., Paul, M. A., Trukhanov, P., Fong, C. J., Waters, M., Bakouny, Z., Xu, W. V., Choueiri, T. K., et al. (2024) · Nature Communications · doi:10.1038/s41467-024-54071-x · Cited by 26 · see citing works
Self-citationAdvancing Global Health Equity in Oncology Clinical Trial Access
Coalition, B. N. E. I. C., Adewole, T., Albrecht, B., Beg, S., Brawley, O. W., Chang, I., Daly, B., Claro, A. D., Dent, J., Dickler, M. N., et al. (2024) · Cancer Discovery · doi:10.1158/2159-8290.cd-24-1288 · Cited by 14 · see citing works
Self-citationAI cancer driver mutation predictions are valid in real-world data
Tran, T. N., Fong, C., Pichotta, K., Luthra, A., Shen, R., Chen, Y., Waters, M., Kim, S., Li, X., de Bruijn, I., et al. (2025) · Nature Communications · doi:10.1038/s41467-025-63461-8 · Cited by 1 · see citing works
Self-citation
- Authors
- Jee, J., Fong, C., Pichotta, K., Tran, T., Luthra, A., Altoe, M., Maron, S., Shen, R., Liu, S.-Y., Waters, M., Kholodenko, J., Mastrogiacomo, B., Kim, S., Brannon, A. R., Berger, M. F., Martin, A., Chang, J., Safonov, A., Reis-Filho, J. S., Schrag, D., Shah, S. P., Razavi, P., Li, B. T., Riely, G. J., & Schultz, N.
- Affiliations
- Memorial Sloan Kettering Cancer Center (US)
- 1Memorial Sloan Kettering Cancer Center, New York, NY;
- New York University (US)
- ORCID
- Jee, Justin
- Fong, Chris
- Tran, Thinh
- Luthra, Anisha
- Maron, Steven
- Shen, Ronglai
- Liu, Si-Yang
- Waters, Michele
- Mastrogiacomo, Brooke
- Kim, Susie
- Brannon, A Rose
- Berger, Michael F.
- Martin, Axel
- Chang, Jason
- Safonov, Anton
- Reis-Filho, Jorge S.
- Schrag, Deborah
- Shah, Sohrab P.
- Razavi, Pedram
- Li, Bob T.
- Riely, Gregory J.
- Schultz, Nikolaus
- Venue
- Cancer Research
- Published
- 2023-04-04
- Volume
- 83
- Issue
- 7_Supplement
- Pages
- 5721-5721
- ISSN
- 0008-5472 (ISSN-L)
- 1538-7445
- OpenAlex
- W4362541523
- Cited by
- 4
- References
- 0
- Citations by year
- 2025: 2 · 2024: 2
- Type
- conference abstract
- Language
- en
- Open access
- closed
- Locations
- Cancer Research (publishedVersion)
- Topics
- Health Sciences › Medicine › Pulmonary and Respiratory Medicine › Lung Cancer Treatments and Mutations
- Health Sciences › Medicine › Radiology, Nuclear Medicine and Imaging › Radiomics and Machine Learning in Medical Imaging
- Physical Sciences › Computer Science › Artificial Intelligence › Machine Learning in Healthcare
- Keywords
- natural language processing, non-small cell lung cancer, overall survival prediction, treatment response prediction, time to next treatment, PD-L1 expression, metastasis site, smoking status, random survival forest, targeted therapy, immunotherapy, tumor mutational burden, circulating tumor DNA, prognostic factors
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review