The DOI matches its Crossref record; 19 of the 19 references it cites were found in a registry or an index.
Artificial Intelligence Tool for Optimizing Eligibility Screening for Clinical Trials in a Large Community Cancer Center
Abstract
PURPOSE: Less than 5% of patients with cancer enroll in clinical trials, and 1 in 5 trials are stopped for poor accrual. We evaluated an automated clinical trial matching system that uses natural language processing to extract patient and trial characteristics from unstructured sources and machine learning to match patients to clinical trials. PATIENTS AND METHODS: Medical records from 997 patients with breast cancer were assessed for trial eligibility at Highlands Oncology Group between May and August 2016. System and manual attribute extraction and eligibility determinations were compared using the percentage of agreement for 239 patients and 4 trials. Sensitivity and specificity of system-generated eligibility determinations were measured, and the time required for manual review and system-assisted eligibility determinations were compared. RESULTS: Agreement between system and manual attribute extraction ranged from 64.3% to 94.0%. Agreement between system and manual eligibility determinations was 81%-96%. System eligibility determinations demonstrated specificities between 76% and 99%, with sensitivities between 91% and 95% for 3 trials and 46.7% for the 4th. Manual eligibility screening of 90 patients for 3 trials took 110 minutes; system-assisted eligibility determinations of the same patients for the same trials required 24 minutes. CONCLUSION: In this study, the clinical trial matching system displayed a promising performance in screening patients with breast cancer for trial eligibility. System-assisted trial eligibility determinations were substantially faster than manual review, and the system reliably excluded ineligible patients for all trials and identified eligible patients for most trials.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Bidirectional Encoder Representations from Transformers (BERT)-based tools have been used for subject matching across various diseases while struggling with generalizability [4–7].”
From Enhancing hepatopathy clinical trial efficiency: a secure, large language model-powered pre-screening pipeline (2025) · cites this paper as [5]
In the citing paper
“Systems parse biomarker requirements, prior therapies, and performance status from EHRs, identify potentially eligible patients, and flag candidates for screening [56,57,58,59,60,61,62].”
From Artificial Intelligence in Clinical Oncology: From Productivity Enhancement to Creative Discovery (2025) · cites this paper as [59]
Citations
Cites
Use of Ranks in One-Criterion Variance Analysis
Kruskal, W. H., & Wallis, W. A. (1952) · Journal of the American Statistical Association · doi:10.1080/01621459.1952.10483441 · Cited by 13,912
What can natural language processing do for clinical decision support?
Demner‐Fushman, D., Chapman, W. W., & McDonald, C. J. (2009) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2009.08.007 · Cited by 716
The Role of Clinical Trial Participation in Cancer Research: Barriers, Evidence, and Strategies
Unger, J. M., Cook, E., Tai, E., & Bleyer, A. (2016) · American Society of Clinical Oncology Educational Book · doi:10.1200/edbk_156686 · Cited by 665
Carlisle, B., Kimmelman, J., Ramsay, T., & MacKinnon, N. (2015) · Clinical Trials · doi:10.1177/1740774514558307 · Cited by 367
Adult cancer clinical trials that fail to complete: an epidemic?
Stensland, K. D., McBride, R. B., Latif, A., Wisnivesky, J., Hendricks, R., Roper, N., Boffetta, P., Hall, S. J., Oh, W. K., & Galsky, M. D. (2014) · JNCI Journal of the National Cancer Institute · doi:10.1093/jnci/dju229 · Cited by 161
Ni, Y., Wright, J., Perentesis, J., Lingren, T., Deleger, L., Kaiser, M., Kohane, I., & Solti, I. (2015) · BMC Medical Informatics and Decision Making · doi:10.1186/s12911-015-0149-3 · Cited by 142
A National Cancer Clinical Trials System for the 21st Century
Board on Health Care Services (2010) · National Academies Press eBooks · doi:10.17226/12879 · Cited by 135
Ni, Y., Kennebeck, S., Dexheimer, J. W., McAneney, C. M., Tang, H., Lingren, T., Li, Q., Zhai, H., & Solti, I. (2014) · Journal of the American Medical Informatics Association · doi:10.1136/amiajnl-2014-002887 · Cited by 115
Artificial Intelligence, Big Data, and Cancer
Kantarjian, H. M., & Yu, P. P. (2015) · JAMA Oncology · doi:10.1001/jamaoncol.2015.1203 · Cited by 105
Enhancing Next-Generation Sequencing-Guided Cancer Care Through Cognitive Computing
Patel, N. M., Michelini, V. V., Snell, J. M., Balu, S., Hoyle, A. P., Parker, J. S., Hayward, M. C., Eberhard, D. A., Salazar, A. H., McNeillie, P., et al. (2017) · The Oncologist · doi:10.1634/theoncologist.2017-0170 · Cited by 103
Flagged first, then by citations
Research works printed but not linked: 1
- Shivade C, 2017, AMIA Annu Symp Proc, 2016, 1149
Cited by
Sorted by citations
Items 101–127 of 127
THE TREATMENT OF ROTO-LATERAL CURVATURE OF THE SPINE.
McKenzie, B. E. (1912) · Europe PMC (PubMed Central)
Artificial Intelligence (AI) Game Changer in Cancer Biology
Kamalanathan, A., Muthu, B., & Kaleena, P. K. (2023) · BENTHAM SCIENCE PUBLISHERS eBooks · doi:10.2174/9789815136807123010009
AS CATEGORIAS DE INCERTEZAS NA INTELIGÊNCIA ARTIFICIAL EM HOSPITAIS: UMA REVISÃO DE LITERATURA
MAGALHÃES, G. H. D., Spínola, M. D. M., Matos, C. C. P., & Gonçalves, R. F. (2023) · Anais ... Encontro Nacional de Engenharia de Produção/Anais do Encontro Nacional de Engenharia de Produção · doi:10.14488/enegep2023_tn_st_404_1987_46298
Delshad, M., Omrani, M. A., Pourbagheri‐Sigaroodi, A., & Bashash, D. (2023) · Iranian Journal of Blood and Cancer · doi:10.61186/ijbc.15.3.13
How artificial intelligence is revolutionizing precision medicine and drug discovery?
Yousefi, A., Zandi, A., Shojaeian, F., Marzban, M. R., Tavakol, M. R., Abiri, H., Hojabri, M., Kaviani, G., & Pournezhad, S. (2023) · Iranian Journal of Blood and Cancer · doi:10.61186/ijbc.15.3.42
Künstliche Intelligenz im Einsatz gegen die Knowledge-Gap
Kreyenschulte, T. (2023) · Springer eBooks · doi:10.1007/978-3-658-41781-9_17
Do, N., Elbers, D. C., Fillmore, N. R., Ajjarapu, S., Bergstrom, S. J., Bihn, J. R., Corrigan, J. K., Dhond, R. P., Dipietro, S., Dolgin, A., et al. (2024) · Studies in health technology and informatics · doi:10.3233/shti231132
Future Directions and Challenges in Overcoming Drug Resistance in Cancer
Khan, S. U., Jan, S., Fatima, K., Wani, A., & Malik, F. A. (2024) · Springer eBooks · doi:10.1007/978-981-97-1666-1_12
Yadav, D. K., Rathee, S., & Patil, U. K. (2024) · Current Cancer Therapy Reviews · doi:10.2174/0115733947301672240528061642 · Cited by 1
Aich, A., & Banerjee, K. (2024) · BENTHAM SCIENCE PUBLISHERS eBooks · doi:10.2174/9789815223255124010011
Innovating Health Records: The Path of AI
WagleVenkatesha, A., & Naik, H. (2025) · Journal of Research in Science and Engineering · doi:10.53469/jrse.2025.07(02).07
Shon, B., Seong, S. J., Choi, E. J., Gwon, M., Lee, H. W., Park, J., Chung, H. Y., Jeong, S., & Yoon, Y. (2025) · JMIR AI · doi:10.2196/64845 · Cited by 1
Artificial Intelligence in Oncology
Afzal, S., Basharat, S., & Khurshid, S. (2025) · Springer eBooks · doi:10.1007/978-981-96-8176-1_13
Analysis of discontinued radiotherapy trials registered on ClinicalTrials.gov between 2014 and 2024
Wu, B., Li, M., Ding, P., Tan, H., Zhang, Z., He, Z., Liao, H., & Dong, X. (2025) · Radiotherapy and Oncology · doi:10.1016/j.radonc.2025.111201
Seamless Integration of Technology in Pharmaceuticals
Sagar, B. R., Sharma, A. M., Sharma, S., Singh, S., & Sharma, A. (2025) · BENTHAM SCIENCE PUBLISHERS eBooks · doi:10.2174/9789815324457125010013
Wang, K., Cui, H., Zhu, Y., Hu, X., Hong, C., Guo, Y., An, L., Zhang, Q., & Liu, L. (2024) · Figshare · doi:10.6084/m9.figshare.26684559
Meystre, S. M., Heider, P. M., Cates, A., Bastian, G., Pittman, T., Gentilin, S. M., & Kelechi, T. J. (2023) · Figshare · doi:10.6084/m9.figshare.22618963
Roller, C., Ittermann, T., Syperek, A., Mühler, M. R., Wielpütz, M. O., Kühn, J., Blum, S. F. U., Schön, F., Winter, P., Schnell, S., et al. (2025) · European Journal of Radiology · doi:10.1016/j.ejrad.2025.112642
63Chapter 4 AI for enhanced cancer detection and diagnosis
Malviya, R., Rajput, S., Roy, M., Sridhar, S. B., & Thomas, S. (2025) · De Gruyter eBooks · doi:10.1515/9783111670744-004
Application of artificial intelligence in gynecologic cancers: A bibliometric analysis
Liu, N., Jiang, F., Lou, Y., & Guan, J. (2026) · Digital Health · doi:10.1177/20552076261416708
Manifold Integration of Lung Emphysema Signatures (MILES): A Radiomic-Based Study
Socha, M., Durawa, A., Jelitto-Górska, M., Dziadziuszko, K., Rzyman, W., Szurowska, E., & Polańska, J. (2026) · Machine Learning and Knowledge Extraction · doi:10.3390/make8020032
Geriatric oncology in 2040: Exploring potential realities and challenges. A diverse perspective
Gardner, R., de Barros, L. P. L., Cheung, K., Dale, W., Decoster, L., Ewals, B., Kenis, C., Puts, M. T. E., Steer, C., Wildiers, H., et al. (2026) · Journal of Geriatric Oncology · doi:10.1016/j.jgo.2026.102907
Artificial Intelligence Towards Health Care and Its Role in Diagnostics and Treatment
Sharf, Y., Sharf, R., & Khan, G. (2026) · Advances in computational intelligence and robotics book series · doi:10.4018/407371
Kumar, A., & Vasu (2026) · Springer eBooks · doi:10.1007/978-981-95-4831-6_29
Smart Trial: Evaluating LLMs for Recruiting Clinical Trial Participants on Social Media
Zhou, X., Wang, Z., Krieger, J., Zalake, M. S., & Cheng, L. (2026) · Lecture notes in computer science · doi:10.1007/978-981-92-1468-6_38
Graph-augmented LLMs for social media-based clinical trial recruitment
Zhou, X., Wang, Z., Krieger, J., Zalake, M. S., & Cheng, L. (2026) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2026.105104
Majid, Z., Chaudhuri, W., & Kanabar, V. (2026) · Lecture notes of the Institute for Computer Sciences, Social Informatics and Telecommunications Engineering · doi:10.1007/978-3-032-33123-6_16
Metadata
- Authors
- Beck, J. T., Rammage, M., Jackson, G. P., Preininger, A. M., Dankwa-Mullan, I., Roebuck, M. C., Torres, A., Holtzen, H., Coverdill, S. E., Williamson, M. P., Chau, Q., Rhee, K., & Vinegra, M.
- Affiliations
- Highlands Oncology Group (US)
- IBM (United States) (US)
- IBM Watson Health, IBM Corporation, Cambridge, MA
- RxEconomics, Hunt Valley, MD
- Novartis (United States) (US)
- ORCID
- Venue
- JCO Clinical Cancer Informatics
- Published
- 2020-11
- Volume
- 4
- Issue
- 4
- Pages
- 50-59
- ISSN
- 2473-4276 (ISSN-L)
- OpenAlex
- W3001688612
- Cited by
- 127
- References
- 19
- Citations by year
- 2026: 17 · 2025: 28 · 2024: 33 · 2023: 20 · 2022: 7 · 2021: 16 · 2020: 5
- FWCI
- 3.58
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- JCO Clinical Cancer Informatics (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
- Health Sciences › Health Professions › Health Information Management › Electronic Health Records Systems
- Physical Sciences › Computer Science › Artificial Intelligence › Machine Learning in Healthcare
- Keywords
- clinical trial eligibility screening, natural language processing, machine learning, breast cancer, cancer clinical trials, trial accrual, attribute extraction
- MeSH terms
- Machine Learning, Adult, Aged, Aged, 80 and over, Artificial Intelligence, Breast Neoplasms, Clinical Trials as Topic, Eligibility Determination, Female, Humans, Middle Aged, Natural Language Processing, Patient Selection, Community Networks, Early Detection of Cancer
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
