The DOI matches its Crossref record; 40 of the 42 references it cites were found in a registry or an index.
Optimizing the Factual Correctness of a Summary: A Study of Summarizing Radiology Reports
Open accessAbstract
Neural abstractive summarization models are able to generate summaries which have high overlap with human references.However, existing models are not optimized for factual correctness, a critical metric in real-world applications.In this work, we develop a general framework where we evaluate the factual correctness of a generated summary by factchecking it automatically against its reference using an information extraction module.We further propose a training strategy which optimizes a neural summarization model with a factual correctness reward via reinforcement learning.We apply the proposed method to the summarization of radiology reports, where factual correctness is a key requirement.On two separate datasets collected from hospitals, we show via both automatic and human evaluation that the proposed approach substantially improves the factual correctness and overall quality of outputs over a competitive neural summarization system, producing radiology summaries that approach the quality of humanauthored ones.Background: radiographic examination of the chest.clinical history: 80 years of age, male ... Findings: frontal radiograph of the chest demonstrates repositioning of the right atrial lead possibly into the ivc.... a right apical pneumothorax can be seen from the image.moderate right and small left pleural effusions continue.no pulmonary edema is observed.heart size is upper limits of normal. Human Summary: pneumothorax is seen. bilateral pleural effusions continue.Summary A (ROUGE-L = 0.77): no pneumothorax is observed.bilateral pleural effusions continue.Summary B (ROUGE-L = 0.44): pneumothorax is observed on radiograph.bilateral pleural effusions continue to be seen.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“generating Impression is related to Radiology Report Summarization (Zhang et al., 2020) where a system has to summarize the Findings section of a report into Impression , making this choice even more relevant.”
From Improving the Factual Correctness of Radiology Report Generation with Semantic Rewards (2022) · cites this paper as Zhang et al., 2020
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
Glove: Global Vectors for Word Representation
Pennington, J., Socher, R., & Manning, C. (2014) · Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.3115/v1/d14-1162 · Cited by 34,071
Self-citation(2014) · Cited by 33,419
Neural Machine Translation by Jointly Learning to Align and Translate
Bahdanau, D., Cho, K., & Bengio, Y. (2014) · arXiv · doi:10.48550/arxiv.1409.0473 · Cited by 16,213
Introduction to information retrieval
(2009) · Choice Reviews Online · doi:10.5860/choice.46-2715 · Cited by 12,278
Self-citationIntroduction to Information Retrieval
Manning, C. D., Raghavan, P., & Schütze, H. (2008) · doi:10.1017/cbo9780511809071 · Cited by 11,288
Self-citation(2004) · Cited by 9,718
Simple Statistical Gradient-Following Algorithms for Connectionist Reinforcement Learning
Williams, R. J. (1992) · Machine Learning · doi:10.1007/bf00992696 · Cited by 8,608
The Stanford CoreNLP Natural Language Processing Toolkit
Manning, C. D., Surdeanu, M., Bauer, J., Finkel, J. R., Bethard, S. J., & McClosky, D. (2014) · Annual Meeting of the Association for Computational Linguistics: System Demonstrations (ACL Demo) · doi:10.3115/v1/p14-5010 · Cited by 7,252
Self-citationA Learning Algorithm for Continually Running Fully Recurrent Neural Networks
Williams, R. J., & Zipser, D. (1989) · Neural Computation · doi:10.1162/neco.1989.1.2.270 · Cited by 4,369
Cited by
Sorted by citations
Items 101–172 of 172
Improving Radiology Summarization with Radiograph and Anatomy Prompts
Hu, J., Chen, Z., Liu, Y., Wan, X., & Chang, T. (2023) · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · doi:10.18653/v1/2023.findings-acl.764 · Cited by 10
Fine-tuning Language Models for Factuality
Tian, K., Mitchell, E., Yao, H., Manning, C. D., & Finn, C. (2023) · arXiv · doi:10.48550/arxiv.2311.08401 · Cited by 14
“Other use of the term ‘hallucination’ refers to summarization or translation system outputs not supported by the reference text (Maynez et al., 2020; Zhang et al., 2020) even if they are factual (Cao et al., 2022).”
Self-citationGuo, K., Zheng, S., Huang, R., & Gao, R. (2023) · IEEE Access · doi:10.1109/access.2023.3322425 · Cited by 10
Úbeda, P. L., Martín‐Noguerol, T., Escartín, J., & Luna, A. (2024) · Neuroradiology · doi:10.1007/s00234-024-03312-3 · Cited by 10
Enabling Multi-modal Conversational Interface for Clinical Imaging
Dayanandan, K., & Lall, B. (2024) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/3613905.3650805 · Cited by 9
SummerTime: Text Summarization Toolkit for Non-experts
Ni, A., Azerbayev, Z., Mutuma, M., Feng, T., Zhang, Y., Tao, Y., Awadallah, A. H., & Radev, D. (2021) · Conference on Empirical Methods in Natural Language Processing: System Demonstrations (EMNLP) · doi:10.18653/v1/2021.emnlp-demo.37 · Cited by 9
Self-citationFRSUM: Towards Faithful Abstractive Summarization via Enhancing Factual Robustness
Wu, W., Li, W., Liu, J., Xiao, X., Cao, Z., Li, S., & Wu, H. (2022) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2022.findings-emnlp.267 · Cited by 9
WebRED: Effective Pretraining And Finetuning For Relation Extraction On The WebPreprint
Ormándi, R., Saleh, M., Winter, E., & Rao, V. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2102.09681 · Cited by 10
Analyzing the Abstractiveness-Factuality Tradeoff With Nonlinear Abstractiveness Constraints.Preprint
Dreyer, M., Liu, M., Feng, N., Atluri, S., & Ravi, S. (2021) · arXiv (Cornell University) · Cited by 9
Fine-tuning BERT Models for Summarizing German Radiology Findings
Liang, S., Kades, K., Fink, M., Full, P., Weber, T., Kleesiek, J., Strube, M., & Maier-Hein, K. (2022) · Proceedings of the 4th Clinical Natural Language Processing Workshop · doi:10.18653/v1/2022.clinicalnlp-1.4 · Cited by 8
Multi-Evidence Based Fact Verification via A Confidential Graph Neural Network
Lan, Y., Liu, Z., Gu, Y., Yi, X., Li, X., Yang, L., & Yu, G. (2024) · IEEE Transactions on Big Data · doi:10.1109/tbdata.2024.3403382 · Cited by 8
Optum at MEDIQA 2021: Abstractive Summarization of Radiology Reports using simple BART Finetuning
Kondadadi, R., Manchanda, S., Ngo, J. A., & McCormack, R. (2021) · Workshop on Biomedical Language Processing (BioNLP) · doi:10.18653/v1/2021.bionlp-1.32 · Cited by 9
Research on automatic pilot repetition generation method based on deep reinforcement learning
Pan, W., Jiang, P., Li, Y., Wang, Z., & Huang, J. (2023) · Frontiers in Neurorobotics · doi:10.3389/fnbot.2023.1285831 · Cited by 8
Generating Followup Questions for Interpretable Multi-hop Question AnsweringPreprint
Malon, C. D., & Bai, B. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2002.12344 · Cited by 11
Patient-centric Summarization of Radiology Findings Using Two-step Training of Large Language Models
Tariq, A., Trivedi, S., Khan, A. U., Ramasamy, G., Fathizadeh, S., Stib, M. T., Tan, N., Patel, B. N., & Banerjee, I. (2024) · ACM Transactions on Computing for Healthcare · doi:10.1145/3709154 · Cited by 9
Xu, L., Zhang, Y., Hong, L., Cai, Y., & Sung, S. (2021) · Workshop on Biomedical Language Processing (BioNLP) · doi:10.18653/v1/2021.bionlp-1.29 · Cited by 7
Self-citationLeveraging speaker-aware structure and factual knowledge for faithful dialogue summarization
Zhao, L., Xu, W., Zhang, C., & Guo, J. (2022) · Knowledge-Based Systems · doi:10.1016/j.knosys.2022.108550 · Cited by 7
A Survey of Evaluation Methods of Generated Medical Textual Reports
Zhou, Y., Ringeval, F., & Portet, F. (2023) · Clinical Natural Language Processing Workshop (ClinicalNLP) · doi:10.18653/v1/2023.clinicalnlp-1.48 · Cited by 7
Mahajan, D., Tsou, C.-H., & Liang, J. J. (2021) · Workshop on Biomedical Language Processing (BioNLP) · doi:10.18653/v1/2021.bionlp-1.35 · Cited by 7
MiRANews: Dataset and Benchmarks for Multi-Resource-Assisted News Summarization
Xu, X., Dušek, O., Narayan, S., Rieser, V., & Konstas, I. (2021) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2021.findings-emnlp.133 · Cited by 7
Patient Centric Summarization of Radiology Findings using Large Language ModelsPreprint
Tariq, A., Fathizadeh, S., Ramaswamy, G., Trivedi, S., Urooj, A., Tan, N., Stib, M. T., Patel, B. N., & Banerjee, I. (2024) · medRxiv · doi:10.1101/2024.02.01.24302145 · Cited by 8
A Cascade Approach to Neural Abstractive Summarization with Content Selection and Fusion
Lebanoff, L., Dernoncourt, F., Kim, D. S., Chang, W. H., & Liu, F. (2020) · Conference of the Asia-Pacific Chapter of the Association for Computational Linguistics and the International Joint Conference on Natural Language Processing (AACL-IJCNLP) · doi:10.18653/v1/2020.aacl-main.52 · Cited by 6
Towards improving coherence and diversity of slogan generation
Jin, Y., Bhatia, A., Wanvarie, D., & Le, P. T. V. (2022) · Natural Language Engineering · doi:10.1017/s1351324921000474 · Cited by 6
A Cascade Approach to Neural Abstractive Summarization with Content Selection and FusionPreprint
Lebanoff, L., Dernoncourt, F., Kim, D. S., Chang, W. H., & Liu, F. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2010.03722 · Cited by 6
Ghosh, A., Jain, R., Jhangra, A., Saha, S., & Jatowt, A. (2025) · Wiley Interdisciplinary Reviews Data Mining and Knowledge Discovery · doi:10.1002/widm.70045 · Cited by 5
Gradient-Based Adversarial Factual Consistency Evaluation for Abstractive Summarization
Zeng, Z., Chen, J., Xu, W., & Li, L. (2021) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2021.emnlp-main.337 · Cited by 5
EchoGen: Generating Conclusions from Echocardiogram Notes
Tang, L., Kooragayalu, S., Wang, Y., Ding, Y., Durrett, G., Rousseau, J. F., & Peng, Y. (2022) · Workshop on Biomedical Language Processing (BioNLP) · doi:10.18653/v1/2022.bionlp-1.35 · Cited by 5
Rong, H., Chen, G., Ma, T., Sheng, V. S., & Bertino, E. (2023) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2023.3286097 · Cited by 5
Detecting Dialogue Hallucination Using Graph Neural Networks
Furumai, K., Wang, Y., Shinohara, M., Ikeda, K., Yu, Y., & Kato, T. (2023) · International Conference on Machine Learning and Applications · doi:10.1109/icmla58977.2023.00128 · Cited by 6
Automatic Generation of Electromyogram Diagnosis Report
Gu, Q., Nie, C., Zou, R., Chen, W., Zheng, C., Zhu, D., Mao, X., Wei, Z., & Tian, D. (2020) · IEEE International Conference on Bioinformatics and Biomedicine (BIBM) · doi:10.1109/bibm49941.2020.9313133 · Cited by 5
Zhang, M., Zhou, G., Yu, W., Liu, W., Huang, N., & Yu, Z. (2022) · Neural Computing and Applications · doi:10.1007/s00521-021-06880-0 · Cited by 5
PoinT-5: Pointer Network and T-5 based Financial NarrativeSummarisationPreprint
Singh, A. P. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2010.04191 · Cited by 6
Keep it Simple: Unsupervised Simplification of Multi-Paragraph TextPreprint
Laban, P., Schnabel, T., Bennett, P. N., & Hearst, M. A. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2107.03444 · Cited by 5
Entity-based De-noising Modeling for Controllable Dialogue Summarization
Liu, Z., & Chen, N. F. (2022) · Annual Meeting of the Special Interest Group on Discourse and Dialogue · doi:10.18653/v1/2022.sigdial-1.40 · Cited by 4
ВЕЛИКІ МОВНІ МОДЕЛІ ШТУЧНОГО ІНТЕЛЕКТУ В МЕДИЦИНІ
Мойсеєнко, М. І., Kuzyshyn, M., Turovska, L., Mazurenko, J., Петришин, М., & Мазуренко, О. (2024) · Modern Information Technologies and Innovation Methodologies of Education in Professional Training Methodology Theory Experience Problems · doi:10.31652/2412-1142-2024-72-73-88 · Cited by 6
Xu, Q., Xu, X., Zhou, C., Liu, Z., Huang, F., Li, S., Zhu, L., Bai, Z., Xu, Y., & Hu, W. (2025) · Expert Systems with Applications · doi:10.1016/j.eswa.2025.126585 · Cited by 6
Improving named entity correctness of abstractive summarization by generative negative sampling
Chen, Z., & Lin, H. (2023) · Computer Speech & Language · doi:10.1016/j.csl.2023.101504 · Cited by 4
GAP-Gen: Guided Automatic Python Code Generation
Zhao, J., Song, Y., Wang, J., & Harris, I. G. (2023) · Conference of the European Chapter of the Association for Computational Linguistics: Student Research Workshop (EACL SRW) · doi:10.18653/v1/2023.eacl-srw.4 · Cited by 6
Sarrouti, M., Gupta, D. K., Abacha, A. B., & Demner‐Fushman, D. (2021) · Cross-Language Evaluation Forum · Cited by 4
Probing Factually Grounded Content Transfer with Factual Ablation
West, P., Quirk, C., Galley, M., & Choi, Y. (2022) · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · doi:10.18653/v1/2022.findings-acl.294 · Cited by 6
GraphFact-Summ: Graph-Augmented Factual Summarization of Hospital Courses from Clinical Notes
Niloy, M., Islam, M. T., Ullah, M. S., Alom, J., Sultana, S. R., & Nur, K. M. (2025) · International Conference on Artificial Intelligence, Blockchain, and Internet of Things (AIBThings) · doi:10.1109/aibthings66987.2025.11296232 · Cited by 3
Generating Mammography Reports from Multi-view Mammograms with BERT
Yalunin, A., Sokolova, E., Burenko, I., Ponomarchuk, A., Сергеевна, П. О., & Umerenkov, D. (2021) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2021.findings-emnlp.15 · Cited by 4
Assessing Privacy Risks in Language Models: A Case Study on Summarization Tasks
Tang, R., Lueck, G., Quispe, R., Inan, H. A., Kulkarni, J., & Hu, X. (2023) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2023.findings-emnlp.1029 · Cited by 3
RadChat: A Radiology Chatbot Incorporating Clinical Context for Radiological Reports Summarization
Mei, X., Yang, L., Gao, D., Cai, X., Liu, T., & Han, J. (2024) · IEEE International Conference on Bioinformatics and Biomedicine (BIBM) · doi:10.1109/bibm62325.2024.10822010 · Cited by 3
KU-DMIS-MSRA at RadSum23: Pre-trained Vision-Language Model for Radiology Report Summarization
Kim, G., Kim, H., Ji, L., Bae, S., Kim, C., Sung, M., Kim, H., Yan, K., Chang, E., & Kang, J. (2023) · Workshop on Biomedical Language Processing (BioNLP) · doi:10.18653/v1/2023.bionlp-1.59 · Cited by 3
Chain-of-Thought for Cancer Pathology Interpretation and Summarization
Mali, A., Kohut, A., & Templeton, J. M. (2025) · IEEE International Conference on Smart Computing · doi:10.1109/smartcomp65954.2025.00081 · Cited by 2
Radiology Report Generation Using Deep Learning and Web-Based Deployment for Chest X-Ray Analysis
Agbolade, D., Heydarian, P., & Ahmad, S. (2026) · Journal of Informatics and Web Engineering · doi:10.33093/jiwe.2026.5.1.3 · Cited by 2
Automatic Generation of Discharge Summary of EMRs Based on Multi-granularity Information Fusion
Zhao, B., Zan, H., Niu, C., Chang, H., & Zhang, K. (2024) · Communications in computer and information science · doi:10.1007/978-981-99-9864-7_17 · Cited by 2
Document-Level Relation Extraction With Low Entity Redundancy Feature Map
Yan, R., Dang, D., Peng, K., Li, Y., Tao, Y., Hou, L., Li, J., & Tang, J. (2025) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2025.3607566 · Cited by 1
Future Trends in Artificial Intelligence for Medical Applications
Chaudhuri, T., & Ghosh, J. (2025) · Advances in medical diagnosis, treatment, and care (AMDTC) book series · doi:10.4018/979-8-3693-9816-6.ch020 · Cited by 1
Ghosh, A., Kumar, N., Patnaik, N., Prakash, A., Raj, R., & Saha, S. (2026) · ACM Transactions on Computing for Healthcare · doi:10.1145/3805803 · Cited by 1
MGK-RAG: Multi-Granularity Knowledge Guided Retrieval-Augmented Generation for Radiology Report
Ma, J., Yue, X., Chen, Y., Shi, J., Wei, Z., & Jia, Z. (2026) · International World Wide Web Conference (WWW) · doi:10.1145/3774904.3792924 · Cited by 1
Concept-Enhanced Multimodal RAG: Towards Interpretable and Accurate Radiology Report Generation
Salmè, M., Siciliano, F., Silvestri, F., Soda, P., Sicilia, R., & Guarrasi, V. (2026) · Information Systems Frontiers · doi:10.1007/s10796-026-10741-3 · Cited by 2
FalCon: A Faithful Contrastive Framework for Response Generation in TableQA Systems
Fang, S., Chen, J., Shen, X., Chen, Y., & Xiao, Y. (2022) · Lecture notes in computer science · doi:10.1007/978-3-031-00129-1_13 · Cited by 1
Are LLMs Hallucinating When Answering Specific Questions? Experiments with a RAG Pipeline
Iacob, I., & Silaghi, G. C. (2025) · Smart innovation, systems and technologies · doi:10.1007/978-981-96-0161-5_39 · Cited by 1
Mattiussi, F., Magoga, F., Schiaffino, S., Ferrari, V., Rezzonico, E., Grande, F. D., & Rizzo, S. (2025) · Tomography · doi:10.3390/tomography11040047 · Cited by 1
An Anchor-Based Automatic Evaluation Metric for Document Summarization
Wang, K., Liu, T., Chang, B., & Sui, Z. (2020) · International Conference on Computational Linguistics · doi:10.18653/v1/2020.coling-main.500 · Cited by 1
Zadrozny, W. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2012.05715 · Cited by 1
Generating Coherent and Diverse Slogans with Sequence-to-Sequence Transformer.Preprint
Jin, Y., Bhatia, A., Wanvarie, D., & Le, P. T. V. (2021) · arXiv (Cornell University) · Cited by 1
Kaviani, P., Kalra, M. K., Digumarthy, S. R., Rodriguez, K., Agarwal, S., Brooks, R., En, S., Alkasab, T. K., Bizzo, B. C., & Dreyer, K. J. (2024) · medRxiv · doi:10.1101/2024.03.07.24303787 · Cited by 1
Unsupervised Extractive Summarization of Psychedelic User Experience ReportsPreprint
Islam, M. S., Salam, S., & Hasan, M. N. (2025) · medRxiv · doi:10.1101/2025.08.22.25334176 · Cited by 1
Pino, P., Parra, D., Dunstan, J., & Besa, C. (2022) · SSRN Electronic Journal · doi:10.2139/ssrn.4052411
Chinese vascular ultrasound report Generation based on LSTM-RNN-Attention model
Wu, R., Huang, H., Liu, B., Gao, J., Lan, W., & Fei, X. (2022) · International Conference on Machine Learning and Natural Language Processing (MLNLP) · doi:10.1145/3578741.3578834
McInerney, D. J. (2024) · Digital Repository Service (Northeastern University) · doi:10.17760/d20653001
Automatically Generate Impression From Findings In Radiology Report Using BERT
Reang, R., Dehalwar, V., & Pateriya, R. K. (2024) · International Conference on Computing, Communication and Networking Technologies (ICCCNT) · doi:10.1109/icccnt61001.2024.10724981
Ding, J., Peng, W., Lu, Y., Wang, Z., & Feng, Y. (2025) · Neurocomputing · doi:10.1016/j.neucom.2025.131339
Parate, K., Nimbalkar, S., Talekar, H., Chopkar, D., Hirekhan, M., & Pathak, A. (2026) · International Research Journal on Advanced Engineering and Management (IRJAEM) · doi:10.47392/irjaem.2026.0307
Automated radiology report generation: A comprehensive review
Huang, L., Islam, T., Miron, A., HONE, K. S., & Li, Y. (2026) · Expert Systems with Applications · doi:10.1016/j.eswa.2026.133320
Chen, L., Jin, R., Luo, J., Chen, H., Strotzer, Q., Yan, R., Xue, Y., Prevedello, L. M. S., & Wu, D. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-38059-3_41
Ayalew, A. M., Seppänen, T., & Oussalah, M. (2026) · ACM SIGIR International Conference on Theory of Information Retrieval (ICTIR) · doi:10.1145/3805713.3820416
Arzu, G. E., Umar, M., Fayaz, M., Ali, U., Dang, L. M., & Moon, H. (2026) · Knowledge-Based Systems · doi:10.1016/j.knosys.2026.116901
Metadata
- Authors
- Zhang, Y., Merck, D., Tsai, E., Manning, C. D., & Langlotz, C.
- Affiliations
- Stanford University (US)
- University of Florida (US)
- Venue
- Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics
- Published
- 2020
- Pages
- 5108-5120
- ISSN
- 0736-587X (ISSN-L)
- OpenAlex
- W3034863243
- Cited by
- 171
- References
- 42
- Citations by year
- 2026: 9 · 2025: 16 · 2024: 20 · 2023: 30 · 2022: 32 · 2021: 49 · 2020: 15
- FWCI
- 11.79
- Type
- conference paper
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- cc-by
- Locations
- Proceedings of the conference - Association for Computational Linguistics. Meeting (publishedVersion, cc-by)
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Multimodal Machine Learning Applications
- Physical Sciences › Computer Science › Artificial Intelligence › Advanced Text Analysis Techniques
- Keywords
- factual accuracy, abstractive summarization, radiology reports, fact-checking, information extraction, reinforcement learning, medical report summarization, ROUGE evaluation
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
