The DOI matches its Crossref record; 41 of the 41 references it cites were found in a registry or an index.
Evaluating the Factual Consistency of Abstractive Text Summarization
Open accessAbstract
Currently used metrics for assessing summarization algorithms do not account for whether summaries are factually consistent with source documents.We propose a weakly-supervised, model-based approach for verifying factual consistency and identifying conflicts between source documents and a generated summary.Training data is generated by applying a series of rule-based transformations to the sentences of source documents.The factual consistency model is then trained jointly for three tasks: 1) identify whether sentences remain factually consistent after transformation, 2) extract a span in the source documents to support the consistency prediction, 3) extract a span in the summary sentence that is inconsistent if one exists.Transferring this model to summaries generated by several state-of-the art models reveals that this highly scalable approach substantially outperforms previous models, including those trained with strong supervision using standard datasets for natural language inference and fact checking.Additionally, human evaluation shows that the auxiliary span extraction tasks provide useful assistance in the process of verifying factual consistency.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“In most previous works, factuality has been defined as whether a claim in a text can be supported by evidence from a separate, trustworthy knowledge base, with applications in fact-checking (Thorne et al., 2018b) (where the knowledge base is a large source like Wikipedia) and summarization (Kryscinski et al., 2020) (where the knowledge base is an input document or documents).”
From FacTool: Factuality Detection in Generative AI - A Tool Augmented Framework for Multi-Task and Multi-Domain Scenarios (2023) · cites this paper as Kryscinski et al., 2020
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Additionally, hallucinations are observed over a wide range of tasks beyond pure fact verification (Kryscinski et al., 2020; Maynez et al., 2020).”
From SelfCheckGPT: Zero-Resource Black-Box Hallucination Detection for Generative Large Language Models (2023) · cites this paper as Kryscinski et al., 2020
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“Research suggests that up to 30% of machine-generated abstractive summaries may contain factual inconsistencies [52, 53].”
From All Public Voices Are Equal, But Are Some More Equal Than Others to LLMs? (2026) · cites this paper as [53]
The cited source says what the claim attributes to it.
In the citing paper
“Results show that the performance of their FactCC model surpasses the classifiers trained on the MNLI or FEVER datasets.”
From Survey of Hallucination in Natural Language Generation (2023) · cites this paper as [126]
The cited source says what the claim attributes to it.
In the citing paper
“These methods, such as entity swapping and sentence negation (Kryscinski et al., 2020;Goyal and Durrett, 2021), were designed to target specific error types that occurred in claims from earlier summarization models.”
From MiniCheck: Efficient Fact-Checking of LLMs on Grounding Documents (2024) · cites this paper as Kryscinski et al., 2020
The cited source says what the claim attributes to it.
In the citing paper
“In response to this challenge, a surge of research explores leveraging data-augmentation methods to construct synthetical data for fine-tuning the classifier, either by rule-based perturbation [79, 152, 266] or generation [389].”
From A Survey on Hallucination in Large Language Models: Principles, Taxonomy, Challenges, and Open Questions (2025) · cites this paper as [152]
The cited source says what the claim attributes to it.
In the citing paper
“most prior studies have primarily concentrated on task-specific hallucinations, such as abstractive summarization [81, 102, 152, 208, 236, 310], data-to-text[240, 296], and machine translation [389].”
From A Survey on Hallucination in Large Language Models: Principles, Taxonomy, Challenges, and Open Questions (2025) · cites this paper as [152]
The check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“This approach has been widely studied in the summarization literature and recent work in factual precision (Kryscinski et al., 2020; Wang et al., 2020; Gao et al., 2022; Manakul et al., 2023).”
From FActScore: Fine-grained Atomic Evaluation of Factual Precision in Long Form Text Generation (2023) · cites this paper as Kryscinski et al., 2020
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., Kaiser, L., & Polosukhin, I. (2017) · arXiv · doi:10.48550/arxiv.1706.03762 · Cited by 120,404
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2018) · arXiv · doi:10.48550/arxiv.1810.04805 · Cited by 73,173
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2019) · Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers) · doi:10.18653/v1/n19-1423 · Cited by 54,325
Sequence to Sequence Learning with Neural Networks
Sutskever, I., Vinyals, O., & Le, Q. V. (2014) · arXiv · doi:10.48550/arxiv.1409.3215 · Cited by 17,766
Deep Contextualized Word Representations
Peters, M., Neumann, M., Iyyer, M., Gardner, M., Clark, C., Lee, K., & Zettlemoyer, L. (2018) · Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long Papers) · doi:10.18653/v1/n18-1202 · Cited by 11,983
(2017) · Cited by 11,625
(2004) · Cited by 9,718
Get To The Point: Summarization with Pointer-Generator Networks
See, A., Liu, P. J., & Manning, C. D. (2017) · Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/p17-1099 · Cited by 3,775
A Broad-Coverage Challenge Corpus for Sentence Understanding through Inference
Williams, A., Nangia, N., & Bowman, S. (2018) · Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long Papers) · doi:10.18653/v1/n18-1101 · Cited by 3,342
A Neural Attention Model for Abstractive Sentence Summarization
Rush, A. M., Chopra, S., & Weston, J. (2015) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d15-1044 · Cited by 2,932
Research works printed but not linked: 9
- Dzmitry Bahdanau, Kyunghyun Cho, and Yoshua Ben- gio. 2015. Neural machine translation by jointly learning to align and translate. In ICLR.
- Samuel R. Bowman, Gabor Angeli, Christopher Potts, and Christopher D. Manning. 2015. A large an- notated corpus for learning natural language infer- ence. In Proceedings of the 2015 Conference on Empirical Methods in Natural Language Processing (EMNLP). Association for Computational Linguis- tics.
- Kyunghyun Cho, Bart van Merrienboer, C ¸aglar Gülc ¸ehre, Dzmitry Bahdanau, Fethi Bougares, Hol- ger Schwenk, and Yoshua Bengio. 2014. Learning phrase representations using RNN encoder-decoder for statistical machine translation. In Proceedings of the 2014 Conference on Empirical Methods in Nat- ural Language Processing, EMNLP 2014, October 25-29, 2014, Doha, Qatar, A meeting of SIGDAT, a Special Interest Group of the ACL, pages 1724- 1734.
- Alexis Conneau, Ruty Rinott, Guillaume Lample, Ad- ina Williams, Samuel R. Bowman, Holger Schwenk, and Veselin Stoyanov. 2018. Xnli: Evaluating cross- lingual sentence representations. In Proceedings of the 2018 Conference on Empirical Methods in Nat- ural Language Processing. Association for Compu- tational Linguistics.
- Sergey Edunov, Myle Ott, Michael Auli, and David Grangier. 2018. Understanding back-translation at scale. CoRR, abs/1808.09381. · arXiv
- Ramesh Nallapati, Bowen Zhou, C ¸aglar Gülc ¸ehre, Bing Xiang, et al. 2016. Abstractive text summa- rization using sequence-to-sequence rnns and be- yond. Proceedings of SIGNLL Conference on Com- putational Natural Language Learning.
- Ramakanth Pasunuru and Mohit Bansal. 2018. Multi- reward reinforced summarization with saliency and entailment. CoRR, abs/1804.06451. · arXiv
- Matthew E. Peters, Mark Neumann, Mohit Iyyer, Matt Gardner, Christopher Clark, Kenton Lee, and Luke Zettlemoyer. 2018. Deep contextualized word rep- resentations. In Proc. of NAACL.
- James Thorne, Andreas Vlachos, Christos Christodoulopoulos, and Arpit Mittal. 2018. FEVER: a large-scale dataset for fact extraction and verification. CoRR, abs/1803.05355. · arXiv
Cited by
Sorted by citations
Items 401–500 of 693
Probing Factually Grounded Content Transfer with Factual Ablation
West, P., Quirk, C., Galley, M., & Choi, Y. (2022) · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · doi:10.18653/v1/2022.findings-acl.294 · Cited by 6
Nandwani, Y., Kumar, V., Raghu, D., Joshi, S., & Lastras, L. (2023) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2023.emnlp-main.639 · Cited by 6
Reading Comprehension as Natural Language Inference: A Semantic AnalysisPreprint
Mishra, A., Patel, D., Vijayakumar, A., Li, X., Kapanipathi, P., & Talamadupula, K. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2010.01713 · Cited by 4
Sometimes We Want TranslationesePreprint
Parthasarathi, P., Sinha, K., Pineau, J., & Williams, A. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2104.07623 · Cited by 4
Improving Factual Consistency of Abstractive Summarization via Question AnsweringPreprint
Nan, F., dos Santos, C. N., Zhu, H., Ng, P., McKeown, K. R., Nallapati, R. M., Zhang, D., Wang, Z., Arnold, A. O., & Xiang, B. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2105.04623 · Cited by 4
Understanding Faithfulness and Reasoning of Large Language Models on Plain Biomedical Summaries
Fang, B., Dai, X., & Karimi, S. (2024) · Findings of the Association for Computational Linguistics: EMNLP 2024 · doi:10.18653/v1/2024.findings-emnlp.578 · Cited by 4
Inverse Reinforcement Learning for Text Summarization
Fu, Y., Xiong, D., & Dong, Y. (2023) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2023.findings-emnlp.436 · Cited by 4
Zhu, Y., Li, Y., Li, L., Hu, D., Hao, X., Chen, D., Zhang, X., Zhang, Z., Zhou, Y., Litvak, M., et al. (2025) · IEEE Transactions on Audio Speech and Language Processing · doi:10.1109/taslpro.2025.3567744 · Cited by 4
Alkhushayni, S. M., & Lee, H. (2025) · Information · doi:10.3390/info16090806 · Cited by 5
Łajewska, W., Balog, K., Spina, D., & Trippas, J. R. (2024) · Annual International ACM SIGIR Conference on Research and Development in Information Retrieval in the Asia Pacific Region (SIGIR-AP) · doi:10.1145/3673791.3698409 · Cited by 5
Generating Abstractive Summaries from Social Media Discussions Using Transformers
Papagiannopoulou, A., Angeli, C., & Ahmad, M. B. (2025) · Open Journal of Applied Sciences · doi:10.4236/ojapps.2025.151016 · Cited by 3
Self-Rationalization in the Wild: A Large-scale Out-of-Distribution Evaluation on NLI-related tasks
Yang, J., Glockner, M., Rocha, A., & Gurevych, I. (2025) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00741 · Cited by 4
Summarizing judicial documents: a hybrid extractive- abstractive model with legal domain knowledge
Gao, Y., Wu, J., Liu, Z., & Li, J. (2025) · Artificial Intelligence and Law · doi:10.1007/s10506-025-09435-z · Cited by 4
Enhancing Summarization with Text Classification via Topic Consistency
Liu, J., & Yang, Y. (2021) · Lecture notes in computer science · doi:10.1007/978-3-030-86523-8_40 · Cited by 3
Post-Editing Extractive Summaries by Definiteness Prediction
Kabbara, J., & Cheung, J. C. K. (2021) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2021.findings-emnlp.312 · Cited by 3
With a Little Push, NLI Models can Robustly and Efficiently Predict Faithfulness
Steen, J., Opitz, J., Frank, A., & Markert, K. (2023) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2023.acl-short.79 · Cited by 5
Unsupervised Token-level Hallucination Detection from Summary Generation By-products
Marfurt, A., & Henderson, J. (2022) · Workshop on Generation, Evaluation and Metrics (GEM) · doi:10.18653/v1/2022.gem-1.21 · Cited by 5
Zhu, Z., Gong, S., Qi, J., & Tong, C. (2023) · Expert Systems with Applications · doi:10.1016/j.eswa.2023.122364 · Cited by 3
EMO-KNOW: A Large Scale Dataset on Emotion-Cause
Nguyen, M. H., Samaradivakara, Y., Sasikumar, P., Gupta, C., & Nanayakkara, S. C. (2023) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2023.findings-emnlp.737 · Cited by 4
Atri, Y. K., Iyer, A. S., Chakraborty, T., & Goyal, V. (2023) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2023.emnlp-main.133 · Cited by 4
Fact-Preserved Personalized News Headline Generation
Zhao, Y., Lian, J., & Ao, X. (2023) · Proceedings · doi:10.1109/icdm58522.2023.00197 · Cited by 3
Lan, Z., Li, W., Su, J., Xiao, X., Liu, J., Wu, W., & Lyu, Y. (2023) · Journal of Artificial Intelligence Research · doi:10.1613/jair.1.14267 · Cited by 3
Li, S., & Xu, J. (2023) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn54540.2023.10191247 · Cited by 3
QaDialMoE: Question-answering Dialogue based Fact Verification with Mixture of Experts
Wang, L., Zhang, P., Lu, X., Zhang, L., Yan, C., & Zhang, C. (2022) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2022.findings-emnlp.229 · Cited by 4
Looking Beyond Sentence-Level Natural Language Inference for Downstream TasksPreprint
Mishra, A., Patel, D., Vijayakumar, A., Li, X., Kapanipathi, P., & Talamadupula, K. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2009.09099 · Cited by 3
Multi-Perspective Abstractive Answer SummarizationPreprint
Fabbri, A. R., Wu, X., Iyer, S. V., & Diab, M. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2104.08536 · Cited by 9
Uncertainty-Aware Abstractive Summarization.Preprint
Gidiotis, A., & Tsoumakas, G. (2021) · arXiv (Cornell University) · Cited by 3
Ni, J. (2023) · DR-NTU (Nanyang Technological University) · doi:10.32657/10356/168430 · Cited by 3
Xia, S.-J., Zhang, H., Jiang, Y., Chen, X., Chen, Y., Li, Z., Wan, Z., & Sun, A. (2025) · SSRN Electronic Journal · doi:10.2139/ssrn.5731427 · Cited by 3
STRONG – Structure Controllable Legal Opinion Summary Generation
Zhong, Y., & Litman, D. J. (2023) · doi:10.18653/v1/2023.findings-ijcnlp.37 · Cited by 4
Automatic Summarization Evaluation: Methods and Practices
Menéndez, H. D., & Dakhama, A. (2025) · Lecture notes in computer science · doi:10.1007/978-3-031-80889-0_12 · Cited by 2
Optimized dynamic multi-head attention for abstractive text summarization
Mushtaq, S., & Veningston, K. (2025) · International Journal of Data Science and Analytics · doi:10.1007/s41060-025-00863-3 · Cited by 2
Generating Feedback for School Students Essay with Large Language Models
Zhang, D., Hoang, T. N., Zhu, Y., Wang, R., & Crouch, P. (2025) · Lecture notes in computer science · doi:10.1007/978-981-95-3055-7_25 · Cited by 2
Multi-Dimensional Evaluation of Auto-Generated Chain-of-Thought Traces in Reasoning Models
Becerra-Monsalve, L. F., Sanchez-Torres, G., & Bedoya, J. B. B. (2026) · Applied Informatics · doi:10.3390/ai7010035 · Cited by 3
Wang, X., Wang, J., Xu, B., Lin, H., Zhang, B., & Yang, Z. (2022) · JMIR Medical Informatics · doi:10.2196/38052 · Cited by 2
Employing Internal and External Knowledge to Factuality-Oriented Abstractive Summarization
Gao, Z., Jiang, F., Chu, X., & Li, P. (2022) · Lecture notes in computer science · doi:10.1007/978-3-031-17120-8_61 · Cited by 2
Improving Factual Consistency of Dialogue Summarization with Fact-Augmentation Mechanism
Li, W., Zhou, X., Bai, X., & Pan, S. (2022) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn55064.2022.9891885 · Cited by 2
Leveraging and Evaluating Automatic Code Summarization for JPA Program Comprehension
Mayer, R., Moser, M., & Geist, V. (2023) · IEEE International Conference on Software Analysis, Evolution and Reengineering (SANER) · doi:10.1109/saner56733.2023.00088 · Cited by 3
Best-k Search Algorithm for Neural Text Generation
Xu, J., Xiong, C., Savarese, S., & Zhou, Y. (2023) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2023.acl-long.692 · Cited by 4
Self-citationEvaluating Factuality in Cross-lingual Summarization
Gao, M., Wang, W., Wan, X., & Xu, Y. (2023) · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · doi:10.18653/v1/2023.findings-acl.786 · Cited by 2
Gtpsum: guided tensor product framework for abstractive summarization
Lu, J., Zhu, Z., Li, K., Gong, S., Pei, H., & Wang, W.-L. (2023) · The Journal of Supercomputing · doi:10.1007/s11227-023-05630-4 · Cited by 2
Entity-Based Evaluation of Political Bias in Automatic Summarization
Zhou, K., & Tan, C. (2023) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2023.findings-emnlp.696 · Cited by 5
USB: A Unified Summarization Benchmark Across Tasks and Domains
Krishna, K., Gupta, P., Ramprasad, S., Wallace, B., Bigham, J. P., & Lipton, Z. C. (2023) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2023.findings-emnlp.592 · Cited by 3
Learning Human-Human Interactions in Images from Weak Textual Supervision
Alper, M., & Averbuch‐Elor, H. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.00270 · Cited by 3
Leveraging Knowledge-aware Methodologies for Multi-document Summarization
Qu, Y. (2024) · International World Wide Web Conference (WWW) · doi:10.1145/3589335.3651262 · Cited by 4
Shen, J., Liang, C. J., & Xuan, J. (2024) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn60899.2024.10650429 · Cited by 2
AI large models bring great opportunities to reusable design of cad software
Sun, Y., Yan, B., & Shao, Z. (2024) · Computer Science and Information Systems · doi:10.2298/csis230907046s · Cited by 2
Fact-Aware Abstractive Summarization Based on Prompt Information and Re-Ranking
Cai, T., Yang, Y., Wan, Y., Mao, X., & Ju, S. (2024) · International Conference on Machine Learning and Natural Language Processing (MLNLP) · doi:10.1109/mlnlp63328.2024.10800044 · Cited by 2
Zeeshan, R., Bogue, J., Gill, A., & Asghar, M. N. (2025) · JMIR Human Factors · doi:10.2196/64919 · Cited by 2
Mu, G., Chen, C., Li, X., Chen, Y., Dai, J., & Li, J. (2025) · PLoS ONE · doi:10.1371/journal.pone.0322556 · Cited by 2
REVISE: A Framework for Paragraph-Level Misinformation Correction in Large Language Models
Tripathi, S., Jennifer, T., Griffith, H., & Rathore, H. (2025) · IEEE International Conference on Artificial Intelligence Testing (AITest) · doi:10.1109/aitest66680.2025.00027 · Cited by 2
ESTIME: Estimation of Summary-to-Text Inconsistency by Mismatched Embeddings
Vasilyev, O., & Bohannon, J. (2021) · Workshop on Evaluation and Comparison of NLP Systems (Eval4NLP) · doi:10.18653/v1/2021.eval4nlp-1.10 · Cited by 3
Narasimhan, S., Dey, S., & Desarkar, M. S. (2022) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/2022.naacl-main.34 · Cited by 2
SumREN: Summarizing Reported Speech about Events in News
Reddy, R. G., Elfardy, H., Chan, H. P., Small, K., & Ji, H. (2023) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v37i11.26506 · Cited by 3
Evaluating Factual Consistency of Texts with Semantic Role Labeling
Fan, J., Aumiller, D., & Gertz, M. (2023) · Joint Conference on Lexical and Computational Semantics · doi:10.18653/v1/2023.starsem-1.9 · Cited by 4
Text-Blueprint: An Interactive Platform for Plan-based Conditional Generation
Huot, F., Maynez, J., Narayan, S., Amplayo, R. K., Ganchev, K., Louis, A. P., Sandholm, A., Das, D., & Lapata, M. (2023) · Conference of the European Chapter of the Association for Computational Linguistics · doi:10.18653/v1/2023.eacl-demo.13 · Cited by 3
The current state of summarization
Retkowski, F. (2023) · AI critique · doi:10.1515/9783839467664-016 · Cited by 6
Fadhlurrahman, J. A. M., Purwarianti, A., & Aji, A. F. (2023) · International Workshop on Artificial Intelligence and Image Processing (IWAIIP) · doi:10.1109/iwaiip58158.2023.10462854 · Cited by 2
Ravaut, M., Zhao, R., Phung, D., Qin, V. M., Milovanovic, D., Pienkowska, A., Bojić, I., Car, J., & Joty, S. (2024) · JMIR AI · doi:10.2196/55059 · Cited by 3
Adversarial Fine-Grained Fact Graph for Factuality-Oriented Abstractive Summarization
Gao, Z., Jiang, F., Chu, X., & Li, P. (2022) · Lecture notes in computer science · doi:10.1007/978-3-031-17120-8_27 · Cited by 2
Discourse-Aware Unsupervised Summarization of Long Scientific DocumentsPreprint
Dong, Y., Mircea, A., & Cheung, J. C. K. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2005.00513 · Cited by 2
Mitigating Media Bias through Neutral Article GenerationPreprint
Lee, N., Bang, Y., Madotto, A., & Fung, P. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2104.00336 · Cited by 6
Prabha, P. L., & Parvathy, M. (2025) · Journal of the Chinese Institute of Engineers · doi:10.1080/02533839.2025.2466647 · Cited by 2
Scirè, A., Ghonim, K., & Navigli, R. (2024) · arXiv · doi:10.48550/arxiv.2403.02270 · Cited by 2
Zhang, Y., Zhou, D., Wang, Z., & Lai, Y. (2023) · Computer Speech & Language · doi:10.1016/j.csl.2023.101570 · Cited by 1
Guidance in Radiology Report Summarization: An Empirical Evaluation and Error Analysis
Trienes, J., Youssef, P., Schlötterer, J., & Seifert, C. (2023) · International Conference on Natural Language Generation · doi:10.18653/v1/2023.inlg-main.13 · Cited by 3
Liu, J., Du, W., Li, Q., Wang, X., Zhou, Z., & Liu, J. (2024) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp48485.2024.10448276 · Cited by 1
Cross-Domain Document Summarization Model via Two-Stage Curriculum Learning
Lee, S., Kim, G., & Kang, S. (2024) · Electronics · doi:10.3390/electronics13173425 · Cited by 1
Dataset Construction and Verification for Detecting Factual Inconsistency in Japanese Summarization
Iwamoto, K., & Shimada, K. (2024) · IIAI International Congress on Advanced Applied Informatics (IIAI-AAI) · doi:10.1109/iiai-aai63651.2024.00054 · Cited by 1
Less Hallucination and More Factuality: Human Values Alignment in Text Summarization
Qiu, Z., & Xu, Y. (2024) · Communications in computer and information science · doi:10.1007/978-981-97-9671-7_14 · Cited by 1
Factual Accuracy Checking by Validating Numerical Data in Financial Summaries
Bera, A., & Goel, A. (2024) · IEEE International Conference on Big Data (BigData) · doi:10.1109/bigdata62323.2024.10825697 · Cited by 1
Saliency-Based Token Swap - A Language-Agnostic Data Augmentation Method for Text Classification
Ilangeshwaran, H., Abeywardhana, L., & Rathnayake, S. (2024) · International Conference on Information Technology Research (ICITR) · doi:10.1109/icitr64794.2024.10857798 · Cited by 1
FACTMS: Enhancing Multimodal Factual Consistency in Multimodal Summarization
Zhang, M., Yan, H., & Li, C. (2025) · Applied Sciences · doi:10.3390/app15084096 · Cited by 1
Godbole, A., George, J. G., & Shandilya, S. (2025) · Communications in computer and information science · doi:10.1007/978-3-031-87511-3_15 · Cited by 3
Balancing factual consistency and informativeness for abstractive summarization
Li, Z., Ou, L., & Huang, Y. (2025) · International Journal of Machine Learning and Cybernetics · doi:10.1007/s13042-025-02724-8 · Cited by 1
Mind the Link: Discourse Link-Aware Hallucination Detection in Summarization
Lee, D., Jung, H., & Choi, Y. S. (2025) · Applied Sciences · doi:10.3390/app151910506 · Cited by 1
Wang, Y., Yu, J., Zhang-Li, D., Lim, J. J. Y., Tu, S., Li, H., Liu, Z., Liu, H., Hou, L., Li, J., et al. (2025) · ACM International Conference on Information and Knowledge Management (CIKM) · doi:10.1145/3746252.3761578 · Cited by 1
Lie Algebra–Based Semantic Flow for Incompleteness Detection in Summarization
Ravikiran, M., Elluru, V., Iyer, K., Pendse, P., & Mohanty, S. (2025) · Communications in computer and information science · doi:10.1007/978-981-95-4575-9_5 · Cited by 1
Quantum-Inspired Cross-Attention Alignment for Turkish Scientific Abstractive Summarization
ALTAY, G., & Küçüksille, E. U. (2025) · Electronics · doi:10.3390/electronics14224474 · Cited by 1
PMDS: progressive multi-document summarization with iterative summary integration
Yu, S., Yang, C., Qin, Y., Huang, R., Chen, Y., Lin, C., & Gao, W. (2026) · Information Processing & Management · doi:10.1016/j.ipm.2025.104501 · Cited by 1
Mahapatra, J., & Garain, U. (2026) · ACM Transactions on Intelligent Systems and Technology · doi:10.1145/3795137 · Cited by 1
Liu, Z., Huang, P., Xu, Z., Li, X., Liu, S., Peng, C., Xin, H., Yan, Y., Wang, S., Han, X., et al. (2026) · AI Open · doi:10.1016/j.aiopen.2026.02.002 · Cited by 1
Analysis of the evaluation metrics for the factual consistency of generative AI
Nair, S., & Rao, Y. S. (2025) · IEEE International Conference for Women in Computing (InCoWoCo) · doi:10.1109/incowoco68239.2025.11407248 · Cited by 1
Dominić, I., S, M. K. H., Nandakumar, R. G., & Regunathan, R. (2025) · International Conference on Signal Processing, Computation, Electronics, Power and Telecommunication (IConSCEPT) · doi:10.1109/iconscept66142.2025.11436852 · Cited by 1
Almutairi, N. (2026) · Electronics · doi:10.3390/electronics15061305 · Cited by 1
An Intelligent Micromachine Perception System for Elevator Fault Diagnosis
Lai, L., Ding, S., Li, Z., Luo, Z., & Wang, H. (2026) · Micromachines · doi:10.3390/mi17040401 · Cited by 2
ChartCap: Mitigating Hallucination of Dense Chart Captioning
Lim, J., Ahn, J., & Kim, G. (2025) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51701.2025.01224 · Cited by 5
Zhang, H., Vithanage, D., Deng, C., & Yu, P. (2026) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2026.105053 · Cited by 2
Detecting Hallucinations in Arabic Large Language Models Using Automatic Fact-Verification Signals
Alhawarat, M. O. (2026) · International Conference on Emerging Technologies and Engineering Systems (ICETES) · doi:10.1109/icetes68504.2026.11518602 · Cited by 1
Liu, J., Pan, D., Kang, Y., Luo, L., Sun, Y., & Lin, H. (2026) · Communications in computer and information science · doi:10.1007/978-981-95-7299-1_6 · Cited by 1
Improving Kazakh Abstractive Summarization with LLMs via Domain Adaptation and Self-Correction
Zhabayev, T., Tukeyev, U., Amirova, D., & Rakhmanberdi, N. (2026) · Information · doi:10.3390/info17070639 · Cited by 1
Mala, C. S., Gezi̇ci, G., & Giannotti, F. (2026) · Machine Learning · doi:10.1007/s10994-026-07121-y · Cited by 1
ASM: Augmentation-based Semantic Mechanism on Abstractive Summarization
Ren, W., Zhou, H., Liu, G., & Huan, F. (2021) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn52387.2021.9534156 · Cited by 1
Analysis and Research of Abstractive Automatic Summarization Based on Sequential Facts
Liu, Y., Li, Y., & Li, L. (2021) · IEEE International Conference on Network Infrastructure and Digital Content (IC-NIDC) · doi:10.1109/ic-nidc54101.2021.9660463 · Cited by 1
Annotating and Detecting Fine-grained Factual Errors for Dialogue Summarization
Zhu, R., Qi, J., & Lau, J. H. (2023) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2023.acl-long.377 · Cited by 7
Multi-View Source Ablation for Faithful Summarization
Cao, S., Ma, L., Lu, D., Logan, R. L., Tetreault, J., & Jaimes, A. (2023) · Findings of the Association for Computational Linguistics: EACL · doi:10.18653/v1/2023.findings-eacl.151 · Cited by 1
Guo, B., Feng, C., Liu, F., Li, X., & Wang, X. (2023) · Communications in computer and information science · doi:10.1007/978-981-99-7894-6_11 · Cited by 1
Sudmann, A., Echterhölter, A., Ramsauer, M., Retkowski, F., Schröter, J., & Waibel, A. (2023) · AI critique · doi:10.1515/9783839467664 · Cited by 5
Hallucination Detection for Grounded Instruction Generation
Zhao, L., Nguyen, K., & Daumé, H. (2023) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2023.findings-emnlp.266 · Cited by 2
Metadata
- Authors
- Kryscinski, W., McCann, B., Xiong, C., & Socher, R.
- Affiliations
- Salesforce (United States) (US)
- Venue
- Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP)
- Published
- 2020
- Pages
- 9332-9346
- OpenAlex
- W2981456979
- Cited by
- 669
- References
- 41
- Citations by year
- 2026: 94 · 2025: 86 · 2024: 56 · 2023: 171 · 2022: 106 · 2021: 118 · 2020: 37
- FWCI
- 41.26
- Type
- conference paper
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- cc-by
- Locations
- Conference on Empirical Methods in Natural Language Processing (EMNLP) (publishedVersion, cc-by)
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
- Physical Sciences › Computer Science › Artificial Intelligence › Advanced Text Analysis Techniques
- Physical Sciences › Computer Science › Artificial Intelligence › Natural Language Processing Techniques
- Keywords
- abstractive summarization, factual consistency, weakly supervised learning, rule-based transformation, span extraction, natural language inference, fact-checking, summarization evaluation metrics
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
