Improving Factual Consistency of Abstractive Summarization via Question Answering
Open accessAbstract
Feng Nan, Cicero Nogueira dos Santos, Henghui Zhu, Patrick Ng, Kathleen McKeown, Ramesh Nallapati, Dejiao Zhang, Zhiguo Wang, Andrew O. Arnold, Bing Xiang. Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 1: Long Papers). 2021.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Nan et al. propose an entity-based metric relying on the Named-Entity Recognition model, which is relatively more robust.
“Therefore, Nan et al. [190] propose an entity-based metric relying on the Named-Entity Recognition model, which is relatively more robust.”
From Survey of Hallucination in Natural Language Generation (2023) · cites this paper as Nan et al. [190]
Section 5 (Related work; page not available) says Nan et al. proposed entity-level factual-consistency metrics. It does not say those metrics rely on a Named-Entity Recognition model or are relatively more robust, so those parts of the claim are unsupported by our copy. (LLM, conf=0.82)
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
(2004) · Cited by 9,718 · see citing works
Lewis, M., Liu, Y., Goyal, N., Ghazvininejad, M., Mohamed, A., Levy, O., Stoyanov, V., & Zettlemoyer, L. (2020) · Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/2020.acl-main.703 · Cited by 8,821 · see citing works
Measuring nominal scale agreement among many raters.
Fleiss, J. L. (1971) · Psychological Bulletin · doi:10.1037/h0031619 · Cited by 8,733 · see citing works
Simple Statistical Gradient-Following Algorithms for Connectionist Reinforcement Learning
Williams, R. J. (1992) · Machine Learning · doi:10.1007/bf00992696 · Cited by 7,936 · see citing works
SQuAD: 100,000+ Questions for Machine Comprehension of Text
Rajpurkar, P., Zhang, J., Lopyrev, K., & Liang, P. (2016) · Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d16-1264 · Cited by 6,208 · see citing works
ALBERT: A Lite BERT for Self-supervised Learning of Language Representations
Lan, Z., Chen, M., Goodman, S., Gimpel, K., Sharma, P., & Soricut, R. (2019) · arXiv · doi:10.48550/arxiv.1909.11942 · Cited by 4,308 · see citing works
fairseq: A Fast, Extensible Toolkit for Sequence Modeling
Ott, M., Edunov, S., Baevski, A., Fan, A., Gross, S., Ng, N., Grangier, D., & Auli, M. (2019) · North American Chapter of the Association for Computational Linguistics · doi:10.18653/v1/n19-4009 · Cited by 3,538 · see citing works
A Neural Attention Model for Abstractive Sentence Summarization
Rush, A. M., Chopra, S., & Weston, J. (2015) · Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d15-1044 · Cited by 2,879 · see citing works
Abstractive Text Summarization using Sequence-to-sequence RNNs and Beyond
Nallapati, R., Zhou, B., dos Santos, C., Gulcehre, C., & Xiang, B. (2016) · Proceedings of The 20th SIGNLL Conference on Computational Natural Language Learning · doi:10.18653/v1/k16-1028 · Cited by 2,361 · see citing works
Self-citationKnow What You Don’t Know: Unanswerable Questions for SQuAD
Rajpurkar, P., Jia, R., & Liang, P. (2018) · Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers) · doi:10.18653/v1/p18-2124 · Cited by 2,240 · see citing works
Unified Language Model Pre-training for Natural Language Understanding and Generation
Dong, L., Yang, N., Wang, W., Wei, F., Liu, X., Wang, Y., Gao, J., Zhou, M., & Hon, H.-W. (2019) · arXiv · doi:10.48550/arxiv.1905.03197 · Cited by 1,225 · see citing works
Narayan, S., Cohen, S. B., & Lapata, M. (2018) · Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d18-1206 · Cited by 1,207 · see citing works
NewsQA: A Machine Comprehension Dataset
Trischler, A., Wang, T., Yuan, X., Harris, J., Sordoni, A., Bachman, P., & Suleman, K. (2017) · Proceedings of the 2nd Workshop on Representation Learning for NLP · doi:10.18653/v1/w17-2623 · Cited by 706 · cited 2× · see citing works
“Our QAGen model in Q UALS is also a BART-large model fine-tuned on the SQ UAD (Rajpurkar et al., 2016) and NewsQA (Trischler et al., 2017) datasets.”
MethodEvaluating the Factual Consistency of Abstractive Text Summarization
Kryscinski, W., McCann, B., Xiong, C., & Socher, R. (2020) · Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2020.emnlp-main.750 · Cited by 669 · see citing works
Faithful to the Original: Fact Aware Neural Abstractive Summarization
Cao, Z., Wei, F., Li, W., & Li, S. (2018) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v32i1.11912 · Cited by 359 · see citing works
(2020) · doi:10.18653/v1/2020.acl-main.450 · Cited by 356 · see citing works
Diverse Beam Search: Decoding Diverse Solutions from Neural Sequence ModelsPreprint
Vijayakumar, A. K., Cogswell, M., Selvaraju, R. R., Sun, Q., Lee, S., Crandall, D., & Batra, D. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1610.02424 · Cited by 350 · see citing works
Neural Text Summarization: A Critical Evaluation
Kryscinski, W., Keskar, N. S., McCann, B., Xiong, C., & Socher, R. (2019) · Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP) · doi:10.18653/v1/d19-1051 · Cited by 335 · see citing works
Durmus, E., He, H., & Diab, M. (2020) · Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/2020.acl-main.454 · Cited by 306 · see citing works
Neural Text Generation with Unlikelihood Training
Welleck, S., Kulikov, I., Roller, S., Dinan, E., Cho, K., & Weston, J. (2019) · arXiv · doi:10.48550/arxiv.1908.04319 · Cited by 254 · see citing works
Don’t Say That! Making Inconsistent Dialogue Unlikely with Unlikelihood Training
Li, M., Roller, S., Kulikov, I., Welleck, S., Boureau, Y.-L., Cho, K., & Weston, J. (2020) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2020.acl-main.428 · Cited by 128 · see citing works
Entity-level Factual Consistency of Abstractive Text Summarization
Nan, F., Nallapati, R. M., Wang, Z., dos Santos, C. N., Zhu, H., Zhang, D., McKeown, K. R., & Xiang, B. (2021) · Conference of the European Chapter of the Association for Computational Linguistics · doi:10.18653/v1/2021.eacl-main.235 · Cited by 127 · see citing works
Self-citationNeural Text Generation With Unlikelihood Training
Welleck, S., Kulikov, I., Roller, S., Dinan, E., Cho, K., & Weston, J. (2020) · International Conference on Learning Representations · Cited by 106 · see citing works
Improving Faithfulness in Abstractive Summarization with Contrast Candidate Generation and Selection
Chen, S., Zhang, F., Sone, K., & Roth, D. (2021) · Proceedings of the 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies · doi:10.18653/v1/2021.naacl-main.475 · Cited by 83 · see citing works
End-to-End Synthetic Data Generation for Domain Adaptation of Question Answering Systems
Shakeri, S., dos Santos, C. N., Zhu, H., Ng, P., Nan, F., Wang, Z., Nallapati, R. M., & Xiang, B. (2020) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2020.emnlp-main.439 · Cited by 74 · see citing works
Self-citationBoosting Factual Correctness of Abstractive Summarization with Knowledge Graph.Preprint
Zhu, C., Hinthorn, W., Xu, R., Zeng, Q., Zeng, M., Huang, X., & Jiang, M. (2020) · arXiv (Cornell University) · Cited by 34 · see citing works
Kedzie, C., & McKeown, K. R. (2019) · International Conference on Natural Language Generation · doi:10.18653/v1/w19-8672 · Cited by 27 · see citing works
Self-citationGenerating Abstractive Summaries with Finetuned Language Models
Gehrmann, S., Ziegler, Z. M., & Rush, A. M. (2019) · International Conference on Natural Language Generation · doi:10.18653/v1/w19-8665 · Cited by 25 · see citing works
End-to-End Synthetic Data Generation for Domain Adaptation of Question Answering SystemsPreprint
Shakeri, S., dos Santos, C. N., Zhu, H., Ng, P., Nan, F., Wang, Z., Nallapati, R. M., & Xiang, B. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2010.06028 · Cited by 20 · see citing works
Self-citation
Flagged first, then by citations
Cited by
Sorted by citations
<scp>SummaC</scp>: Re-Visiting NLI-based Models for Inconsistency Detection in Summarization
Laban, P., Schnabel, T., Bennett, P. N., & Hearst, M. A. (2022) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00453 · Cited by 238 · see citing works
Pre-Trained Language Models for Text Generation: A Survey
Li, J., Tang, T., Zhao, W. X., Nie, J., & Wen, J.-R. (2024) · ACM Computing Surveys · doi:10.1145/3649449 · Cited by 304 · see citing works
An Empirical Survey on Long Document Summarization: Datasets, Models, and Metrics
Koh, H. Y., Ju, J., Liu, M., & Pan, S. (2022) · ACM Computing Surveys · doi:10.1145/3545176 · Cited by 124 · see citing works
Honovich, O., Choshen, L., Aharoni, R., Neeman, E., Szpektor, I., & Abend, O. (2021) · Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/2021.emnlp-main.619 · Cited by 113 · see citing works
Measuring Attribution in Natural Language Generation Models
Rashkin, H., Nikolaev, V., Lamm, M., Aroyo, L., Collins, M., Das, D., Petrov, S., Tomar, G. S., Turc, I., & Reitter, D. (2023) · Computational Linguistics · doi:10.1162/coli_a_00486 · Cited by 71 · see citing works
Understanding Factual Errors in Summarization: Errors, Summarizers, Datasets, Error Detectors
Tang, L., Goyal, T., Fabbri, A. R., Laban, P., Xu, J., Yavuz, S., Kryściński, W., Rousseau, J. F., & Durrett, G. (2023) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2023.acl-long.650 · Cited by 62 · see citing works
Evaluating Attribution in Dialogue Systems: The BEGIN Benchmark
Dziri, N., Rashkin, H., Linzen, T., & Reitter, D. (2022) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00506 · Cited by 67 · see citing works
Language Generation Models Can Cause Harm: So What Can We Do About It? An Actionable Survey
Kumar, S., Balachandran, V., Njoo, L., Anastasopoulos, A., & Tsvetkov, Y. (2023) · Proceedings of the 17th Conference of the European Chapter of the Association for Computational Linguistics · doi:10.18653/v1/2023.eacl-main.241 · Cited by 38 · see citing works
FactGraph: Evaluating Factuality in Summarization with Semantic Graph Representations
Ribeiro, L., Liu, M., Gurevych, I., Dreyer, M., & Bansal, M. (2022) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/2022.naacl-main.236 · Cited by 39 · see citing works
RHO: Reducing Hallucination in Open-domain Dialogues with Knowledge Grounding
Ji, Z., Liu, Z., Lee, N., Yu, T., Wilie, B., Zeng, M., & Fung, P. (2023) · Findings of the Association for Computational Linguistics: ACL 2023 · doi:10.18653/v1/2023.findings-acl.275 · Cited by 37 · see citing works
Abstractive Summarization of Indian Legal Judgments
Prabhakar, P., Gupta, D., & Pati, P. B. (2022) · OITS International Conference on Information Technology (OCIT) · doi:10.1109/ocit56763.2022.00056 · Cited by 30 · see citing works
Learning to Revise References for Faithful Summarization
Adams, G., Shing, H.-C., Sun, Q., Winestock, C., McKeown, K. R., & Elhadad, N. (2022) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2022.findings-emnlp.296 · Cited by 30 · see citing works
Self-citationFactually Consistent Summarization via Reinforcement Learning with Textual Entailment Feedback
Roit, P., Ferret, J., Shani, L., Aharoni, R., Cideron, G., Dadashi, R., Geist, M., Girgin, S., Hussenot, L., Keller, O., et al. (2023) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2023.acl-long.344 · Cited by 39 · see citing works
An Investigation of Evaluation Methods in Automatic Medical Note Generation
Abacha, A. B., Yim, W., Michalopoulos, G., & Lin, T. (2023) · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · doi:10.18653/v1/2023.findings-acl.161 · Cited by 42 · see citing works
Re-Examining System-Level Correlations of Automatic Summarization Evaluation Metrics
Deutsch, D., Dror, R., & Roth, D. (2022) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/2022.naacl-main.442 · Cited by 25 · see citing works
CitationSum: Citation-aware Graph Contrastive Learning for Scientific Paper Summarization
Luo, Z., Xie, Q., & Ananiadou, S. (2023) · International World Wide Web Conference (WWW) · doi:10.1145/3543507.3583505 · Cited by 17 · see citing works
Zero-shot Faithful Factual Error Correction
Huang, K.-H., Chan, H. P., & Ji, H. (2023) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2023.acl-long.311 · Cited by 18 · see citing works
How Far are We from Robust Long Abstractive Summarization?
Koh, H. Y., Ju, J., Zhang, H., Liu, M., & Pan, S. (2022) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2022.emnlp-main.172 · Cited by 18 · see citing works
Measuring Attribution in Natural Language Generation Models
Rashkin, H., Nikolaev, V. A., Lamm, M., Aroyo, L. M., Collins, M., Das, D., Petrov, S., Tomar, G. S., Turc, I., & Reitter, D. (2023) · Computational Linguistics · doi:10.1162/coli_a_00490 · Cited by 16 · see citing works
Manakul, P., Liusie, A., & Gales, M. (2023) · Proceedings of the 13th International Joint Conference on Natural Language Processing and the 3rd Conference of the Asia-Pacific Chapter of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/2023.ijcnlp-main.4 · Cited by 14 · see citing works
X-FACTOR: A Cross-metric Evaluation of Factual Correctness in Abstractive Summarization
Chaudhury, S., Swaminathan, S., Gunasekara, C., Crouse, M., Ravishankar, S., Kimura, D., Murugesan, K., Astudillo, R. F., Naseem, T., Kapanipathi, P., et al. (2022) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2022.emnlp-main.478 · Cited by 14 · see citing works
FactKB: Generalizable Factuality Evaluation using Language Models Enhanced with Factual Knowledge
Feng, S., Balachandran, V., Bai, Y., & Tsvetkov, Y. (2023) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2023.emnlp-main.59 · Cited by 21 · see citing works
Single-Document Abstractive Text Summarization: A Systematic Literature Review
Rao, A. B., Aithal, S. G., & Singh, S. (2024) · ACM Computing Surveys · doi:10.1145/3700639 · Cited by 16 · see citing works
Active Learning for Abstractive Text Summarization
Tsvigun, A., Lysenko, I., Sedashov, D., Lazichny, I., Damirov, E., Va, K., Belousov, A., Sanochkin, L., Panov, M., Panchenko, A., et al. (2022) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2022.findings-emnlp.377 · Cited by 14 · see citing works
Improving Factuality of Abstractive Summarization without Sacrificing Summary Quality
Dixit, T., Wang, F., & Chen, M. (2023) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2023.acl-short.78 · Cited by 12 · see citing works
Explainable Fact-Checking Through Question Answering
Yang, J., Vega‐Oliveros, D. A., Seibt, T., & Rocha, A. D. R. (2022) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp43922.2022.9747214 · Cited by 10 · see citing works
Token-Level Fact Correction in Abstractive Summarization
Shin, J., Park, S.-B., & Song, H.-J. (2023) · IEEE Access · doi:10.1109/access.2022.3233854 · Cited by 10 · see citing works
Generating EDU Extracts for Plan-Guided Summary Re-Ranking
Adams, G., Fabbri, A. R., Ladhak, F., Elhadad, N., & McKeown, K. R. (2023) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2023.acl-long.151 · Cited by 9 · see citing works
Self-citationFRSUM: Towards Faithful Abstractive Summarization via Enhancing Factual Robustness
Wu, W., Li, W., Liu, J., Xiao, X., Cao, Z., Li, S., & Wu, H. (2022) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2022.findings-emnlp.267 · Cited by 9 · see citing works
Reliability Check: An Analysis of GPT-3’s Response to Sensitive Topics and Prompt Wording
Khatun, A., & Brown, D. G. (2023) · Workshop on Trustworthy Natural Language Processing (TrustNLP) · doi:10.18653/v1/2023.trustnlp-1.8 · Cited by 12 · see citing works
Han, C., Feng, J., & Qi, H. (2023) · Expert Systems with Applications · doi:10.1016/j.eswa.2023.121873 · Cited by 8 · see citing works
Do Multi-Document Summarization Models Synthesize?
DeYoung, J., Martinez, S. C., Marshall, I. J., & Wallace, B. (2024) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00687 · Cited by 10 · see citing works
Adams, G., Nguyen, B. H., Smith, J. A., Xia, Y., Xie, S., Ostropolets, A., Deb, B., Chen, Y.-J., Naumann, T., & Elhadad, N. (2023) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2023.acl-long.587 · Cited by 9 · see citing works
Scientific document processing: challenges for modern learning methods
Kashyap, A. R., Yang, Y., & Kan, M. (2023) · International Journal on Digital Libraries · doi:10.1007/s00799-023-00352-7 · Cited by 9 · see citing works
SWING: Balancing Coverage and Faithfulness for Dialogue Summarization
Huang, K.-H., Singh, S., Ma, X., Xiao, W., Nan, F., Dingwall, N., Wang, W. Y., & McKeown, K. R. (2023) · Findings of the Association for Computational Linguistics: EACL · doi:10.18653/v1/2023.findings-eacl.37 · Cited by 10 · see citing works
Self-citationXue, B., Wang, W., Wang, H., Mi, F., Wang, R., Wang, Y., Shang, L., Jiang, X., Liu, Q., & Wong, K. (2023) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2023.findings-emnlp.525 · Cited by 11 · see citing works
Trusting Your Evidence: Hallucinate Less with Context-aware Decoding
Shi, W., Han, X., Lewis, M., Tsvetkov, Y., Zettlemoyer, L., & Yih, S. W.-T. (2023) · arXiv · doi:10.48550/arxiv.2305.14739 · Cited by 6 · see citing works
“…triples extracted from source documents (Cao et al., 2018; Zhu et al., 2021), optimizing summarization models towards a factual consistency metrics (Nan et al., 2021; Cao and Wang, 2021), learning a post-editing error corrector (Dong et al., 2020) and removing noisy training samples (Kang and…”
BackgroundMethodÇelikten, T., & Onan, A. (2025) · IEEE Access · doi:10.1109/access.2025.3604351 · Cited by 6 · see citing works
High-Reliability LLM Summarization through Causal Cue Modeling and Factual Correction
Hu, J., Lyu, Y., & Jiang, J. (2026) · International Conference on Electronic Information Technology and Computer Engineering (EITCE) · doi:10.1109/eitce70137.2026.11634334 · Cited by 6 · see citing works
Factuality Guided Diffusion-Based Abstractive Summarization
Shin, J., Park, H., & Song, H.-J. (2024) · IEEE Access · doi:10.1109/access.2024.3467063 · Cited by 5 · see citing works
Wang, X., & Zhao, T. (2022) · Findings of the Association for Computational Linguistics: NAACL · doi:10.18653/v1/2022.findings-naacl.180 · Cited by 5 · see citing works
Mitigating Intrinsic Named Entity-Related Hallucinations of Abstractive Text Summarization
Shen, J., Xuan, J., & Liang, C. (2023) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2023.findings-emnlp.1059 · Cited by 5 · see citing works
Li, Y., Li, L., Hu, D., Li, Y., Zhou, Y., Litvak, M., & Vanetik, N. (2023) · Research Square · doi:10.21203/rs.3.rs-3695932/v1 · Cited by 7 · see citing works
A Survey of Factual Consistency in Summarization from 2021 to 2023
Li, Y., Hao, X., & Li, L. (2023) · International Conference on Computers and Artificial Intelligence Technology (CAIT) · doi:10.1109/cait59945.2023.10468958 · Cited by 4 · see citing works
Improving named entity correctness of abstractive summarization by generative negative sampling
Chen, Z., & Lin, H. (2023) · Computer Speech & Language · doi:10.1016/j.csl.2023.101504 · Cited by 4 · see citing works
Probing Factually Grounded Content Transfer with Factual Ablation
West, P., Quirk, C., Galley, M., & Choi, Y. (2022) · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · doi:10.18653/v1/2022.findings-acl.294 · Cited by 4 · see citing works
Zhu, Y., Li, Y., Li, L., Hu, D., Hao, X., Chen, D., Zhang, X., Zhang, Z., Zhou, Y., Litvak, M., et al. (2025) · IEEE Transactions on Audio Speech and Language Processing · doi:10.1109/taslpro.2025.3567744 · Cited by 4 · see citing works
Fact-Preserved Personalized News Headline Generation
Zhao, Y., Lian, J., & Ao, X. (2023) · Proceedings · doi:10.1109/icdm58522.2023.00197 · Cited by 3 · see citing works
Shen, J., Liang, C. J., & Xuan, J. (2024) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn60899.2024.10650429 · Cited by 2 · see citing works
Adversarial Fine-Grained Fact Graph for Factuality-Oriented Abstractive Summarization
Gao, Z., Jiang, F., Chu, X., & Li, P. (2022) · Lecture notes in computer science · doi:10.1007/978-3-031-17120-8_27 · Cited by 2 · see citing works
LexiSem: A re-ranker balancing lexical and semantic quality for enhanced abstractive summarization
Aloraini, E., Kassab, H., Hamdi, A., & Shaban, K. B. (2025) · Neurocomputing · doi:10.1016/j.neucom.2025.130816 · Cited by 1 · see citing works
Balancing factual consistency and informativeness for abstractive summarization
Li, Z., Ou, L., & Huang, Y. (2025) · International Journal of Machine Learning and Cybernetics · doi:10.1007/s13042-025-02724-8 · Cited by 1 · see citing works
PMDS: progressive multi-document summarization with iterative summary integration
Yu, S., Yang, C., Qin, Y., Huang, R., Chen, Y., Lin, C., & Gao, W. (2026) · Information Processing & Management · doi:10.1016/j.ipm.2025.104501 · Cited by 1 · see citing works
Sheng, Z., Finzel, R., Lucke, M., Dufresne, S. R., Gini, M. L., & Pakhomov, S. (2023) · DialDoc Workshop on Document-grounded Dialogue and Conversational Question Answering (DialDoc) · doi:10.18653/v1/2023.dialdoc-1.8 · Cited by 1 · see citing works
Contrastive Error Attribution for Finetuned Language Models
Ladhak, F., Durmus, E., & Hashimoto, T. (2023) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2023.acl-long.643 · Cited by 3 · see citing works
Mitigating Societal Harms in Large Language Models
Kumar, S., Balachandran, V., Njoo, L., Anastasopoulos, A., & Tsvetkov, Y. (2023) · doi:10.18653/v1/2023.emnlp-tutorial.5 · Cited by 1 · see citing works
Factual Relation Discrimination for Factuality-oriented Abstractive Summarization
Gao, Z., Li, P., Jiang, F., Chu, X., & Zhu, Q. (2023) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2023.findings-emnlp.69 · Cited by 1 · see citing works
Improving the Consistency of Semantic Parsing in KBQA Through Knowledge Distillation
Zou, J., Cao, S., Wan, J., Hou, L., & Xu, J. (2024) · Lecture notes in computer science · doi:10.1007/978-981-97-2387-4_25 · Cited by 1 · see citing works
Dutta, T., & Liu, X. (2024) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn60899.2024.10650810 · Cited by 1 · see citing works
Consecutive Question Generation via Dynamic Multitask Learning
Li, Y., Li, S., & Shi, X. (2022) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2022.findings-emnlp.493 · Cited by 1 · see citing works
Toward Fact-aware Abstractive Summarization Method Using Joint LearningPreprint
Mao, X., Chen, L., Ju, S., Wan, X., & Liu, Y. (2022) · Research Square · doi:10.21203/rs.3.rs-2206382/v1
Factual Error Correction in Summarization with Retriever-Reader Pipeline
Li, W., Liu, J., & Gao, H. (2023) · Lecture notes in computer science · doi:10.1007/978-3-031-30105-6_33
Multi-doc Hybrid Summarization via Salient Representation Learning
Xiao, M. (2023) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2023.acl-industry.37
Leveraging In-and-Cross Project Pseudo-Summaries for Project-Specific Code Summarization
Wu, Y., Hu, T., Liao, N., Xie, R., Zhang, M., Du, D., & Lin, S. (2024) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn60899.2024.10650905
KQFV: a knowledge-enhanced method using question answering for fact verification
Bian, Y., & Ma, T. (2025) · Journal of Intelligent Information Systems · doi:10.1007/s10844-025-00956-2
Chen, D., Hu, D., & Li, L. (2025) · Communications in computer and information science · doi:10.1007/978-981-96-9994-0_33
Hallucinations in Abstractive Text Summarization with Large Language Models
Delpisheh, N., & Chali, Y. (2025) · International Generative AI and Computational Language Modelling Conference (GACLM) · doi:10.1109/gaclm67198.2025.11231924 · Cited by 1 · see citing works
Knowledge Extraction, Fusion and Summary Rewriting: A Three-Stage Modular Abstractive Summarization
Wu, S. J., & Liu, J. (2025) · IEEE International Conference on Sensors, Electronics and Computer Engineering (ICSECE) · doi:10.1109/icsece65727.2025.11256782
Localizing Factual Inconsistencies in Attributable Text Generation
Cattan, A., Roit, P., Zhang, S., Wan, D., Aharoni, R., Szpektor, I., Bansal, M., & Dagan, I. (2026) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl.a.598 · Cited by 3 · see citing works
Sebire, I. G., Barale, C., & Lapata, M. (2025) · International Conference on Artificial Intelligence and Law · doi:10.1145/3769126.3769237
Pratama, I. P. A. E., Widyantara, I. M. O., Linawati, L., & Gunantara, N. (2026) · International Journal of Advances in Data and Information Systems · doi:10.59395/ijadis.v7i1.1488
Integrating Unsupervised Learning for the Factual Consistency of Generative Models
Nair, S., & -, Y. S. R. (2026) · Future Internet · doi:10.3390/fi18050235
NEWSLYTIC: An AI-Powered News Analysis Engine
Thiyagu, T. M., Mohana Priya, M., & Lakshmi, M. (2026) · IEEE International Conference on Emerging Computing and Intelligent Technologies (ICoECIT) · doi:10.1109/icoecit68303.2026.11496850
Temporal and linguistic enrichment for abstractive text summarization using transformer models
Abdalgader, K., Ahmed, F. Y. H., Wassie, B., Kerala, K., Heramo, N., & Gudeta, R. (2026) · Discover Artificial Intelligence · doi:10.1007/s44163-026-01710-5
AI-Powered Like-Minded Team Builder
Lakshmi, R. T. T., Yashwanth, P., & Vignesh, N. (2026) · IEEE Global Symposium on Emerging and Communication Technologies (GSEACT) · doi:10.1109/gseact68539.2026.11619987
Zhu, Y., Zhang, X., Gao, J., Li, L., & Wang, X. (2026) · Journal of King Saud University - Computer and Information Sciences · doi:10.1007/s44443-026-01349-3
- Authors
- Nan, F., Nogueira dos Santos, C., Zhu, H., Ng, P., McKeown, K., Nallapati, R., Zhang, D., Wang, Z., Arnold, A. O., & Xiang, B.
- Affiliations
- Columbia University (US)
- Venue
- Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 1: Long Papers)
- Published
- 2021
- Pages
- 6881-6894
- OpenAlex
- W3177242492
- Cited by
- 78
- References
- 29
- Citations by year
- 2026: 9 · 2025: 10 · 2024: 8 · 2023: 33 · 2022: 17 · 2021: 1
- FWCI
- 6.82
- Type
- conference paper
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
- Physical Sciences › Computer Science › Artificial Intelligence › Natural Language Processing Techniques
- Physical Sciences › Computer Science › Artificial Intelligence › Advanced Text Analysis Techniques
- Keywords
- abstractive summarization, factual consistency, question answering, factual accuracy, summarization evaluation
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review