The DOI matches its Crossref record; 16 of the 16 references it cites were found in a registry or an index.
LexRank: Graph-based Lexical Centrality as Salience in Text Summarization
Open accessAbstract
We introduce a stochastic graph-based method for computing relative importance of textual units for Natural Language Processing. We test the technique on the problem of Text Summarization (TS). Extractive TS relies on the concept of sentence salience to identify the most important sentences in a document or set of documents. Salience is typically defined in terms of the presence of particular important words or in terms of similarity to a centroid pseudo-sentence. We consider a new approach, LexRank, for computing sentence importance based on the concept of eigenvector centrality in a graph representation of sentences. In this model, a connectivity matrix based on intra-sentence cosine similarity is used as the adjacency matrix of the graph representation of sentences. Our system, based on LexRank ranked in first place in more than one task in the recent DUC 2004 evaluation. In this paper we present a detailed analysis of our approach and apply it to a larger data set including data from earlier DUC evaluations. We discuss several methods to compute centrality using the similarity graph. The results show that degree-based methods (including LexRank) outperform both centroid-based methods and other systems participating in DUC in most of the cases. Furthermore, the LexRank with threshold method outperforms the other degree-based techniques including continuous LexRank. We also show that our approach is quite insensitive to the noise in the data that may result from an imperfect topical clustering of documents.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The anatomy of a large-scale hypertextual Web search engine
Brin, S., & Page, L. (1998) · Computer Networks and ISDN Systems · doi:10.1016/s0169-7552(98)00110-x · Cited by 16,004
A STATISTICAL INTERPRETATION OF TERM SPECIFICITY AND ITS APPLICATION IN RETRIEVAL
SPARCK JONES, K. (1972) · Journal of Documentation · doi:10.1108/eb026526 · Cited by 4,505
Unsupervised word sense disambiguation rivaling supervised methods
Yarowsky, D. (1995) · Proceedings of the 33rd annual meeting on Association for Computational Linguistics - · doi:10.3115/981658.981684 · Cited by 2,385
The Use of MMR, Diversity-Based Reranking for Reordering Documents and Producing Summaries
Carbonell, J., & Goldstein, J. (2017) · ACM SIGIR Forum · doi:10.1145/3130348.3130369 · Cited by 2,156
Three generative, lexicalised models for statistical parsing
Collins, M. (1997) · Proceedings of the 35th annual meeting on Association for Computational Linguistics - · doi:10.3115/976909.979620 · Cited by 743
TextRank: Bringing Order into Texts
Mihalcea, R., & Tarau, P. (2004) · University of North Texas Digital Library (University of North Texas) · Cited by 632
Statistics-Based Summarization - Step One: Sentence Compression
Knight, K. K., & Marcu, D. (2000) · Cited by 392
Generating Natural Language Summaries from Multiple On-Line Sources
Radev, D. (1997) · doi:10.7916/d83n2b7j · Cited by 374
Self-citationAutomatic condensation of electronic publications by sentence selection
Brandow, R., Mitze, K., & Rau, L. F. (1995) · Information Processing & Management · doi:10.1016/0306-4573(95)00052-i · Cited by 363
PageRank on semantic networks, with application to word sense disambiguation
Mihalcea, R., Tarau, P., & Figa, E. (2004) · Proceedings of the 20th international conference on Computational Linguistics - COLING '04 · doi:10.3115/1220355.1220517 · Cited by 214
Cited by
The structure and dynamics of cocitation clusters: A multiple‐perspective cocitation analysis
Chen, C., Ibekwe‐SanJuan, F., & Hou, J. (2010) · Journal of the American Society for Information Science and Technology · doi:10.1002/asi.21309 · Cited by 1,585
Nallapati, R., Zhai, F., & Zhou, B. (2017) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v31i1.10958 · Cited by 1,233
Jumping NLP Curves: A Review of Natural Language Processing Research [Review Article]
Cambria, E., & White, B. (2014) · IEEE Computational Intelligence Magazine · doi:10.1109/mci.2014.2307227 · Cited by 1,102
Sentence similarity based on semantic nets and corpus statistics
Li, Y., McLean, D., Bandar, Z. A., O'Shea, J. D., & Crockett, K. (2006) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2006.130 · Cited by 819
“In addition, the incorporation of short-text similarity is beneficial to applications such as text summarization [9], text categorization [15], and machine translation [21].”
BackgroundAutomatic text summarization: A comprehensive survey
El-Kassas, W. S., Salama, C. R., Rafea, A. A., & Mohamed, H. K. (2021) · Expert Systems with Applications · doi:10.1016/j.eswa.2020.113679 · Cited by 809
Recent automatic text summarization techniques: a survey
Gambhir, M., & Gupta, V. (2017) · Artificial Intelligence Review · doi:10.1007/s10462-016-9475-9 · Cited by 727
Dependency-Based Construction of Semantic Space Models
Padó, S., & Lapata, M. (2007) · Computational Linguistics · doi:10.1162/coli.2007.33.2.161 · Cited by 695
A Survey of Text Summarization Techniques
Nenkova, A., & McKeown, K. (2012) · Mining Text Data · doi:10.1007/978-1-4614-3223-4_3 · Cited by 590
Enquiring Minds: Early Detection of Rumors in Social Media from Enquiry Posts
Zhao, Z., Resnick, P., & Mei, Q. (2015) · Proceedings of the 24th International Conference on World Wide Web · doi:10.1145/2736277.2741637 · Cited by 583
“We keep the summarization component simple and efficient in this study, though algorithms such as LexRank [11] may improve the performance of text summarization.”
MethodText Summarization Techniques: A Brief Survey
Allahyari, M., Pouriyeh, S., Assefi, M., Safaei, S., D., E., B., J., & Kochut, K. (2017) · International Journal of Advanced Computer Science and Applications · doi:10.14569/ijacsa.2017.081052 · Cited by 558
Benchmarking Large Language Models for News Summarization
Zhang, T., Ladhak, F., Durmus, E., Liang, P., McKeown, K., & Hashimoto, T. B. (2024) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00632 · Cited by 415
Benchmarking Large Language Models for News Summarization
Zhang, T., Ladhak, F., Durmus, E., Liang, P., McKeown, K., & Hashimoto, T. B. (2023) · arXiv · doi:10.48550/arxiv.2301.13848 · Cited by 415
Özgür, A., Vu, T., Erkan, G., & Radev, D. R. (2008) · Bioinformatics · doi:10.1093/bioinformatics/btn182 · Cited by 373
Self-citationAutomatic summarising: The state of the art
Spärck Jones, K. (2007) · Information Processing & Management · doi:10.1016/j.ipm.2007.03.009 · Cited by 353
Abstractive text summarization using LSTM-CNN based deep learning
Song, S., Huang, H., & Ruan, T. (2019) · Multimedia Tools and Applications · doi:10.1007/s11042-018-5749-3 · Cited by 342
Neural Rating Regression with Abstractive Tips Generation for Recommendation
Li, P., Wang, Z., Ren, Z., Bing, L., & Lam, W. (2017) · Proceedings of the 40th International ACM SIGIR Conference on Research and Development in Information Retrieval · doi:10.1145/3077136.3080822 · Cited by 313
“LexRank Pagerank for summarization [7] CTRt CTR for tips topic extraction [40] RMRt RMR for tips topic extraction [21]”
MethodAn Experimental Study of Graph Connectivity for Unsupervised Word Sense Disambiguation
Navigli, R., & Lapata, M. (2010) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2009.36 · Cited by 288
Shaik, T., Tao, X., Li, Y., Dann, C., McDonald, J., Redmond, P., & Galligan, L. (2022) · IEEE Access · doi:10.1109/access.2022.3177752 · Cited by 286
Aliguliyev, R. M. (2009) · Expert Systems with Applications · doi:10.1016/j.eswa.2008.11.022 · Cited by 265
A survey on extractive text summarization
Moratanch, N., & Chitrakala, S. (2017) · 2017 International Conference on Computer, Communication and Signal Processing (ICCCSP) · doi:10.1109/icccsp.2017.7944061 · Cited by 265
Multimodal Saliency and Fusion for Movie Summarization Based on Aural, Visual, and Textual Attention
Evangelopoulos, G., Zlatintsi, A., Potamianos, A., Maragos, P., Rapantzikos, K., Skoumas, G., & Avrithis, Y. (2013) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2013.2267205 · Cited by 263
Graph-based Neural Multi-Document Summarization
Yasunaga, M., Zhang, R., Meelu, K., Pareek, A., Srinivasan, K., & Radev, D. (2017) · Proceedings of the 21st Conference on Computational Natural Language Learning (CoNLL 2017) · doi:10.18653/v1/k17-1045 · Cited by 262
Self-citationGA, MR, FFNN, PNN and GMM based models for automatic text summarization
Fattah, M. A., & Ren, F. (2009) · Computer Speech & Language · doi:10.1016/j.csl.2008.04.002 · Cited by 254
Neural Natural Language Processing for unstructured data in electronic health records: A review
Li, I., Pan, J., Goldwasser, J., Verma, N., Wong, W. P., Nuzumlalı, M. Y., Rosand, B., Li, Y., Zhang, M., Chang, D., et al. (2022) · Computer Science Review · doi:10.1016/j.cosrev.2022.100511 · Cited by 254
Self-citationLiang, W., Zhang, Y., Cao, H., Wang, B., Ding, D., Yang, X., Vodrahalli, K., He, S., Smith, D., Yin, Y., et al. (2023) · arXiv · doi:10.48550/arxiv.2310.01783 · Cited by 633
BIGPATENT: A Large-Scale Dataset for Abstractive and Coherent Summarization
Sharma, E., Li, C., & Wang, L. (2019) · Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/p19-1212 · Cited by 173
Optimizing the Factual Correctness of a Summary: A Study of Summarizing Radiology Reports
Zhang, Y., Merck, D., Tsai, E., Manning, C. D., & Langlotz, C. (2020) · Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/2020.acl-main.458 · Cited by 171
A systematic review of digital transformation technologies in museum exhibition
Li, J., Zheng, X., Watanabe, I., & Ochiai, Y. (2024) · Computers in Human Behavior · doi:10.1016/j.chb.2024.108407 · Cited by 136
Learning to Summarize Radiology Findings
Zhang, Y., Ding, D. Y., Qian, T., Manning, C. D., & Langlotz, C. P. (2018) · arXiv · doi:10.48550/arxiv.1809.04698 · Cited by 126
Learning to Summarize Radiology Findings
Zhang, Y., Ding, D. Y., Qian, T., Manning, C. D., & Langlotz, C. P. (2018) · Proceedings of the Ninth International Workshop on Health Text Mining and Information Analysis · doi:10.18653/v1/w18-5623 · Cited by 126
Extractive Opinion Summarization in Quantized Transformer Spaces
Angelidis, S., Amplayo, R. K., Suhara, Y., Wang, X., & Lapata, M. (2021) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00366 · Cited by 85
“As shown in Table 4, participants rate QT favorably over all baselines in terms of in-formativeness, conciseness and lack of redundancy, with slight preference for Copycat summaries with respect to coherence (statistical significance infor-S 26.24 3.58 14.72 11.53 .799 .374 .509 .592 LexRank 29.85 5.87 17.56 11.84 .840…”
MethodInfluentialA semantic graph-based approach to biomedical summarisation
Plaza, L., Díaz, A., & Gervás, P. (2011) · Artificial Intelligence in Medicine · doi:10.1016/j.artmed.2011.06.005 · Cited by 83
Enhancing credibility judgment of web search results
Yamamoto, Y., & Tanaka, K. (2011) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/1978942.1979126 · Cited by 75
“We use the LexRank algorithm to calculate content typicality [7].”
MethodChestXRayBERT: A Pretrained Language Model for Chest Radiology Report Summarization
Cai, X., Liu, S., Han, J., Yang, L., Liu, Z., & Liu, T. (2023) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2021.3132724 · Cited by 72
A random walk algorithm for automatic construction of domain-oriented sentiment lexicon
Tan, S., & Wu, Q. (2011) · Expert Systems with Applications · doi:10.1016/j.eswa.2011.02.105 · Cited by 55
Wang, M., Xie, P., Du, Y., & Hu, X. (2023) · Applied Sciences · doi:10.3390/app13127111 · Cited by 46
Generating Product Descriptions from User Reviews
Novgorodov, S., Guy, I., Elad, G., & Radinsky, K. (2019) · The World Wide Web Conference · doi:10.1145/3308558.3313532 · Cited by 41
Supporting Software Developers with a Holistic Recommender System
Ponzanelli, L., Scalabrino, S., Bavota, G., Mocci, A., Oliveto, R., Di Penta, M., & Lanza, M. (2017) · 2017 IEEE/ACM 39th International Conference on Software Engineering (ICSE) · doi:10.1109/icse.2017.17 · Cited by 41
Self-Supervised and Controlled Multi-Document Opinion Summarization
Elsahar, H., Coavoux, M., Gallé, M., & Rozen, J. (2020) · arXiv · doi:10.48550/arxiv.2004.14754 · Cited by 40
SumPubMed: Summarization Dataset of PubMed Scientific Articles
Gupta, V., Bharti, P., Nokhiz, P., & Karnick, H. (2021) · Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing: Student Research Workshop · doi:10.18653/v1/2021.acl-srw.30 · Cited by 43
Abstractive Timeline Summarization
Steen, J., & Markert, K. (2019) · Proceedings of the 2nd Workshop on New Frontiers in Summarization · doi:10.18653/v1/d19-5403 · Cited by 34
Extracting and Ranking Travel Tips from User-Generated Reviews
Guy, I., Mejer, A., Nus, A., & Raiber, F. (2017) · Proceedings of the 26th International Conference on World Wide Web · doi:10.1145/3038912.3052632 · Cited by 32
Generative AI for Pull Request Descriptions: Adoption, Impact, and Developer Interventions
Xiao, T., Hata, H., Treude, C., & Matsumoto, K. (2024) · Proceedings of the ACM on Software Engineering · doi:10.1145/3643773 · Cited by 29
MReD: A Meta-Review Dataset for Structure-Controllable Text Generation
Shen, C., Cheng, L., Zhou, R., Bing, L., You, Y., & Si, L. (2022) · Findings of the Association for Computational Linguistics: ACL 2022 · doi:10.18653/v1/2022.findings-acl.198 · Cited by 23
An Ensemble Approach for Extractive Text Summarization
Singh, P., Chhikara, P., & Singh, J. (2020) · 2020 International Conference on Emerging Trends in Information Technology and Engineering (ic-ETITE) · doi:10.1109/ic-etite47903.2020.95 · Cited by 22
Surveyor: A System for Generating Coherent Survey Articles for Scientific Topics
Jha, R., Coke, R., & Radev, D. (2015) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v29i1.9495 · Cited by 19
Self-citationPageRank Approach to Ranking National Football Teams
Lazova, V., & Basnarkov, L. (2015) · arXiv · doi:10.48550/arxiv.1503.01331 · Cited by 17
“Also it is used in NLP for the purpose of text summarization and word sense disambiguation [15], [16].”
MethodLearning to Generate Personalized Product Descriptions
Elad, G., Guy, I., Novgorodov, S., Kimelfeld, B., & Radinsky, K. (2019) · Proceedings of the 28th ACM International Conference on Information and Knowledge Management · doi:10.1145/3357384.3357984 · Cited by 13
Experience-guided multi-agent interpretable framework for radiology report summarization
Li, J., Zhou, T., Zhou, Z., Wei, X., Song, H., Wang, Z., Chen, Y., & Lv, H. (2026) · Computer Methods and Programs in Biomedicine · doi:10.1016/j.cmpb.2025.109078 · Cited by 4
Automatic Related Work Section in Scientific Article: Research Trends and Future Directions
Justitia, A., & Wang, H.-C. (2022) · 2022 International Seminar on Intelligent Technology and Its Applications (ISITIA) · doi:10.1109/isitia56226.2022.9855331 · Cited by 2
Scientific Opinion Summarization: Paper Meta-review Generation Dataset, Methods, and Evaluation
Zeng, Q., Sidhu, M., Blume, A., Chan, H. P., Wang, L., & Ji, H. (2025) · Lecture Notes in Computer Science · doi:10.1007/978-981-97-9536-9_2 · Cited by 2
Metadata
- Authors
- Erkan, G., & Radev, D. R.
- Venue
- Journal of Artificial Intelligence Research
- Publisher
- AI Access Foundation
- Published
- 2004-12-01
- Volume
- 22
- Pages
- 457-479
- ISSN
- 1076-9757 (ISSN-L)
- OpenAlex
- W2110693578
- Cited by
- 1,700
- References
- 16
- FWCI
- 9.49
- Type
- journal article
- Language
- en
- Open access
- diamond
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.