Summarizing text documents: sentence selection and evaluation metrics
The DOI matches its Crossref record; 19 of the 19 references it cites were found in a registry or an index.
Abstract
Article Free Access Share on Summarizing text documents: sentence selection and evaluation metrics Authors: Jade Goldstein Language Technologies Institute, Carnegie Mellon University, Pittsburgh, PA Language Technologies Institute, Carnegie Mellon University, Pittsburgh, PAView Profile , Mark Kantrowitz Just Research, 4616 Henry Street, Pittsburgh, PA Just Research, 4616 Henry Street, Pittsburgh, PAView Profile , Vibhu Mittal Just Research, 4616 Henry Street, Pittsburgh, PA Just Research, 4616 Henry Street, Pittsburgh, PAView Profile , Jaime Carbonell Language Technologies Institute, Carnegie Mellon University, Pittsburgh, PA Language Technologies Institute, Carnegie Mellon University, Pittsburgh, PAView Profile Authors Info & Claims SIGIR '99: Proceedings of the 22nd annual international ACM SIGIR conference on Research and development in information retrievalAugust 1999 Pages 121–128https://doi.org/10.1145/312624.312665Published:01 August 1999Publication History 264citation3,037DownloadsMetricsTotal Citations264Total Downloads3,037Last 12 Months222Last 6 weeks42 Get Citation AlertsNew Citation Alert added!This alert has been successfully added and will be sent to:You will be notified whenever a record that you have chosen has been cited.To manage your alert preferences, click on the button below.Manage my Alerts New Citation Alert!Please log in to your account Save to BinderSave to BinderCreate a New BinderNameCancelCreateExport CitationPublisher SiteeReaderPDF
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Introduction to Modern Information Retrieval
Salton, G., & McGill, M. J. (1983) · Virtual Defense Library (Ministerio de Defensa) · Cited by 11,546
The Automatic Creation of Literature Abstracts
Luhn, H. P. (1958) · IBM Journal of Research and Development · doi:10.1147/rd.22.0159 · Cited by 3,246
The use of MMR, diversity-based reranking for reordering documents and producing summaries
Carbonell, J., & Goldstein, J. (1998) · Proceedings of the 21st annual international ACM SIGIR conference on Research and development in information retrieval · doi:10.1145/290941.291025 · Cited by 2,329 · cited 2×
“, [8, 9, 17, 25]), and combinations of the two (e.”
BackgroundMethodSelf-citationThe Use of MMR, Diversity-Based Reranking for Reordering Documents and Producing Summaries
Carbonell, J., & Goldstein, J. (2017) · ACM SIGIR Forum · doi:10.1145/3130348.3130369 · Cited by 2,156
Self-citationImproving retrieval performance by relevance feedback
Salton, G., & Buckley, C. (1990) · Journal of the American Society for Information Science · doi:10.1002/(sici)1097-4571(199006)41:4<288::aid-asi8>3.0.co;2-h · Cited by 1,495
Quary Expansion Using Local and Global Document Analysis
Xu, J., & Croft, W. B. (2017) · ACM SIGIR Forum · doi:10.1145/3130348.3130364 · Cited by 1,252
Using lexical chains for text summarization
Barzilay, R., & Elhadad, M. (1997) · doi:10.7916/d85b09vz · Cited by 855
Query expansion using local and global document analysis
Xu, J., & Croft, W. B. (1996) · Proceedings of the 19th annual international ACM SIGIR conference on Research and development in information retrieval - SIGIR '96 · doi:10.1145/243199.243202 · Cited by 831
Constructing literature abstracts by computer: Techniques and prospects
Paice, C. D. (1990) · Information Processing & Management · doi:10.1016/0306-4573(90)90014-s · Cited by 381
Generating Natural Language Summaries from Multiple On-Line Sources
Radev, D. (1997) · doi:10.7916/d83n2b7j · Cited by 374
Cited by
Mining and summarizing customer reviews
Hu, M., & Liu, B. (2004) · Proceedings of the tenth ACM SIGKDD international conference on Knowledge discovery and data mining · doi:10.1145/1014052.1014073 · Cited by 7,793
Centroid-based summarization of multiple documents
Radev, D. R., Jing, H., Styś, M., & Tam, D. (2004) · Information Processing & Management · doi:10.1016/j.ipm.2003.10.006 · Cited by 1,042
Generic text summarization using relevance measure and latent semantic analysis
Gong, Y., & Liu, X. (2001) · Proceedings of the 24th annual international ACM SIGIR conference on Research and development in information retrieval · doi:10.1145/383952.383955 · Cited by 848
Automatic text summarization: A comprehensive survey
El-Kassas, W. S., Salama, C. R., Rafea, A. A., & Mohamed, H. K. (2021) · Expert Systems with Applications · doi:10.1016/j.eswa.2020.113679 · Cited by 809
Chowdhury, G. G. (2003) · Annual Review of Information Science and Technology · doi:10.1002/aris.1440370103 · Cited by 805
Introduction to the Special Issue on Summarization
Radev, D. R., Hovy, E., & McKeown, K. (2002) · Computational Linguistics · doi:10.1162/089120102762671927 · Cited by 539
Radev, D. R., Jing, H., & Budzikowska, M. (2000) · NAACL-ANLP 2000 Workshop on Automatic summarization - · doi:10.3115/1117575.1117578 · Cited by 510
The Pyramid Method: Incorporating human content selection variation in summarization evaluation
Nenkova, A., Passonneau, R., & McKeown, K. (2007) · ACM Transactions on Speech and Language Processing · doi:10.1145/1233912.1233913 · Cited by 307
GA, MR, FFNN, PNN and GMM based models for automatic text summarization
Fattah, M. A., & Ren, F. (2009) · Computer Speech & Language · doi:10.1016/j.csl.2008.04.002 · Cited by 254
Temporal summaries of new topics
Allan, J., Gupta, R., & Khandelwal, V. (2001) · Proceedings of the 24th annual international ACM SIGIR conference on Research and development in information retrieval · doi:10.1145/383952.383954 · Cited by 253
Fast generation of result snippets in web search
Turpin, A., Tsegay, Y., Hawking, D., & Williams, H. E. (2007) · Proceedings of the 30th annual international ACM SIGIR conference on Research and development in information retrieval · doi:10.1145/1277741.1277766 · Cited by 167
“The scoring of sentences against queries has been explored in several papers [7, 12, 18, 20, 21], with different features of sentences deemed important.”
BackgroundThe influence of caption features on clickthrough patterns in web search
Clarke, C. L. A., Agichtein, E., Dumais, S., & White, R. W. (2007) · Proceedings of the 30th annual international ACM SIGIR conference on Research and development in information retrieval · doi:10.1145/1277741.1277767 · Cited by 119
“[6] describe another extractive system for generating query-dependent summaries from newspaper articles.”
BackgroundGenerating Product Descriptions from User Reviews
Novgorodov, S., Guy, I., Elad, G., & Radinsky, K. (2019) · The World Wide Web Conference · doi:10.1145/3308558.3313532 · Cited by 41
Lacson, R. C., Barzilay, R., & Long, W. J. (2006) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2005.12.009 · Cited by 38
“Following a commonly used strategy in text summarization, we select the leading utter-ance of each segment [21].”
Method
Metadata
- Authors
- Goldstein, J., Kantrowitz, M., Mittal, V., & Carbonell, J.
- Venue
- Proceedings of the 22nd annual international ACM SIGIR conference on Research and development in information retrieval
- Publisher
- ACM
- Published
- 1999-08
- Pages
- 121-128
- OpenAlex
- W2034771957
- Cited by
- 462
- References
- 19
- FWCI
- 12.45
- Type
- conference paper
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.