Deep Keyphrase Generation
Open accessThe DOI matches its Crossref record; 34 of the 34 references it cites were found in a registry or an index.
Abstract
Keyphrase provides highly-summative information that can be effectively used for understanding, organizing and retrieving text content.Though previous studies have provided many workable solutions for automated keyphrase extraction, they commonly divided the to-be-summarized content into multiple text chunks, then ranked and selected the most meaningful ones.These approaches could neither identify keyphrases that do not appear in the text, nor capture the real semantic meaning behind the text.We propose a generative model for keyphrase prediction with an encoder-decoder framework, which can effectively overcome the above drawbacks.We name it as deep keyphrase generation since it attempts to capture the deep semantic meaning of the content with a deep learning method.Empirical analysis on six datasets demonstrates that our proposed model not only achieves a significant performance boost on extracting keyphrases that appear in the source text, but also can generate absent keyphrases based on the semantic meaning of the text.Code and dataset are available at https://github.com/memray/seq2seq-keyphrase.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Hochreiter, S., & Schmidhuber, J. (1997) · Neural Computation · doi:10.1162/neco.1997.9.8.1735 · Cited by 102,318
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
Learning Phrase Representations using RNN Encoder–Decoder for Statistical Machine Translation
Cho, K., van Merrienboer, B., Gulcehre, C., Bahdanau, D., Bougares, F., Schwenk, H., & Bengio, Y. (2014) · Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.3115/v1/d14-1179 · Cited by 25,545 · cited 5×
“As a result, the above non-linear function f is replaced by the GRU function (see in (Cho et al., 2014)).”
BackgroundMethodInfluentialSequence to Sequence Learning with Neural Networks
Sutskever, I., Vinyals, O., & Le, Q. V. (2014) · arXiv · doi:10.48550/arxiv.1409.3215 · Cited by 17,766
Neural Machine Translation by Jointly Learning to Align and Translate
Bahdanau, D., Cho, K., & Bengio, Y. (2014) · arXiv · doi:10.48550/arxiv.1409.0473 · Cited by 16,213
TextRank: Bringing Order into Text
Mihalcea, R. F., & Tarau, P. (2004) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · Cited by 3,631
A Neural Attention Model for Abstractive Sentence Summarization
Rush, A. M., Chopra, S., & Weston, J. (2015) · Proceedings of the 2015 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d15-1044 · Cited by 2,656
Building End-To-End Dialogue Systems Using Generative Hierarchical Neural Network Models
Serban, I., Sordoni, A., Bengio, Y., Courville, A., & Pineau, J. (2016) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v30i1.9883 · Cited by 1,615
Incorporating Copying Mechanism in Sequence-to-Sequence Learning
Gu, J., Lu, Z., Li, H., & Li, V. O. K. (2016) · Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/p16-1154 · Cited by 1,446
Sequence Level Training with Recurrent Neural Networks
Ranzato, M., Chopra, S., Auli, M., & Zaremba, W. (2015) · arXiv · doi:10.48550/arxiv.1511.06732 · Cited by 1,426
Improved automatic keyword extraction given more linguistic knowledge
Hulth, A. (2003) · Proceedings of the 2003 conference on Empirical methods in natural language processing - · doi:10.3115/1119355.1119383 · Cited by 951
KEA: practical automatic keyphrase extraction
Witten, I. H., Paynter, G. W., Frank, E., Gutwin, C., & Nevill-Manning, C. G. (1999) · Proceedings of the fourth ACM conference on Digital libraries · doi:10.1145/313238.313437 · Cited by 859
KEYWORD EXTRACTION FROM A SINGLE DOCUMENT USING WORD CO-OCCURRENCE STATISTICAL INFORMATION
MATSUO, Y., & ISHIZUKA, M. (2004) · International Journal on Artificial Intelligence Tools · doi:10.1142/s0218213004001466 · Cited by 788
LSTM recurrent networks learn simple context-free and context-sensitive languages
Gers, F. A., & Schmidhuber, E. (2001) · IEEE Transactions on Neural Networks · doi:10.1109/72.963769 · Cited by 722
Domain-specific keyphrase extraction
Frank, E., Paynter, G. W., Witten, I. H., Gutwin, C. A., & Nevill-Manning, C. G. (1999) · Research Commons (University of Waikato) · Cited by 647
A Convolutional Attention Network for Extreme Summarization of Source CodePreprint
Allamanis, M., Peng, H. M., & Sutton, C. A. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1602.03001 · Cited by 624
Sequence Level Training with Recurrent Neural Networks
Ranzato, M., Chopra, S., Auli, M., & Zaremba, W. (2016) · International Conference on Learning Representations · Cited by 572
Vinyals, O., Kaiser, L., Koo, T., Petrov, S., Sutskever, I., & Hinton, G. (2014) · arXiv · doi:10.48550/arxiv.1412.7449 · Cited by 464
Automatic Keyphrase Extraction via Topic Decomposition
Liu, Z., Huang, W., Zheng, Y., & Sun, M. (2010) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · Cited by 414
Single document keyphrase extraction using neighborhood knowledge
Wan, X., & Xiao, J. (2008) · Cited by 393
Minimum Risk Training for Neural Machine Translation
Shen, S., Cheng, Y., He, Z., He, W., Wu, H., Sun, M., & Liu, Y. (2016) · Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/p16-1159 · Cited by 375
SemEval-2010 Task 5 : Automatic Keyphrase Extraction from Scientific Articles
Kim, S. N., Medelyan, O., Kan, M., & Baldwin, T. J. (2010) · Cited by 340
Keyphrase Extraction in Scientific Publications
Nguyen, T. D., & Kan, M.-Y. (2008) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-77094-7_41 · Cited by 331
Human-competitive tagging using automatic keyphrase extraction
Medelyan, O., Frank, E., & Witten, I. H. (2009) · Proceedings of the 2009 Conference on Empirical Methods in Natural Language Processing Volume 3 - EMNLP '09 · doi:10.3115/1699648.1699678 · Cited by 313
A language model approach to keyphrase extraction
Tomokiyo, T., & Hurst, M. (2003) · Proceedings of the ACL 2003 workshop on Multiword expressions analysis, acquisition and treatment - · doi:10.3115/1119282.1119287 · Cited by 297
Extracting key terms from noisy and multitheme documents
Grineva, M., Grinev, M., & Lizorkin, D. (2009) · Proceedings of the 18th international conference on World wide web · doi:10.1145/1526709.1526798 · Cited by 262
Keyphrase Extraction Using Deep Recurrent Neural Networks on Twitter
Zhang, Q., Wang, Y., Gong, Y., & Huang, X. (2016) · Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d16-1080 · Cited by 195
A study on automatically extracted keywords in text categorization
Hulth, A., & Megyesi, B. B. (2006) · Proceedings of the 21st International Conference on Computational Linguistics and the 44th annual meeting of the ACL - ACL '06 · doi:10.3115/1220175.1220243 · Cited by 165
Conundrums in Unsupervised Keyphrase Extraction: Making Sense of the State-of-the-Art
Hasan, K. S., & Ng, V. (2010) · Cited by 154
Extracting Keyphrases from Research Papers Using Citation Networks
Gollapalli, S. D., & Caragea, C. (2014) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v28i1.8946 · Cited by 135
Efficient Summarization with Read-Again and Copy MechanismPreprint
Zeng, W., Luo, W., Fidler, S., & Urtasun, R. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1611.03382 · Cited by 113
Jones, S., & Staveley, M. S. (1999) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/312624.312671 · Cited by 110
Automatic Keyphrase Extraction by Bridging Vocabulary Gap
Liu, Z., Chen, X., Zheng, Y., & Sun, M. (2011) · Cited by 69
Supporting exploratory people search: a study of factor transparency and user control
Han, S., He, D., Jiang, J., & Yue, Z. (2013) · ACM International Conference on Information and Knowledge Management (CIKM) · doi:10.1145/2505515.2505684 · Cited by 30
Self-citation
Cited by
YAKE! Keyword extraction from single documents using multiple local features
Campos, R., Mangaravite, V., Pasquali, A., Jorge, A., Nunes, C., & Jatowt, A. (2020) · Information Sciences · doi:10.1016/j.ins.2019.09.013 · Cited by 668
Metadata
- Authors
- Meng, R., Zhao, S., Han, S., He, D., Brusilovsky, P., & Chi, Y.
- Venue
- Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
- Published
- 2017
- Pages
- 582-592
- OpenAlex
- W2963265326
- Cited by
- 351
- References
- 34
- FWCI
- 16.89
- Type
- conference paper
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.