The DOI matches its Crossref record; 46 of the 46 references it cites were found in a registry or an index.
Controllable Abstractive Summarization
Open accessAbstract
Current models for document summarization disregard user preferences such as the desired length, style, the entities that the user might be interested in, or how much of the document the user has already read.We present a neural summarization model with a simple but effective mechanism to enable users to specify these high level attributes in order to control the shape of the final summaries to better suit their needs.With user input, our system can produce high quality summaries that follow user preferences.Without user input, we set the control variables automatically -on the full text CNN-Dailymail dataset, we outperform state of the art abstractive systems (both in terms of F1-ROUGE1 40.38 vs. 39.53F1-ROUGE and human evaluation).
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“In controlled generation work, the control is generally performed over the style or content of the generations [23,27] while the underlying task remains the same.”
From Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processing (2023) · cites this paper as [27]
The cited source says what the claim attributes to it.
In the citing paper
“Specifically, the guidance signals could be style tokens [27,123], length specifications [56], domain tags [14], or any variety of other pieces of information used to control of the generated text.”
From Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processing (2023) · cites this paper as [27]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., Kaiser, L., & Polosukhin, I. (2017) · arXiv · doi:10.48550/arxiv.1706.03762 · Cited by 120,404 · cited 1×
“The mechanism allows the decoder to keep track of its progress and dissuades the decoder from generating repeated information (Vaswani et al., 2017; Paulus et al., 2017).”
BackgroundExploiting Generative AI to Scale up Intelligent Tutoring Systems
Jakubův, J., Chvalovský, K., Goertzel, Z., Kaliszyk, C., Olšák, M., Piotrowski, B., Schulz, S., Suda, M., & Urban, J. (2023) · DROPS (Schloss Dagstuhl – Leibniz Center for Informatics) · doi:10.4230/lipics.itp.2023.19 · Cited by 76,658
Auto-Encoding Variational Bayes
Kingma, D. P., & Welling, M. (2013) · arXiv · doi:10.48550/arxiv.1312.6114 · Cited by 20,067 · cited 1×
“The field follows recent advances in generative models, such as the introduction of variational auto-encoders (Kingma and Welling, 2013) and adversarial networks (Good-fellow et al., 2014).”
BackgroundLabaca-Castro, R. (2023) · Machine Learning under Malware Attack · doi:10.1007/978-3-658-40442-0_9 · Cited by 19,272
GAN(Generative Adversarial Nets)
(2017) · Journal of Japan Society for Fuzzy Theory and Intelligent Informatics · doi:10.3156/jsoft.29.5_177_2 · Cited by 19,270
Sequence to Sequence Learning with Neural Networks
Sutskever, I., Vinyals, O., & Le, Q. V. (2014) · arXiv · doi:10.48550/arxiv.1409.3215 · Cited by 17,766 · cited 2×
“Recently, sequence-to-sequence neural networks (Sutskever et al., 2014) have been applied to abstractive summarization (Nallapati et al., 2016; See et al., 2017; Paulus et al., 2017) following their success in both machine translation (Bahdanau et al., 2015; Luong et al., 2015b), parsing (Luong et…”
MethodNeural Machine Translation by Jointly Learning to Align and Translate
Bahdanau, D., Cho, K., & Bengio, Y. (2014) · arXiv · doi:10.48550/arxiv.1409.0473 · Cited by 16,213 · cited 6×
“In addition to attending over encoder states (Bahdanau et al., 2015), we also use intra-attention in the decoder to enable the model to refer back to previously generated words at any time scale.”
BackgroundMethodInfluential(2004) · Cited by 9,718
Effective Approaches to Attention-based Neural Machine Translation
Luong, T., Pham, H., & Manning, C. D. (2015) · Proceedings of the 2015 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d15-1166 · Cited by 8,382 · cited 2×
“…et al., 2014) have been applied to abstractive summarization (Nallapati et al., 2016; See et al., 2017; Paulus et al., 2017) following their success in both machine translation (Bahdanau et al., 2015; Luong et al., 2015b), parsing (Luong et al., 2015a) and image captioning (Vinyals et al., 2015b).”
BackgroundMethodShow and tell: A neural image caption generator
Vinyals, O., Toshev, A., Bengio, S., & Erhan, D. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298935 · Cited by 6,318 · cited 2×
“…et al., 2014) have been applied to abstractive summarization (Nallapati et al., 2016; See et al., 2017; Paulus et al., 2017) following their success in both machine translation (Bahdanau et al., 2015; Luong et al., 2015b), parsing (Luong et al., 2015a) and image captioning (Vinyals et al., 2015b).”
BackgroundMethodOn the difficulty of training recurrent neural networks
Pascanu, R., Mikolov, T., & Bengio, Y. (2012) · arXiv · doi:10.48550/arxiv.1211.5063 · Cited by 4,310 · cited 2×
“1 (Pascanu et al., 2013), momentum 0.”
MethodInfluentialGet To The Point: Summarization with Pointer-Generator Networks
See, A., Liu, P. J., & Manning, C. D. (2017) · Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/p17-1099 · Cited by 3,775 · cited 24×
“, 2014) have been applied to abstractive summarization (Nallapati et al., 2016; See et al., 2017; Paulus et al., 2017) following their success in translation (Bahdanau et al.”
BackgroundMethodInfluential(2013) · Cited by 3,740
(1989) · neural information processing systems · Cited by 3,736
The Automatic Creation of Literature Abstracts
Luhn, H. P. (1958) · IBM Journal of Research and Development · doi:10.1147/rd.22.0159 · Cited by 3,246 · cited 1×
“Automatic summarization has been an active field of research for close to 60 years (Luhn, 1958).”
BackgroundConvolutional Sequence to Sequence Learning
Gehring, J., Auli, M., Grangier, D., Yarats, D., & Dauphin, Y. N. (2017) · arXiv · doi:10.48550/arxiv.1705.03122 · Cited by 2,850 · cited 5×
“Table 2 details the effect of our design choices on top of Gehring et al. (2017).”
BackgroundMethodInfluentialSelf-citationA Neural Algorithm of Artistic Style
Gatys, L., Ecker, A., & Bethge, M. (2016) · Journal of Vision · doi:10.1167/16.12.326 · Cited by 2,612
Teaching Machines to Read and Comprehend
Hermann, K. M., Kočiský, T., Grefenstette, E., Espeholt, L., Kay, W., Suleyman, M., & Blunsom, P. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1506.03340 · Cited by 2,521
Abstractive Text Summarization using Sequence-to-sequence RNNs and Beyond
Nallapati, R., Zhou, B., dos Santos, C., Gulcehre, C., & Xiang, B. (2016) · Proceedings of The 20th SIGNLL Conference on Computational Natural Language Learning · doi:10.18653/v1/k16-1028 · Cited by 2,361
SeqGAN: Sequence Generative Adversarial Nets with Policy Gradient
Yu, L., Zhang, W., Wang, J., & Yu, Y. (2017) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v31i1.10804 · Cited by 2,285
Generating Sentences from a Continuous Space
Bowman, S. R., Vilnis, L., Vinyals, O., Dai, A., Jozefowicz, R., & Bengio, S. (2016) · Proceedings of The 20th SIGNLL Conference on Computational Natural Language Learning · doi:10.18653/v1/k16-1002 · Cited by 2,061 · cited 1×
“This is exemplified by work focusing on natural language generation such as (Bowman et al., 2016; Yu et al., 2017; Zhao et al., 2017; Rajeswar et al., 2017).”
BackgroundVinyals, O., Fortunato, M., & Jaitly, N. (2015) · neural information processing systems · Cited by 2,043
Nallapati, R., Zhai, F., & Zhou, B. (2017) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v31i1.10958 · Cited by 1,233 · cited 12×
“Research in abstractive summarization with sequence-to-sequence models focuses on neural architectures (Rush et al., 2015; Chopra et al., 2016; Nallapati et al., 2016; See et al., 2017; Paulus et al., 2017) and learning objectives (Paulus et al., 2017).”
BackgroundMethodInfluentialA Deep Reinforced Model for Abstractive Summarization
Paulus, R., Xiong, C., & Socher, R. (2017) · arXiv · doi:10.48550/arxiv.1705.04304 · Cited by 1,182 · cited 21×
“To avoid repetition, we prevent the de-coder from generating the same trigram more than once during test, following (Paulus et al., 2017).”
BackgroundMethodInfluentialLanguage Modeling with Gated Convolutional Networks
Dauphin, Y., Fan, A., Auli, M., & Grangier, D. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1612.08083 · Cited by 1,080 · cited 2×
“The decoder is connected to the encoder through an attention module (Bahdanau et al., 2015) after each GLU.”
BackgroundSelf-citationToward Controlled Generation of TextPreprint
Hu, Z., Yang, Z., Liang, X., Salakhutdinov, R., & Xing, E. P. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1703.00955 · Cited by 990
Abstractive Sentence Summarization with Attentive Recurrent Neural Networks
Chopra, S., Auli, M., & Rush, A. M. (2016) · Proceedings of the 2016 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies · doi:10.18653/v1/n16-1012 · Cited by 881 · cited 2×
“Research in abstractive summarization with sequence-to-sequence models focuses on neural architectures (Rush et al., 2015; Chopra et al., 2016; Nallapati et al., 2016; See et al., 2017; Paulus et al., 2017) and learning objectives (Paulus et al., 2017).”
BackgroundMethodSelf-citation(2017) · International Conference on Machine Learning · Cited by 758
Self-citationMcKeown, K. (1985) · Cambridge University Press eBooks · doi:10.1017/cbo9780511620751 · Cited by 757
Nallapati, R. M., Zhai, F., & Zhou, B. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1611.04230 · Cited by 742 · cited 12×
“Research in abstractive summarization with sequence-to-sequence models focuses on neural architectures (Rush et al., 2015; Chopra et al., 2016; Nallapati et al., 2016; See et al., 2017; Paulus et al., 2017) and learning objectives (Paulus et al., 2017).”
BackgroundMethodInfluentialMulti-task Sequence to Sequence LearningPreprint
Luong, M.-T., Le, Q. V., Sutskever, I., Vinyals, O., & Kaiser, Ł. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1511.06114 · Cited by 606 · cited 1×
“, 2015b), parsing (Luong et al., 2015a) and image captioning (Vinyals et al.”
BackgroundStyle Transfer from Non-Parallel Text by Cross-Alignment
Shen, T., Lei, T., Barzilay, R., & Jaakkola, T. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1705.09655 · Cited by 584 · cited 2×
“(Shen et al., 2017) relies on adversarial training Set sizes”
Nenkova, A. (2011) · now publishers, Inc. eBooks · doi:10.1561/9781601984715 · Cited by 429
A Survey on Automatic Text Summarization
Andr, D. D. (2007) · Cited by 348
Adversarially Regularized AutoencodersPreprint
Zhao, J., Kim, Y., Zhang, K., Rush, A. M., & LeCun, Y. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1706.04223 · Cited by 302
Controlling Politeness in Neural Machine Translation via Side Constraints
Sennrich, R., Haddow, B., & Birch, A. (2016) · Proceedings of the 2016 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies · doi:10.18653/v1/n16-1005 · Cited by 273
Fader Networks: Manipulating Images by Sliding Attributes
Lample, G., Zeghidour, N., Usunier, N., Bordes, A., Denoyer, L., & Ranzato, M. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1706.00409 · Cited by 271 · cited 1×
“Research in computer vision includes style transfer (Gatys et al., 2015) or controllable image generation (Lample et al., 2017).”
BackgroundControlling Linguistic Style Aspects in Neural Language Generation
Ficler, J., & Goldberg, Y. (2017) · Proceedings of the Workshop on Stylistic Variation · doi:10.18653/v1/w17-4912 · Cited by 265 · cited 1×
“(Ficler and Goldberg, 2017) proposes on conditional language model to generate text with stylistic requirements.”
BackgroundControlling Output Length in Neural Encoder-Decoders
Kikuchi, Y., Neubig, G., Sasano, R., Takamura, H., & Okumura, M. (2016) · Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d16-1140 · Cited by 222 · cited 3×
“(2016), our results are stronger while our method is very simple – (Kikuchi et al., 2016) explore embedding the remaining length at each timestep during decoding and creating a separate memory cell to control length.”
MethodResultInfluentialAdversarial Generation of Natural Language
Subramanian, S., Rajeswar, S., Dutil, F., Pal, C., & Courville, A. C. (2017) · Workshop on Representation Learning for NLP (RepL4NLP) · doi:10.18653/v1/w17-2629 · Cited by 220 · cited 1×
“This is exemplified by work focusing on natural language generation such as (Bowman et al., 2016; Yu et al., 2017; Zhao et al., 2017; Rajeswar et al., 2017).”
BackgroundDomain Control for Neural Machine Translation
SYSTRAN International, P., Kobus, C., Crego, J., & Sénellart, J. (2017) · International conference Recent advances in natural language processing · doi:10.26615/978-954-452-049-6_049 · Cited by 143
A Neural Attention Model for Sentence Summarization
Rush, A. M., Chopra, S., & Weston, J. (2015) · Cited by 91
Cutting-off Redundant Repeating Generations for Neural Abstractive Summarization
Suzuki, J., & Nagata, M. (2017) · Conference of the European Chapter of the Association for Computational Linguistics · doi:10.18653/v1/e17-2047 · Cited by 66 · cited 1×
“To address this impediment, (See et al., 2017) introduce coverage modeling, (Paulus et al., 2017) propose intra-decoder attention, and (Suzuki and Nagata, 2017) equip the decoder with an estimator of unigram frequency.”
MethodAdversarially Regularized Autoencoders for Generating Discrete Structures.Preprint
Zhao, J., Kim, Y., Zhang, K., Rush, A. M., & LeCun, Y. (2017) · arXiv (Cornell University) · Cited by 54
Controlling Output Length in Neural Encoder-DecodersPreprint
Kikuchi, Y., Neubig, G., Sasano, R., et al. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1609.09552 · Cited by 42 · cited 3×
“(2016), our results are stronger while our method is very simple – (Kikuchi et al., 2016) explore embedding the remaining length at each timestep during decoding and creating a separate memory cell to control length.”
MethodResultInfluentialControlling Target Features in Neural Machine Translation via Prefix Constraints
Takeno, S., Nagata, M., & Yamamoto, K. (2017) · Cited by 18
Research works printed but not linked: 3
- [7]7. Katja Filippova. 2017. Sentence and passage summariza- tion for question answering. Talk given at EMNLP 2017 Workshop on New Frontiers in Summarization.
- [25]25. Ani Nenkova, Kathleen McKeown, et al. 2011. Auto- matic summarization. Foundations and Trends R in Information Retrieval 5(2-3):103-233.
- [32]32. Rico Sennrich, Barry Haddow, and Alexandra Birch. 2016b. Neural machine translation of rare words with subword units. Annual Meeting of the Association for Computational Linguistics (ACL) .
Cited by
Lewis, M., Liu, Y., Goyal, N., Ghazvininejad, M., Mohamed, A., Levy, O., Stoyanov, V., & Zettlemoyer, L. (2020) · Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/2020.acl-main.703 · Cited by 8,821
Lewis, M., Liu, Y., Goyal, N., Ghazvininejad, M., Mohamed, A., Levy, O., Stoyanov, V., & Zettlemoyer, L. (2019) · arXiv · doi:10.48550/arxiv.1910.13461 · Cited by 8,816
Liu, P., Yuan, W., Fu, J., Jiang, Z., Hayashi, H., & Neubig, G. (2023) · ACM Computing Surveys · doi:10.1145/3560815 · Cited by 4,361
“Also, some clear discrepancies between controlled generation and prompt-based text generation are: (1) In controlled generation work, the control is generally performed over the style or content of the generations [23, 27] while the underlying task remains the same.”
Backgroundfairseq: A Fast, Extensible Toolkit for Sequence Modeling
Ott, M., Edunov, S., Baevski, A., Fan, A., Gross, S., Ng, N., Grangier, D., & Auli, M. (2019) · Proceedings of the 2019 Conference of the North · doi:10.18653/v1/n19-4009 · Cited by 2,344
“, 2017; Baevski and Auli, 2019), abstractive document summarization (Fan et al., 2018a; Liu et al., 2018; Narayan et al., 2018), story generation (Fan et al.”
BackgroundMethodInfluentialSelf-citationNarayan, S., Cohen, S. B., & Lapata, M. (2018) · Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d18-1206 · Cited by 1,207
“…has consistently attracted attention (Cheng and Lapata, 2016; Durrett et al., 2016; Nallapati et al., 2016, 2017; See et al., 2017; Tan and Wan, 2017; Narayan et al., 2017; Fan et al., 2017; Paulus et al., 2018; Pasunuru and Bansal, 2018; Celikyilmaz et al., 2018; Narayan et al., 2018a,b).”
Background
Metadata
- Authors
- Fan, A., Grangier, D., & Auli, M.
- Affiliations
- Meta (United States) (US)
- Venue
- Proceedings of the 2nd Workshop on Neural Machine Translation and Generation
- Published
- 2018
- Pages
- 45-54
- OpenAlex
- W2962805889
- Cited by
- 281
- References
- 44
- Citations by year
- 2026: 1 · 2025: 10 · 2024: 12 · 2023: 36 · 2022: 38 · 2021: 66 · 2020: 47 · 2019: 50 · 2018: 21
- FWCI
- 18.30
- Type
- conference paper
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by
- Locations
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
- Physical Sciences › Computer Science › Artificial Intelligence › Advanced Text Analysis Techniques
- Physical Sciences › Computer Science › Artificial Intelligence › Natural Language Processing Techniques
- Keywords
- abstractive summarization, user preferences
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.