CoChat
Sign Up
PreprintCited by 40Topic ModelingSentiment Analysis and Opinion MiningAdvanced Text Analysis Techniques

Self-Supervised and Controlled Multi-Document Opinion Summarization

Open access
Elsahar, Hady, Coavoux, Maximin, Gallé, Matthias, Rozen, Jos·2020·arXiv
DOI 10.48550/arxiv.2004.14754arXiv 2004.14754
Open this paper in CoChat — free accountOpen PDF

Abstract

We address the problem of unsupervised abstractive summarization of collections of user generated reviews with self-supervision and control. We propose a self-supervised setup that considers an individual document as a target summary for a set of similar documents. This setting makes training simpler than previous approaches by relying only on standard log-likelihood loss. We address the problem of hallucinations through the use of control codes, to steer the generation towards more coherent and relevant summaries.Finally, we extend the Transformer architecture to allow for multiple reviews as input. Our benchmarks on two datasets against graph-based and recent neural abstractive unsupervised models show that our proposed method generates summaries with a superior quality and relevance.This is confirmed in our human evaluation which focuses explicitly on the faithfulness of generated summaries We also provide an ablation study, which shows the importance of the control setup in controlling hallucinations and achieve high sentiment and topic alignment of the summaries with the input reviews.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

DataCite · 10.48550/arxiv.2004.14754

Cites

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • Training on heterogenous data annotated with control codes has been shown to improve controlled generation in autoregressive language models.

    “Similar to multitask learning, training on heterogenous data annotated with control codes has been shown to improve controlled generation in autoregressive language models (Keskar et al., 2019; ElSahar et al., 2020; Sudhakar et al., 2019; Li et al., 2020).”

    From TLDR: Extreme Summarization of Scientific Documents (2020) · cites this paper as ElSahar et al., 2020

    Section 4 (p. 4) says the authors enrich reviews with category-derived control codes during training. Section 7 (pp. 8–9) reports that removing the codes degrades summary quality and that generated summaries tend to follow appropriate codes. The paper supports improved control in its review-summarization model, but does not isolate heterogeneous training data as the reason for that improvement or establish the result for autoregressive language models generally. (LLM, conf=0.84)

    Experimental — accuracy not yet measured

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

No references could be resolved yet.

Research works printed but not linked: 69

  1. Anderson, P., Fernando, B., Johnson, M., and Gould, S. Guided open vocabulary image captioning with constrained beam search. In Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing, EMNLP 2017, Copenhagen, Denmark, September 9-11, 2017 , pp. 936-945, 2017. doi: 10 . 18653/v1/ d17-1098. URL https://doi . org/10 . 18653/v1/ d17-1098 .
  2. Angelidis, S. and Lapata, M. Summarizing opinions: Aspect extraction meets sentiment prediction and they are both weakly supervised. In Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing , pp. 3675-3686, Brussels, Belgium, October-November 2018. Association for Computational Linguistics. URL https://www . aclweb . org/ anthology/D18-1403 .
  3. Artetxe, M., Labaka, G., Agirre, E., and Cho, K. Unsupervised neural machine translation. In 6th International Conference on Learning Representations, ICLR 2018, Vancouver, BC, Canada, April 30 - May 3, 2018, Conference Track Proceedings , 2018. URL https: //openreview . net/forum?id=Sy2ogebAW .
  4. Barrios, F., L´ opez, F., Argerich, L., and Wachenchauzer, R. Variations of the similarity function of textrank for automated summarization. CoRR , abs/1602.03606, 2016. URL http://arxiv . org/abs/1602 . 03606 . · arXiv
  5. Blei, D., Ng, A., and Jordan, M. Latent Dirichlet Allocation. Journal of Machine Learning Research , 3:993-1022, 2003. URL http://www . cs . princeton . edu/ ˜blei/lda-c/ .
  6. Brainskas, A., Lapata, M., and Titov, I. Unsupervised Multi-Document Opinion Summarization as CopycatReview Generation. arXiv:1911.02247 [cs, stat] , November 2019. URL http://arxiv . org/abs/ 1911 . 02247 . arXiv: 1911.02247. · arXiv
  7. Chen, Y., Li, V. O. K., Cho, K., and Bowman, S. R. A stable and effective learning strategy for trainable greedy decoding. In Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing, Brussels, Belgium, October 31 - November 4, 2018 , pp. 380-390, 2018. doi: 10 . 18653/v1/d18-1035. URL https://doi . org/10 . 18653/v1/d18-1035 .
  8. Chu, E. and Liu, P. J. Meansum: A neural model for unsupervised multi-document abstractive summarization. In Proceedings of the 36th International Conference on Machine Learning, ICML 2019, 9-15 June 2019, Long Beach, California, USA , pp. 1223-1232, 2019. URL http:// proceedings . mlr . press/v97/chu19b . html .
  9. Coavoux, M., Elsahar, H., and Gall´ e, M. Unsupervised aspect-based multi-document abstractive summarization. In Proceedings of the 2nd Workshop on New Frontiers in Summarization , pp. 42-47, Hong Kong, China, November 2019. Association for Computational Linguistics. doi: 10 . 18653/v1/D19-5405. URL https: //www . aclweb . org/anthology/D19-5405 .
  10. Cohan, A., Dernoncourt, F., Kim, D. S., Bui, T., Kim, S., Chang, W., and Goharian, N. A discourse-aware attention model for abstractive summarization of long documents. arXiv preprint arXiv:1804.05685 , 2018. · arXiv
  11. Dathathri, S., Madotto, A., Lan, J., Hung, J., Frank, E., Molino, P., Yosinski, J., and Liu, R. Plug and play language models: a simple approach to controlled text generation. arXiv preprint arXiv:1912.02164 , 2019. · arXiv
  12. Devlin, J., Chang, M.-W., Lee, K., and Toutanova, K. BERT: Pre-training of deep bidirectional transformers for language understanding. In Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers) , pp. 4171-4186, Minneapolis, Minnesota, June 2019. Association for Computational Linguistics. doi: 10 . 18653/ v1/N19-1423. URL https://www . aclweb . org/ anthology/N19-1423 .
  13. Drozdov, A., Verga, P., Yadav, M., Iyyer, M., and McCallum, A. Unsupervised latent tree induction with deep inside-outside recursive autoencoders. arXiv preprint arXiv:1904.02142 , 2019. · arXiv
  14. ElSahar, H. and El-Beltagy, S. R. Building large arabic multi-domain resources for sentiment analysis. In Computational Linguistics and Intelligent Text Processing - 16th International Conference, CICLing 2015, Cairo, Egypt, April 14-20, 2015, Proceedings, Part II , pp. 23-34, 2015. doi: 10 . 1007/978-3-319-18117-2 \ 2. URL https: //doi . org/10 . 1007/978-3-319-18117-2 2 .
  15. ElSahar, H., Gravier, C., and Laforest, F. Zero-shot question generation from knowledge graphs for unseen predicates and entity types. In Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, NAACL-HLT 2018, New Orleans, Louisiana, USA, June 1-6, 2018, Volume 1 (Long Papers) , pp. 218-228, 2018. doi: 10 . 18653/v1/n18-1020. URL https://doi . org/10 . 18653/v1/n18-1020 .
  16. Erkan, G. and Radev, D. R. LexRank: Graph-based lexical centrality as salience in text summarization. Journal of Artificial Intelligence Research , 22(1):457-479, December 2004. ISSN 1076-9757. URL http://dl . acm . org/ citation . cfm?id=1622487 . 1622501 .
  17. Falke, T., Ribeiro, L. F., Utama, P. A., Dagan, I., and Gurevych, I. Ranking generated summaries by correctness: An interesting but challenging application for natural language inference. In Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics , pp. 2214-2220, 2019.
  18. Fan, A., Grangier, D., and Auli, M. Controllable abstractive summarization. arXiv preprint arXiv:1711.05217 , 2017. · arXiv
  19. Fan, R.-E., Chang, K.-W., Hsieh, C.-J., Wang, X.-R., and Lin, C.-J. Liblinear: A library for large linear classification. Journal of machine learning research , 9(Aug): 1871-1874, 2008.
  20. Ganesan, K., Zhai, C., and Han, J. Opinosis: A graph based approach to abstractive summarization of highly redundant opinions. In Proceedings of the 23rd International Conference on Computational Linguistics (Coling 2010) , pp. 340-348, Beijing, China, August 2010. Coling 2010 Organizing Committee. URL https: //www . aclweb . org/anthology/C10-1039 .
  21. Gholipour Ghalandari, D. Revisiting the centroid-based method: A strong baseline for multi-document summarization. In Proceedings of the Workshop on New Frontiers in Summarization , pp. 85-90, Copenhagen, Denmark, September 2017. Association for Computational Linguistics. doi: 10 . 18653/v1/W17-4511. URL https: //www . aclweb . org/anthology/W17-4511 .
  22. He, R., Lee, W. S., Ng, H. T., and Dahlmeier, D. An unsupervised neural attention model for aspect extraction. In Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) , pp. 388-397, Vancouver, Canada, July 2017. Association for Computational Linguistics. doi: 10 . 18653/ v1/P17-1036. URL https://www . aclweb . org/ anthology/P17-1036 .
  23. Hokamp, C. and Liu, Q. Lexically constrained decoding for sequence generation using grid beam search. In Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics, ACL 2017, Vancouver, Canada, July 30 - August 4, Volume 1: Long Papers , pp. 1535-1546, 2017. doi: 10 . 18653/v1/P17-1141. URL https://doi . org/10 . 18653/v1/P17-1141 .
  24. Holtzman, A., Buys, J., Forbes, M., Bosselut, A., Golub, D., and Choi, Y. Learning to write with cooperative discriminators. In Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) , pp. 1638-1649, Melbourne, Australia, July 2018. Association for Computational Linguistics. doi: 10 . 18653/v1/P18-1152. URL https: //www . aclweb . org/anthology/P18-1152 .
  25. Jang, E., Gu, S., and Poole, B. Categorical reparameterization with gumbel-softmax. In 5th International Conference on Learning Representations, ICLR 2017, Toulon, France, April 24-26, 2017, Conference Track Proceedings , 2017. URL https://openreview . net/ forum?id=rkE3y85ee .
  26. Junczys-Dowmunt, M. Microsoft translator at WMT 2019: Towards large-scale document-level neural machine translation. In Proceedings of the Fourth Conference on
  27. Machine Translation, WMT 2019, Florence, Italy, August 1-2, 2019 - Volume 2: Shared Task Papers, Day 1 , pp. 225-233, 2019. doi: 10 . 18653/v1/w19-5321. URL https://doi . org/10 . 18653/v1/w19-5321 .
  28. Keskar, N. S., McCann, B., Varshney, L. R., Xiong, C., and Socher, R. CTRL: A conditional transformer language model for controllable generation. CoRR , abs/1909.05858, 2019. URL http://arxiv . org/ abs/1909 . 05858 . · arXiv
  29. Kryscinski, W., Keskar, N. S., McCann, B., Xiong, C., and Socher, R. Neural text summarization: A critical evaluation. In Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP) , pp. 540-551, 2019.
  30. Kudo, T. and Richardson, J. Sentencepiece: A simple and language independent subword tokenizer and detokenizer for neural text processing. In Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing, EMNLP 2018: System Demonstrations, Brussels, Belgium, October 31 - November 4, 2018 , pp. 66-71, 2018. doi: 10 . 18653/v1/d18-2012. URL https://doi . org/10 . 18653/v1/d18-2012 .
  31. Lample, G., Conneau, A., Denoyer, L., and Ranzato, M. Unsupervised machine translation using monolingual corpora only. In 6th International Conference on Learning Representations, ICLR 2018, Vancouver, BC, Canada, April 30 - May 3, 2018, Conference Track Proceedings , 2018. URL https://openreview . net/ forum?id=rkYTTf-AZ .
  32. Lewis, P., Denoyer, L., and Riedel, S. Unsupervised question answering by cloze translation. arXiv preprint arXiv:1906.04980 , 2019. · arXiv
  33. Li, J., Galley, M., Brockett, C., Gao, J., and Dolan, B. A diversity-promoting objective function for neural conversation models. In Proceedings of the 2016 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies , pp. 110-119, San Diego, California, June 2016a. Association for Computational Linguistics. doi: 10 . 18653/v1/N16-1014. URL https: //www . aclweb . org/anthology/N16-1014 .
  34. Li, J., Monroe, W., Ritter, A., Jurafsky, D., Galley, M., and Gao, J. Deep reinforcement learning for dialogue generation. In Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing, EMNLP 2016, Austin, Texas, USA, November 1-4, 2016 , pp. 1192-1202, 2016b. doi: 10 . 18653/v1/d16-1127. URL https://doi . org/10 . 18653/v1/d16-1127 .
  35. Libovick´ y, J., Helcl, J., and Marecek, D. Input combination strategies for multi-source transformer decoder. In Proceedings of the Third Conference on Machine Translation: Research Papers, WMT 2018, Belgium, Brussels, October 31 - November 1, 2018 , pp. 253-260, 2018. doi: 10 . 18653/v1/w18-6326. URL https: //doi . org/10 . 18653/v1/w18-6326 .
  36. Lin, C.-Y. ROUGE: A package for automatic evaluation of summaries. In Text Summarization Branches Out , pp. 74-81, Barcelona, Spain, July 2004. Association for Computational Linguistics. URL https: //www . aclweb . org/anthology/W04-1013 .
  37. Liu, S., Zhu, Z., Ye, N., Guadarrama, S., and Murphy, K. Improved image captioning via policy gradient optimization of spider. In Proceedings of the IEEE international conference on computer vision , pp. 873-881, 2017.
  38. Liu, Y. and Lapata, M. Hierarchical transformers for multidocument summarization. In Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics , pp. 5070-5081, Florence, Italy, July 2019. Association for Computational Linguistics. doi: 10 . 18653/ v1/P19-1500. URL https://www . aclweb . org/ anthology/P19-1500 .
  39. Luong, T., Sutskever, I., Le, Q. V ., Vinyals, O., and Zaremba, W. Addressing the rare word problem in neural machine translation. In Proceedings of the 53rd Annual Meeting of the Association for Computational Linguistics and the 7th International Joint Conference on Natural Language Processing of the Asian Federation of Natural Language Processing, ACL 2015, July 26-31, 2015, Beijing, China, Volume 1: Long Papers , pp. 1119, 2015. doi: 10 . 3115/v1/p15-1002. URL https: //doi . org/10 . 3115/v1/p15-1002 .
  40. Mihalcea, R. and Tarau, P. TextRank: Bringing order into text. In Proceedings of EMNLP 2004 , pp. 404-411, Barcelona, Spain, July 2004. Association for Computational Linguistics. URL https://www . aclweb . org/ anthology/W04-3252 .
  41. Nabil, M., Aly, M., and Atiya, A. Labr: A large scale arabic sentiment analysis benchmark. arXiv preprint arXiv:1411.6718 , 2014. · arXiv
  42. Nayeem, M. T., Fuad, T. A., and Chali, Y. Abstractive unsupervised multi-document summarization using paraphrastic sentence fusion. In Proceedings of the 27th International Conference on Computational Linguistics , pp. 1191-1204, Santa Fe, New Mexico, USA, August 2018. Association for Computational Linguistics. URL https: //www . aclweb . org/anthology/C18-1102 .
  43. Ng, A. Y. Feature selection, l 1 vs. l 2 regularization, and rotational invariance. In Proceedings of the twenty-first international conference on Machine learning , pp. 78, 2004.
  44. Ott, M., Edunov, S., Baevski, A., Fan, A., Gross, S., Ng, N., Grangier, D., and Auli, M. fairseq: A fast, extensible toolkit for sequence modeling. In Proceedings of NAACLHLT 2019: Demonstrations , 2019.
  45. Paszke, A., Gross, S., Massa, F., Lerer, A., Bradbury, J., Chanan, G., Killeen, T., Lin, Z., Gimelshein, N., Antiga, L., Desmaison, A., Kopf, A., Yang, E., DeVito, Z., Raison, M., Tejani, A., Chilamkurthy, S., Steiner, B., Fang, L., Bai, J., and Chintala, S. Pytorch: An imperative style, high-performance deep learning library. In Wallach, H., Larochelle, H., Beygelzimer, A., d' Alch´ e-Buc, F., Fox, E., and Garnett, R. (eds.), Advances in Neural Information Processing Systems 32 , pp. 8024-8035. Curran Associates, Inc., 2019. URL http://papers . nips . cc/paper/9015pytorch-an-imperative-style-highperformance-deep-learning-library . pdf .
  46. Pedregosa, F., Varoquaux, G., Gramfort, A., Michel, V., Thirion, B., Grisel, O., Blondel, M., Prettenhofer, P., Weiss, R., Dubourg, V., Vanderplas, J., Passos, A., Cournapeau, D., Brucher, M., Perrot, M., and Duchesnay, E. Scikit-learn: Machine learning in Python. Journal of Machine Learning Research , 12:2825-2830, 2011a.
  47. Pedregosa, F., Varoquaux, G., Gramfort, A., Michel, V., Thirion, B., Grisel, O., Blondel, M., Prettenhofer, P., Weiss, R., Dubourg, V., et al. Scikit-learn: Machine learning in python. Journal of machine learning research , 12(Oct):2825-2830, 2011b.
  48. Peyrard, M. A Simple Theoretical Model of Importance for Summarization. In Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics , pp. 1059-1073, Florence, Italy, July 2019. Association for Computational Linguistics. doi: 10 . 18653/ v1/P19-1101. URL https://www . aclweb . org/ anthology/P19-1101 .
  49. Post, M. and Vilar, D. Fast lexically constrained decoding with dynamic beam allocation for neural machine translation. In Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, NAACL-HLT 2018, New Orleans, Louisiana, USA, June 1-6, 2018, Volume 1 (Long Papers) , pp. 1314-1324, 2018. doi: 10 . 18653/v1/n18-1119. URL https://doi . org/10 . 18653/v1/n18-1119 .
  50. Radev, D. R., Jing, H., Sty, M., and Tam, D. Centroid-based summarization of multiple docu- ments. Information Processing and Management , 40(6):919 -938, 2004. ISSN 0306-4573. doi: https://doi . org/10 . 1016/j . ipm . 2003 . 10 . 006. URL http://www . sciencedirect . com/science/ article/pii/S0306457303000955 .
  51. Ramos, J. et al. Using tf-idf to determine word relevance in document queries. In Proceedings of the first instructional conference on machine learning , volume 242, pp. 133142. Piscataway, NJ, 2003.
  52. Ranzato, M., Chopra, S., Auli, M., and Zaremba, W. Sequence level training with recurrent neural networks. In 4th International Conference on Learning Representations, ICLR 2016, San Juan, Puerto Rico, May 24, 2016, Conference Track Proceedings , 2016. URL http://arxiv . org/abs/1511 . 06732 .
  53. Rohrbach, A., Hendricks, L. A., Burns, K., Darrell, T., and Saenko, K. Object hallucination in image captioning. In Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing , pp. 40354045, Brussels, Belgium, October-November 2018. Association for Computational Linguistics. doi: 10 . 18653/ v1/D18-1437. URL https://www . aclweb . org/ anthology/D18-1437 .
  54. Rossiello, G., Basile, P., and Semeraro, G. Centroid-based text summarization through compositionality of word embeddings. In Proceedings of the MultiLing 2017 Workshop on Summarization and Summary Evaluation Across Source Types and Genres , pp. 12-21, Valencia, Spain, April 2017. Association for Computational Linguistics. doi: 10 . 18653/v1/W17-1003. URL https: //www . aclweb . org/anthology/W17-1003 .
  55. See, A., Roller, S., Kiela, D., and Weston, J. What makes a good conversation? how controllable attributes affect human judgments. In Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, NAACL-HLT 2019, Minneapolis, MN, USA, June 2-7, 2019, Volume 1 (Long and Short Papers) , pp. 1702-1723, 2019. doi: 10 . 18653/v1/n19-1170. URL https://doi . org/10 . 18653/v1/n19-1170 .
  56. Tibshirani, R. Regression shrinkage and selection via the lasso. Journal of the Royal Statistical Society: Series B (Methodological) , 58(1):267-288, 1996.
  57. Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., Kaiser, Ł., and Polosukhin, I. Attention is all you need. In Advances in neural information processing systems , pp. 5998-6008, 2017.
  58. Wang, L. and Ling, W. Neural network-based abstract generation for opinions and arguments. In Proceedings of the 2016 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies , pp. 47-57, San Diego, California, June 2016. Association for Computational Linguistics. doi: 10 . 18653/v1/N16-1007. URL https: //www . aclweb . org/anthology/N16-1007 .
  59. West, P., Holtzman, A., Buys, J., and Choi, Y. BottleSum: Unsupervised and self-supervised sentence summarization using the information bottleneck principle. In Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP) , pp. 3750-3759, Hong Kong, China, November 2019. Association for Computational Linguistics. doi: 10 . 18653/v1/D19-1389. URL https: //www . aclweb . org/anthology/D19-1389 .
  60. Williams, R. J. Simple statistical gradient-following algorithms for connectionist reinforcement learning. Machine learning , 8(3-4):229-256, 1992.
  61. Wu, L., Xia, Y., Tian, F., Zhao, L., Qin, T., Lai, J., and Liu, T. Adversarial neural machine translation. In Proceedings of The 10th Asian Conference on Machine Learning, ACML 2018, Beijing, China, November 14-16, 2018 , pp. 534-549, 2018. URL http: //proceedings . mlr . press/v95/wu18a . html .
  62. Wu, Y., Schuster, M., Chen, Z., Le, Q. V., Norouzi, M., Macherey, W., Krikun, M., Cao, Y., Gao, Q., Macherey, K., Klingner, J., Shah, A., Johnson, M., Liu, X., Kaiser, L., Gouws, S., Kato, Y., Kudo, T., Kazawa, H., Stevens, K., Kurian, G., Patil, N., Wang, W., Young, C., Smith, J., Riesa, J., Rudnick, A., Vinyals, O., Corrado, G., Hughes, M., and Dean, J. Google's neural machine translation system: Bridging the gap between human and machine translation. CoRR , abs/1609.08144, 2016. URL http: //arxiv . org/abs/1609 . 08144 . · arXiv
  63. Yang, Z., Hu, Z., Dyer, C., Xing, E. P., and Berg-Kirkpatrick, T. Unsupervised text style transfer using language models as discriminators. In Advances in Neural Information Processing Systems 31: Annual Conference on Neural Information Processing Systems 2018, NeurIPS 2018, 3-8 December 2018, Montr´ eal, Canada , pp. 7298-7309, 2018. URL http://papers . nips . cc/ paper/7959-unsupervised-text-styletransfer-using-language-models-asdiscriminators .
  64. In Advances in Neural Information Processing Systems 31: Annual Conference on Neural Information Processing Systems 2018, NeurIPS 2018, 3-8 December 2018, Montr´ eal, Canada , pp. 1039-1050, 2018. URL https://papers . nips . cc/paper/7381neural-symbolic-vqa-disentanglingreasoning-from-vision-and-languageunderstanding .
  65. Yuan, L., Tay, F. E., Li, P., Zhou, L., and Feng, J. Cyclesum: cycle-consistent adversarial lstm networks for unsupervised video summarization. In Proceedings of the AAAI Conference on Artificial Intelligence , volume 33, pp. 9143-9150, 2019.
  66. Zellers, R., Holtzman, A., Rashkin, H., Bisk, Y., Farhadi, A., Roesner, F., and Choi, Y. Defending against neural fake news. In Advances in Neural Information Processing Systems , pp. 9051-9062, 2019.
  67. Zhang, J., Zhao, Y., Saleh, M., and Liu, P. J. Pegasus: Pre-training with extracted gap-sentences for abstractive summarization. arXiv preprint arXiv:1912.08777 , 2019. · arXiv
  68. Zhang, T., Kishore, V., Wu, F., Weinberger, K. Q., and Artzi, Y. Bertscore: Evaluating text generation with bert. In International Conference on Learning Representations , 2020. URL https://openreview . net/ forum?id=SkeHuCVFDr .
  69. Zheng, H. and Lapata, M. Sentence centrality revisited for unsupervised summarization. In Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics , pp. 6236-6247, Florence, Italy, July 2019. Association for Computational Linguistics. doi: 10 . 18653/v1/P19-1628.

Cited by

Sorted by citations

Authors
Elsahar, H., Coavoux, M., Gallé, M., & Rozen, J.
Affiliations
Institut polytechnique de Grenoble (FR)
ORCID
Venue
arXiv
Publisher
arXiv
Published
2020
Pages
1646-1662
DOI
10.48550/arxiv.2004.14754
arXiv
2004.14754
OpenAlex
W3020873268
Cited by
40
References
0
Citations by year
2026: 1 · 2025: 3 · 2024: 5 · 2023: 12 · 2022: 9 · 2021: 7 · 2020: 3
FWCI
3.80
Type
conference paper
Language
en
Open access
Licence
Locations
  • Conference of the European Chapter of the Association for Computational Linguistics (publishedVersion, cc-by)
  • arXiv (Cornell University) (submittedVersion)
  • HAL (submittedVersion, cc-by-nc-nd)
  • arXiv (Cornell University)
Topics
  • Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
  • Physical Sciences › Computer Science › Artificial Intelligence › Sentiment Analysis and Opinion Mining
  • Physical Sciences › Computer Science › Artificial Intelligence › Advanced Text Analysis Techniques
Keywords
multi-document summarization, abstractive summarization, self-supervised learning, control codes, hallucination mitigation, user-generated reviews, faithfulness, topic alignment

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review