Student or educator? Sign up with your school email and get 6 months of Pro free.
CoChat
Sign Up
PreprintCited by 2

The DOI matches its DataCite record; 8 of the 8 references it cites were found in a registry or an index.

AQuaMuSe: Automatically Generating Datasets for Query-Based Multi-Document Summarization

Kulkarni, Sayali, Chammas, Sheide, Zhu, Wan, Sha, Fei, Ie, Eugene·2020·arXiv
DOI 10.48550/arxiv.2010.12694arXiv 2010.12694
Open this paper in CoChat — free account

Abstract

Summarization is the task of compressing source document(s) into coherent and succinct passages. This is a valuable tool to present users with concise and accurate sketch of the top ranked documents related to their queries. Query-based multi-document summarization (qMDS) addresses this pervasive need, but the research is severely limited due to lack of training and evaluation datasets as existing single-document and multi-document summarization datasets are inadequate in form and scale. We propose a scalable approach called AQuaMuSe to automatically mine qMDS examples from question answering datasets and large document corpora. Our approach is unique in the sense that it can general a dual dataset -- for extractive and abstractive summaries both. We publicly release a specific instance of an AQuaMuSe dataset with 5,519 query-based summaries, each associated with an average of 6 input documents selected from an index of 355M documents from Common Crawl. Extensive evaluation of the dataset along with baseline summarization model experiments are provided.

Overview

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

DataCite · 10.48550/arxiv.2010.12694

Cites

8 of 8 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 8 references

Research works printed but not linked: 27

  1. Tal Baumel, Matan Eyal, and Michael Elhadad. 2018a. Query focused abstractive summarization: Incorpo- rating query relevance, multi-document coverage, and summary length constraints into seq2seq mod- els. CoRR, abs/1801.07704. · arXiv
  2. Tal Baumel, Matan Eyal, and Michael Elhadad. 2018b. Query focused abstractive summarization: Incorpo- rating query relevance, multi-document coverage, and summary length constraints into seq2seq mod- els. CoRR, abs/1801.07704. · arXiv
  3. Jaime G Carbonell and Jade Goldstein. 1998. The use of mmr, diversity-based reranking for reordering documents and producing summaries. In SIGIR, vol- ume 98, pages 335-336.
  4. James Clarke and Mirella Lapata. 2010. Discourse con- straints for document compression. Computational Linguistics, 36(3):411-441. · DOI
  5. Hoa Trang Dang. 2006. Duc 2005: Evaluation of question-focused summarization systems. In Pro- ceedings of the Workshop on Task-Focused Summa- rization and Question Answering, SumQA '06, page 48-55, USA. Association for Computational Lin- guistics.
  6. Hal Daumé III and Daniel Marcu. 2006. Bayesian query-focused summarization. In Proceedings of the 21st International Conference on Computational Linguistics and 44th Annual Meeting of the Associa- tion for Computational Linguistics, pages 305-312, Sydney, Australia. Association for Computational Linguistics. · DOI
  7. Yang Deng, Wai Lam, Yuexiang Xie, Daoyuan Chen, Yaliang Li, Min Yang, and Ying Shen. 2020. Joint learning of answer selection and answer sum- mary generation in community question answering. AAAI.
  8. Elozino Egonmwan, Vittorio Castelli, and Md Arafat Sultan. 2019. Cross-task knowledge transfer for query-based text summarization. In Proceedings of the 2nd Workshop on Machine Reading for Question Answering, pages 72-77, Hong Kong, China. Asso- ciation for Computational Linguistics. · DOI
  9. Alexander R Fabbri, Irene Li, Tianwei She, Suyi Li, and Dragomir R Radev. 2019. Multi-news: a large- scale multi-document summarization dataset and ab- stractive hierarchical model. ACL.
  10. Max Grusky, Mor Naaman, and Yoav Artzi. 2018. Newsroom: A dataset of 1.3 million sum- maries with diverse extractive strategies. CoRR, abs/1804.11283. · arXiv
  11. Johan Hasselqvist, Niklas Helmertz, and Mikael Kågebäck. 2017. Query-based abstractive summarization using neural networks. CoRR, abs/1712.06100. · arXiv
  12. Karl Moritz Hermann, Tomas Kocisky, Edward Grefen- stette, Lasse Espeholt, Will Kay, Mustafa Suleyman, and Phil Blunsom. 2015a. Teaching machines to read and comprehend. In Advances in neural infor- mation processing systems, pages 1693-1701.
  13. Karl Moritz Hermann, Tomás Kociský, Edward Grefen- stette, Lasse Espeholt, Will Kay, Mustafa Suleyman, and Phil Blunsom. 2015b. Teaching machines to read and comprehend. CoRR, abs/1506.03340. · arXiv
  14. Mahnaz Koupaee and William Yang Wang. 2018. Wik- ihow: A large scale text summarization dataset. CoRR, abs/1810.09305. · arXiv
  15. Marina Litvak and Natalia Vanetik. 2017. Query-based summarization using MDL principle. In Proceed- ings of the MultiLing 2017 Workshop on Summariza- tion and Summary Evaluation Across Source Types and Genres, pages 22-31, Valencia, Spain. Associa- tion for Computational Linguistics. · DOI
  16. Peter J. Liu, Mohammad Saleh, Etienne Pot, Ben Goodrich, Ryan Sepassi, Lukasz Kaiser, and Noam Shazeer. 2018. Generating wikipedia by summariz- ing long sequences. CoRR, abs/1801.10198. · arXiv
  17. Ting Liu, Andrew W. Moore, Alexander G. Gray, and Ke Yang. 2004. An investigation of practical approx- imate nearest neighbor algorithms. In NIPS.
  18. Rada Mihalcea and Paul Tarau. 2004. TextRank: Bringing order into text. In Proceedings of the 2004 Conference on Empirical Methods in Natural Lan- guage Processing, pages 404-411, Barcelona, Spain. Association for Computational Linguistics.
  19. Preksha Nema, Mitesh M. Khapra, Anirban Laha, and Balaraman Ravindran. 2017. Diversity driven atten- tion model for query-based abstractive summariza- tion. In Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics, ACL 2017, Vancouver, Canada, July 30 -August 4, Vol- ume 1: Long Papers, pages 1063-1072. Association for Computational Linguistics. · DOI
  20. Jahna Otterbacher, Gunes Erkan, and Dragomir R. Radev. 2009. Biased LexRank: Passage retrieval us- ing random walks with question-based priors. Infor- mation Processing & Management, 45(1):42 -54. · DOI
  21. Alexander M Rush, Sumit Chopra, and Jason Weston. 2015. A neural attention model for abstractive sen- tence summarization. EMNLP.
  22. Frank Schilder and Ravikumar Kondadadi. 2008. Fast- sum: Fast and accurate query-based multi-document summarization. In Proceedings of the 46th Annual Meeting of the Association for Computational Lin- guistics on Human Language Technologies: Short Papers, HLT-Short '08, page 205-208, USA. Asso- ciation for Computational Linguistics.
  23. Hong Wang, Xin Wang, Wenhan Xiong, Mo Yu, Xi- aoxiao Guo, Shiyu Chang, and William Yang Wang. 2019. Self-supervised learning for contextualized extractive summarization. In Proceedings of the 57th Annual Meeting of the Association for Com- putational Linguistics, pages 2221-2227, Florence, Italy. Association for Computational Linguistics. · DOI
  24. Li Wang, Junlin Yao, Yunzhe Tao, Li Zhong, Wei Liu, and Qiang Du. 2018. A reinforced topic-aware con- volutional sequence-to-sequence model for abstrac- tive text summarization. CoRR, abs/1805.03616. · arXiv
  25. Lu Wang, Hema Raghavan, Vittorio Castelli, Radu Flo- rian, and Claire Cardie. 2016. A sentence com- pression based framework to query-focused multi- document summarization. CoRR, abs/1606.07548. · arXiv
  26. Jingqing Zhang, Yao Zhao, Mohammad Saleh, and Pe- ter J. Liu. 2019. Pegasus: Pre-training with ex- tracted gap-sentences for abstractive summarization. ArXiv, abs/1912.08777. · arXiv
  27. Qingyu Zhou, Nan Yang, Furu Wei, Shaohan Huang, Ming Zhou, and Tiejun Zhao. 2018. Neural doc- ument summarization by jointly learning to score and select sentences. In Proceedings of the 56th An- nual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 654- 663, Melbourne, Australia. Association for Compu- tational Linguistics. · DOI

Cited by

Metadata

Authors
Kulkarni, S., Chammas, S., Zhu, W., Sha, F., & Ie, E.
Venue
arXiv
Publisher
arXiv
Published
2020
DOI
10.48550/arxiv.2010.12694
arXiv
2010.12694
References
8
Type
Preprint
Licence
creativecommons.org/licenses/by-nc-sa/4.0/legalcode

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.