Cited by 30Topic ModelingAdvanced Text Analysis TechniquesNatural Language Processing Techniques

Abstractive summarization of long texts by representing multiple compositionalities with temporal hierarchical pointer generator network

Moirangthem, Dennis Singh, Lee, Minho·2020·Neural Networks

Abstract

In order to tackle the problem of abstractive summarization of long multi-sentence texts, it is critical to construct an efficient model, which can learn and represent multiple compositionalities better. In this paper, we introduce a temporal hierarchical pointer generator network that can represent multiple compositionalities in order to handle longer sequences of texts with a deep structure. We demonstrate how a multilayer gated recurrent neural network organizes itself with the help of an adaptive timescale in order to represent the compositions. The temporal hierarchical network is implemented with a multiple timescale architecture where the timescale of each layer is also learned during the training process through error backpropagation through time. We evaluate our proposed model using an Introduction-Abstract summarization dataset from scientific articles and the CNN/Daily Mail summarization benchmark dataset. The results illustrate that, we successfully implement a summary generation system for long texts by using the multiple timescale with adaptation concept. We also show that we have improved the summary generation system with our proposed model on the benchmark dataset.

Integrity signals

Registry

Crossref · 10.1016/j.neunet.2019.12.022

Cites

60 of 60 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Claims the paper makes

This paper’s full text isn’t openly available, so its claims and self-check weren’t run. The registry and citation checks still apply.

Cites

Flagged first, then by citations

Cited by

Sorted by citations

Authors
Moirangthem, D. S., & Lee, M.
Affiliations
Kyungpook National University (KR)
Corresponding author
Lee, Minho
Venue
Neural Networks
Publisher
Elsevier BV
Published
2020-04
Volume
124
Pages
1-11
ISSN
0893-6080 (ISSN-L)
OpenAlex
W2998517938
Cited by
30
References
60
Citations by year
2026: 1 · 2025: 3 · 2024: 10 · 2023: 8 · 2022: 2 · 2021: 5 · 2020: 1
Type
conference abstract
Language
en
Open access
closed
Locations
  • Neural Networks (publishedVersion)
  • PubMed (publishedVersion)
Funders
  • Institute for Information and Communications Technology Promotion (IITP)
  • Ministry of Trade, Industry and Energy
  • Ministry of Science and ICT, South Korea (10073162, 2016-0-00564)
Topics
  • Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
  • Physical Sciences › Computer Science › Artificial Intelligence › Advanced Text Analysis Techniques
  • Physical Sciences › Computer Science › Artificial Intelligence › Natural Language Processing Techniques
Keywords
abstractive summarization, long text summarization, pointer-generator network, gated recurrent neural networks, backpropagation through time, CNN/DailyMail
MeSH terms
Machine Learning, Periodicals as Topic, Word Processing

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review