[PDF] Top 20 Attention Optimization for Abstractive Document Summarization

... 3.3 Human Evaluation and Case Study We also conduct human evaluation on the gen- erated summaries. Similar to the previous work (Chen and Bansal, 2018; Nallapati et al., 2017), we randomly select 100 samples from the ... See full document

... input document along with the corresponding ground-truth summary y, the model is trained to output a summary y ˆ that is close to ...and summarization (Nallapati et ...The attention mechanism maps ... See full document

... In document summarization, information com- pression and information coverage are the two most important structural ...of document and sum- mary, they can be realized at the sentence- level as: (1) ... See full document

... generate abstractive summary based on Abstract Meaning Represen- tation (AMR) (Liu et ...recent abstractive summarization meth- od generates new sentences by selecting and merging phrases from the ... See full document

... Abstractive summarization aims to gen- erate a shorter version of the document covering all the salient points in a com- pact and coherent ...query-based summarization high- lights those ... See full document

... original document, the performance is limited by the model’s ability of generating a long output ...the abstractive document summarization ...original document, and at this time the ... See full document

... F1 scores over all of the other baselines (reported in their own articles) and two extensions we pro- posed both improve the performances based on the basic model. Concretely, we design the focus- attention ... See full document

... exploring more fine-grained syntactic units than sentences, namely, noun/verb phrases (NPs/VPs). This idea is based on two observations. First, the major constituent phrases loosely correspond to the concepts and facts. ... See full document

... and Optimization All the CNN models use a 50000 words article dictio- nary and 20000 words summary dictionary with byte pair encoding (BPE) (Sennrich et ... See full document

... the abstractive system. However, we also note that the abstractive system requires access to the full source ...to abstractive models showed a drastic decrease in model ...source document ... See full document

... In this paper, we evaluate our proposed method on three abstractive text summarization benchmark datasets. First, we use the annotated Gigaword corpus and preprocess it identically to Rush et al. (2015), ... See full document

... as document summariza- tion. We propose a novel coarse-to-fine attention model that hierarchically reads a document, using coarse attention to select top-level chunks of text and fine ... See full document

... extractive summarization of categorized ...extractive summarization is performed on each text of each ...of summarization is evaluated using human generated summary and is ...and summarization ... See full document

... the document clus- ter can be crucial for determining sentence redun- dancy, because sentences sharing the same topi- cal words are more likely to be considered redun- ... See full document

... We have already described the differences be- tween TLS and MDS and the limited direct appli- cability of MDS systems to TLS in Section 2.2. However, our methodology is inspired by the MDS system of Banerjee et al. ... See full document

... automatic summarization, centrality is the notion that a summary should contain the core parts of the source ...how summarization can advance past this paradigm towards robust abstraction by making greater ... See full document

... pared to 37.73 F1-R OUGE 1 of the baseline in Table 1). Our baseline always presents the full summary, re- gardless of the portion of the article presented as input. It achieves an F1-R OUGE 1 score of 28.12. Among our ... See full document

... FAIRSEQ is an open-source sequence model- ing toolkit that allows researchers and devel- opers to train custom models for translation, summarization, language modeling, and other text generation tasks. The toolkit ... See full document

... Indicative Summarization is applied for quickly viewing a long ...full document or ...the document, methodology used in the document, purpose of the document ... See full document

... As our CGU is responsible for selecting impor- tant information of the outputs from the RNN en- coder to improve the quality of the attention score, it should be able to reduce repetition in the gen- erated ... See full document