Geodesic
Variational Neural Decoder for Abstractive Text Summarization
Computer Science and Information Systems, Tome 17 (2020) no. 2.

Voir la notice de l'article provenant de la source Computer Science and Information Systems website

In the conventional sequence-to-sequence (seq2seq) model for abstractive summarization, the internal transformation structure of recurrent neural networks (RNNs) is completely determined. Therefore, the learned semantic information is far from enough to represent all semantic details and context dependencies, resulting in a redundant summary and poor consistency. In this paper, we propose a variational neural decoder text summarization model (VND). The model introduces a series of implicit variables by combining variational RNN and variational autoencoder, which is used to capture complex semantic representation at each step of decoding. It includes a standard RNN layer and a variational RNN layer [5]. These two network layers respectively generate a deterministic hidden state and a random hidden state. We use these two RNN layers to establish the dependence between implicit variables between adjacent time steps. In this way, the model structure can better capture the complex semantics and the strong dependence between the adjacent time steps when outputting the summary, thereby improving the performance of generating the summary. The experimental results show that, on the text summary LCSTS and English Gigaword dataset, our model has a significant improvement over the baseline model.
Keywords: abstractive summarization, sequence-to-sequence, variational auto-encoder, variation neural inferer 
@article{CSIS_2020_17_2_a9,
     author = {Huan Zhao and Jie Cao and Mingquan Xu and Jian Lu},
     title = {Variational {Neural} {Decoder} for {Abstractive} {Text} {Summarization}},
     journal = {Computer Science and Information Systems},
     publisher = {mathdoc},
     volume = {17},
     number = {2},
     year = {2020},
     url = {http://geodesic.mathdoc.fr/item/CSIS_2020_17_2_a9/}
}
TY  - JOUR
AU  - Huan Zhao
AU  - Jie Cao
AU  - Mingquan Xu
AU  - Jian Lu
TI  - Variational Neural Decoder for Abstractive Text Summarization
JO  - Computer Science and Information Systems
PY  - 2020
VL  - 17
IS  - 2
PB  - mathdoc
UR  - http://geodesic.mathdoc.fr/item/CSIS_2020_17_2_a9/
ID  - CSIS_2020_17_2_a9
ER  - 
%0 Journal Article
%A Huan Zhao
%A Jie Cao
%A Mingquan Xu
%A Jian Lu
%T Variational Neural Decoder for Abstractive Text Summarization
%J Computer Science and Information Systems
%D 2020
%V 17
%N 2
%I mathdoc
%U http://geodesic.mathdoc.fr/item/CSIS_2020_17_2_a9/
%F CSIS_2020_17_2_a9
Huan Zhao; Jie Cao; Mingquan Xu; Jian Lu. Variational Neural Decoder for Abstractive Text Summarization. Computer Science and Information Systems, Tome 17 (2020) no. 2. http://geodesic.mathdoc.fr/item/CSIS_2020_17_2_a9/