Timezone: »
Poster
Sequence Modeling with Unconstrained Generation Order
Dmitrii Emelianenko · Elena Voita · Pavel Serdyukov
Wed Dec 11 10:45 AM -- 12:45 PM (PST) @ East Exhibition Hall B + C #121
The dominant approach to sequence generation is to produce a sequence in some predefined order, e.g. left to right. In contrast, we propose a more general model that can generate the output sequence by inserting tokens in any arbitrary order. Our model learns decoding order as a result of its training procedure. Our experiments show that this model is superior to fixed order models on a number of sequence generation tasks, such as Machine Translation, Image-to-LaTeX and Image Captioning.
Author Information
Dmitrii Emelianenko (Yandex; National Research University Higher School of Economics)
Elena Voita (Yandex; University of Amsterdam)
Pavel Serdyukov (Yandex)
More from the Same Authors
-
2016 Poster: Efficient High-Order Interaction-Aware Feature Selection Based on Conditional Mutual Information »
Alexander Shishkin · Anastasia Bezzubtseva · Alexey Drutsa · Ilia Shishkov · Ekaterina Gladkikh · Gleb Gusev · Pavel Serdyukov -
2015 Workshop: Applying (machine) Learning to Experimental Physics (ALEPH) and «Flavours of Physics» challenge »
Pavel Serdyukov · Andrey Ustyuzhanin · Marcin Chrząszcz · Francesco Dettori · Marc-Olivier Bettler