[PDF] Top 20 Improving Neural Machine Translation Robustness via Data Augmentation: Beyond Back Translation

... To explore the effect of other types of noise, we fine-tuned our baseline model on different external datasets (see the “Unconstrained" rows in Table 3 and 4). We experimented with human transcript and ... See full document

... that data augmentation does not introduce new words to the ...language data with Byte- pair encoding (BPE) (Sennrich et ...the augmentation exper- iments BPE is performed after data ... See full document

... While data augmentation is an important trick to boost the accuracy of deep learning meth- ods in computer vision tasks, its study in nat- ural language tasks is still very ...novel data augmen- ... See full document

... Many Data Augmentation (DA) methods have been proposed for neural machine ...four translation tasks are achieved regarding both ... See full document

... training data, we tried four kinds of combinations shown in Table ...For data augmentation and back translation is mutual exclusion, we trained different models and did ensemble to ... See full document

... additional data did not con- tribute to the translation quality, which indicates that the data augmentation using back-translation was not ...lel data English sentences ... See full document

... — data augmentation by translating target monolingual data — is a crucial component in modern neural machine translation ...mulate back-translation in the scope of ... See full document

... as back- translation replacement for both language ...the translation performance over the development set ...clean data only ...noisy data seems to pro- vide no additional ...clean ... See full document

... While back-translation is simple and effec- tive in exploiting abundant monolingual cor- pora to improve low-resource neural machine translation (NMT), the synthetic bilingual cor- pora ... See full document

... results, via back-translation of monolingual target data into the source language, and treating this synthetic data as additional train- ing ...monolingual data, ... See full document

... phrase-based translation, but our sys- tem surpasses it (when both are trained on the same ...low-resource translation than before, and are optimistic that NMT’s repertoire will con- tinue to ... See full document

... Multilayer architectures are currently the gold standard for large-scale neural machine trans- lation. Existing works have explored some methods for understanding the hidden repre- sentations, however, they ... See full document

... training data is a major issue in the training of application-specific neural machine translation ...bilingual data collections is costly and often not ...in-domain data having ... See full document

... This is reasonable because the NLP-TEA-2 training data are extracted from essays written by high-level Chinese learners and, in most cases, these learners produce only one- or two-word- mistakes. By contrast, ... See full document

... for machine translation, Tu et ...the translation de- ...speech translation if the speech translation is based on both the input speech and its transcrip- ... See full document

... of machine translation, we are constantly training en- gines for a variety of uses, languages, and content ...training data available, and the quality re- quirements of the end ...of Neural MT ... See full document

... Machine Translation (MT) systems have been shown to exhibit severely degraded performance when required to translate of out-of-domain or noisy data (Luong and Manning, 2015; Sakaguchi et ...parallel ... See full document

... static data selection exper- iments in Section ...namic data selection performs using random selec- ...dynamic data selection—and in particular gradual fine-tuning—is still superior to static ... See full document

... The quality of the translation also depends on the professions from the Occupations test and its predicted gender. Again, the system has no prob- lem predicting the gender of professions in the context of “him”, ... See full document

... Although Machine Translation (MT) is a very active research field which is receiving an in- creasing amount of attention from the research community, the results that current MT sys- tems are capable of ... See full document