[PDF] Top 20 Neural Network Based Bilingual Language Model Growing for Statistical Machine Translation

... n-gram Language Model (LM) usually performs better in Statistical Machine Translation (SMT), how to con- struct efficient large LM is an important topic in ...LM growing methods ... See full document

... the bilingual pivoting approach from the perspective of neural machine translation, a new approach to machine transla- tion based purely on neural networks (Kalchbren- ner ... See full document

... time based on L1-specific ESL learner ...a bilingual L1-L2 corpus, to obtain L2 paraphrases, which are likely to be translated to the same phrase in ...the machine translation ap- proach, ... See full document

... Neural machine translation (NMT) is a new ap- proach to machine translation that has shown promising results compared to the existing ap- proaches such as phrase-based ... See full document

... In statistical machine translation, reordering model is concerned with predicting correct orders of tar- get language sentence given a source language one and translation ... See full document

... models based on bilingual clustering for sta- tistical machine ...specific translation must be performed simultaneously dur- ing the translation ...a bilingual corpus was ... See full document

... to Statistical Machine Translation (SMT) to learn several components or features of conventional framework, includ- ing word alignment, language modelling, transla- tion modelling and ... See full document

... Another approach is using restricted Boltzmann machines (RBMs) (Niehues and Waibel, 2012) instead of using multi-layer neural networks (Bengio et al., 2003; Schwenk, 2007; Le et al., 2011). Since probability in a ... See full document

... trigram model in machine translation, Ding and Palmer (2005) use n-gram rule Markov model in the dependency treelet model, Liu and Gildea (2008) applies the same method in a tree-to- ... See full document

... log-linear model (Gimpel and Smith, 2008; Chiang et al, 2009); predicting co- herent sets of target words rather than individual phrase translations (Bangalore et al, 2009; Maus- er et al, 2009); and selecting ... See full document

... different model architectures includ- ing LSTM and Transformer, their improvements are not made over the best performed baseline model ...the-art translation performance with larger model ... See full document

... into language models in several ...decomposition based on a segmented training corpus. They es- timate unigram topic-based probability and com- bine it with standard n-gram ...topic model for ... See full document

... of neural network train- ing based on word-aligned ...training neural networks. Thus the heuristic- based approaches (Sundermeyer et ...the neural network-based HMM ... See full document

... phrasal translation and equips itself with a maximum entropy based reordering model (Xiong et ...our bilingual training data which consists of 3.84M bilingual sentences, ...5-gram ... See full document

... syntactic language model, structured LM (SLM) (Chelba and Jelinek, 2000), that we extend to a bilingual setting and apply to SMT in Sec- tion ...syntactic language models define sentence ... See full document

... gual tokens and we adopt this terminology. There are alternative definitions of bilingual language models. Our choice of the above defi- nition is supported by the fact that it produces an unambiguous ... See full document

... German-Czech language pair are built based on the previously proposed unsupervised MT sys- tems, with some adaptations made to accom- modate the morphologically rich characteristics of German and Czech ... See full document

... (REF), translation from BSL, and that from the BSC sys- ...BSC model was able to generate a better ...correct translation of “备战” should be “prepare for”, where neither side conveys sen- ...literal ... See full document

... M based cross-lingual data selection for LM adap- tation. This model learns the transform probabili- ty of a multi-term phrase in a source sentence giv- en a phrase in the target sentence of LM training ... See full document

... the translation model causes words to be inserted ...a translation may not be directly generated from a word in the original ...one language may have no equivalent in the other ... See full document