[PDF] Top 20 Decoding complexity in word replacement translation models

... The general architecture is the source-channel model: an English string is statistically generated source, then statistically transformed into French channel.. In order to translate or "[r] ... See full document

... that each source-language word should be translated exactly once. A subgradient algorithm is used to op- timize the dual problem arising from the relaxation. The first technical contribution of this paper is the ... See full document

... on translation between related languages that the increased length of subword level translation is challenge for training as well as decoding (Vilar et ...from word-level alignment, which will ... See full document

... For all experiments, we used four LMs. The base- lines used conventional 5-gram LMs, estimated with modified Kneser-Ney smoothing (Chen and Good- man, 1998) on the English side of the bitext and the 329M-word ... See full document

... standard models used in statistical machine transla- tion (SMT), which are usually conditioned on word identities rather than word ...channel models in both directions, simple count ... See full document

... Parameters are updated by Mini-batch Gra- dient Descent and the learning rate is con- trolled by the AdaDelta (Zeiler, 2012) algorith- m with decay constant ρ = 0.95 and denomi- nator constant ϵ = 1e − 6. The batch size ... See full document

... and store this word sequence in the node instead. As in (Auli et al., 2013), the added information is ignored when deciding on recombination. When the RNN hidden state is needed, it is retrieved from a cache using ... See full document

... The main result in 2 is that, for the two language pairs considered, the expressive power of PBTS is not the lim- iting factor to achieve high translation performance. In fact, for most sentences in the test set, ... See full document

... NAT models to enhance their translation ability and meanwhile preserve the fast-decoding ...the decoding speed and the top layer of the FS-decoder can ex- ploit target sequential information ... See full document

... NMT models use a left-to-right generation which would appear to facilitate efficient search, the models themselves use a recurrent architecture, and accordingly are ...sequential decoding of symbols ... See full document

... document-level translation have started to ...develop models that, with the help of coreference resolu- tion methods, identify links among words in a text and use them for a better translation of ... See full document

... of a target word, which corresponds to the actual translation direction. Note, that both EiTM and EdTM lose the advantage of modelling dependen- cies beyond phrase boundaries when trained in the inverse ... See full document

... a translation that is better than any single system output? We propose a hier- archical system combination framework for machine ...the word-, phrase- and sentence- levels. By boosting common word ... See full document

... candidate word is associated with a score. The optimal consensus translation can be obtained by selecting one word from each set of candidates to maximizing the overall ...in decoding phase, ... See full document

... the word alignments between them, the toolkit first extracts a phrase table and two reordering models for the phrase-based system, or a Synchronous Context-free/Tree-substitution Grammar (SCFG/STSG) for the ... See full document

... Future work will involve empirical testing of this suggestion as well as further experiments on improving the stability of the normalised scores by developing better normalisation methods. We will evaluate the proposed ... See full document

... non-terminal (2NT) model. In our earlier experi- ments we found the 1NT model to perform com- parably to the 2NT model for close language pairs such as French-English (Sankaran et al., 2012) at the same time resulting in ... See full document

... generate translation candidates for OOV words, either by segmentation into subword units, projection from other languages, or by leveraging external knowledge sources like ...OOV word, and the MT system is ... See full document

... Among the phenomena that are modeled poorly by modern SMT systems is the insertion and deletion of words, such as function words, that are motivated by the divergent linguistic structure between source and target ... See full document

... Table 4 shows the performance of all different con- fidence measures on the hypotheses generated by the alignment template system and the phrase-based system. For the baseline CER, we determined the 90%- and ... See full document