[PDF] Top 20 Word Reordering and a Dynamic Programming Beam Search Algorithm for Statistical Machine Translation

... of search procedures used in statistical MT: Brown et ...a statistical MT system that is based on the same statistical principles as those used in most speech recognition systems (Jelinek ... See full document

... distance word reordering is a major challenge in statistical machine translation re- ...stantial word order ...on word or- der precedence in the target language to repo- ... See full document

... therefore reordering can only be triggered by at least partially lexicalized translation ...where reordering can be captured by rules containing only labeled non-terminals ...the reordering ... See full document

... the word reordering problem as a preprocessing ...learn reordering rules for English-French translation from source and target language dependency ...craft reordering rules manually ... See full document

... (lexicalized reordering) mod- els (Tillmann, 2004; Koehn et ...medium-range reordering and are prob- ably the most widely used in PSMT ...of reordering steps makes them unsuitable to capture ... See full document

... We implement both algorithms and conduct some experiments. To evaluate the results, we adopt the concept of inversion pairs to measure the distances between the standard answers and the sentences outputted by the ... See full document

... reordered. Word reorderings can be divided in two tighly intertwined parts: local reorderings that take place within phrases; and longer reorderings of those ...target word order and then fed into the ... See full document

... the word order of this sentence quite different from that of the English ...the word reordering will be quite difficult for the word or phrase-based alignment model to ...a reordering ... See full document

... the reordering con- straints from a theoretical point of ...many word-reorderings are permitted for the ITG constraints as well as for the IBM ...specific word identities are of no importance ...of ... See full document

... to Statistical Machine Translation (SMT) in recent ...and word reordering within short ...long-distance reordering is problematic in phrase-based ...based reordering model ... See full document

... This trend shows the trade-off between phrase- based and syntax-based approaches. When the threshold is too small, an abstraction tree be- comes closer to the dependency tree and the tree- projection becomes difficult. ... See full document

... the machine translation ...greedy search and dynamic programming that search for the optimal segmentation ...our algorithm is able to segment the input two to three times ... See full document

... a dynamic program- ming search algorithm exists as described in the previous ...an algorithm that generates the target sentence word by word or phrase by ...the beam ... See full document

... The search for consistent Viterbi phrase align- ments can be implemented as a phrase-based de- coder using a beam search whose outputs are con- strained only to the target ...A* search as ... See full document

... the beam search algorithm. Uses dynamic programming to produce a lower bound on the optimal constrained solution and, possibly, a certificate of ... See full document

... well-known dynamic programming beam search in phrase-based statistical machine translation (SMT), aiming at increased effi- ciency of decoding by minimizing the number of ... See full document

... early reordering pruning to be effective, it is especially important that the correct reordering option be ranked in the top n among those available at the time of a given hypoth- esis ... See full document

... However, for the optimization criterion considered here dynamic programming is only suboptimal because the decomposition into independent subproblems is only approximately possible: to p[r] ... See full document

... in statistical machine ...the Translation Template Model to perform phrase alignment and translation using standard WFST op- ...modeling reordering within translation; their WFST ... See full document

... 2007). Word alignment and phrase extrac- tion are done by GIZA++ (Och and Ney, 2000) with L0-normalization (Vaswani et ...The translation quality is evaluated by case-insensitive BLEU-4 metric (Papineni et ... See full document