[PDF] Top 20 Fast and Scalable Decoding with Language Model Look Ahead for Phrase based Statistical Machine Translation

... LM look-ahead scores, we can then directly access the nodes without the need to traverse the trie ...increase translation speed by roughly 20% in a short ... See full document

... for phrase- based SMT (Langlais et ...n-gram language model, which the authors claim would be difficult to implement in a beam search ... See full document

... the language model with the English-side grammar introduces many states into the nontermi- nal alphabet, which are projected over to the French ...increases decoding speed, at the cost of some search ... See full document

... learning phrase translations and decoding, we used Pharaoh (Koehn, 2004), a state-of-the-art phrase- based SMT system which is available for research ...learning language models, we ... See full document

... the translation forest and the language model by expanding a limited beam of hypotheses from each nonterminal ...a fast-to-compute heuris- tic view of outside weights (cheapest way to com- ... See full document

... a statistical word alignment tool which incorporates all the IBM 1-5 ...facilitates fast devel- opment of statistical machine translation (SMT) ...low-resource language pairs the ... See full document

... traditional statistical ma- chine translation (SMT), neural machine translation (NMT) often sacrifices ade- quacy for the sake of ...existing phrase-based SMT model to ... See full document

... the phrase-based sys- tem, we use the following feature functions: a trigram language model, the phrase translation model and the word-based lexicon ...and ... See full document

... a phrase-based SMT decoder, the word se- quence of the target language is typically gener- ated in order in a forward ...the translation are generated first, then the subsequent words, in ... See full document

... the translation forest and the language model by expanding a limited beam of hypotheses from each nonterminal ...a fast-to-compute heuris- tic view of outside weights (cheapest way to com- ... See full document

... allow translation events to span sub- tree units, providing several advantages, including the ability to selectively produce uncohesive transla- tions (Eisner, 2003; Graehl and Knight, 2004; Quirk et ...cohesive ... See full document

... factored translation model demonstrating improvement not only in the BLEU and NIST scores but also improvement in the fluency and adequacy by subjective evaluation ...multiple phrase tables. The ... See full document

... of phrase-based SMT is that phrase cohere across two languages (Fox, 2002), which means phrases in one language tend to be moved together during ... See full document

... In this paper we explore a novel approach towards extending a standard PBSMT system with syntactic descriptions: we inject lexical descriptions into both the target side of the phrase translation table and ... See full document

... unmatched phrase in the TM source sentence, they replace its corresponding translation in the TM target sentence by the corresponding source phrase in the input sentence, and then mark the ... See full document

... the phrase table is queried, the source phrase is hashed and we try to find it in the probing hash ...source phrase queried inside the payloads byte ...target phrase to- gether with its scores ... See full document

... MT decoding to finding optimal tours in the Traveling Salesman Prob- lem (Garey and Johnson, 1979)—choosing a good word order for decoder output is similar to choosing a good TSP ...instance, Model 4 ... See full document

... The OpenNMT toolkit was used to develop the NMT systems. The training was done on two lay- ers of LSTM network with 500 hidden units at both, the encoder and decoder models for 1,00,000 epochs. The variability of the ... See full document

... both Model-III + and Distinguishing Model are worse than Koehn-10 at some high fuzzy match ...best translation results at all intervals in either BLEU or TER when the fuzzy match score is above ... See full document

... In addition, we used a rule augmentation method which is known as syntax-augmented machine translation (Zollmann and Venugopal, 2006). Because the tree-to-string SMT makes some constraints on extracting ... See full document