[PDF] Top 20 Entropy based Pruning for Phrase based Machine Translation

... significance pruning does not perform as ...spurious phrase pairs are extracted. Sig- nificance pruning performs well under these condi- tions, since the measure is designed for this ...spurious ... See full document

... ginning. Generating the target in the ‘wrong’ di- rection (the opposite direction to the way in which humans do) is counter intuitive, and possibly as a result of this, SMT systems typically generate the target word ... See full document

... the phrase-based sys- tem, we use the following feature functions: a trigram language model, the phrase translation model and the word-based lexicon ...and phrase penalty fea- ... See full document

... raw machine-translation output, along with its human-post-edited counterpart, we can train the system to translate from the former into the lat- ...the phrase-based post-editing model that we ... See full document

... In order to derive the morphological decompo- sition we use existing tools. For stemming we use the TreeTagger (Schmid, 1994) for German and the Snowball stemmer 1 for Finnish. A vari- ety of ways for compound splitting ... See full document

... In this paper we explore a novel approach towards extending a standard PBSMT system with syntactic descriptions: we inject lexical descriptions into both the target side of the phrase translation table and ... See full document

... most Phrase-Based Statistical Machine Translation (PB-SMT) systems starts from automatically word aligned parallel cor- ...travel translation domain and news translation ... See full document

... Machine translation systems achieve near human-level performance on some languages, yet their effectiveness strongly relies on the availability of large amounts of parallel sen- tences, which hinders their ... See full document

... unmatched phrase in the TM source sentence, they replace its corresponding translation in the TM target sentence by the corresponding source phrase in the input sentence, and then mark the ... See full document

... We presented a modified beam search algorithm for an efficient incremental decoder (ID), which will allow translations to be generated incremen- tally for every word typed by a user, instead of waiting for the entire ... See full document

... The fractions of the 1- and 5-best matches are shown in table 2. The table is split into two halves. The upper part investigates the effect of increasing the amount of Arabic data while keeping the En- glish data fixed ... See full document

... Evaluation exercises indicate that approximate search algorithms work well in practice (Bojar et al., 2013). The most popular algorithms pro- vide solutions with unbounded error, thus pre- cisely quantifying their ... See full document

... our phrase table and lan- guage model supports a literal translation, cohesion tends to produce an ...first translation example shown in Table 5. In the base- line translation, the language ... See full document

... Philipp Koehn, Hieu Hoang, Alexandra Birch, Chris Callison-Burch, Marcello Federico, Nicola Bertoldi, Brooke Cowan, Wade Shen, Christine Moran, Richard Zens, et al. 2007. Moses: Open source toolkit for statistical ... See full document

... idiomatic phrase translations and can be easily enriched with bilingual ...using phrase-based translation in a statistical framework has been shown in many studies such as (Koehn et ...the ... See full document

... the phrase-based systems (Och and Ney, 2002; Marcu and Wong, 2002; Zens et ...The phrase-based models translate contiguous sequences of words from the source sentence to contiguous words in ... See full document

... ses are generated by glossing. For each word in the source, the most likely translation option (according to the weighted phrase-internal score) is selected, and these translations are joined together ... See full document

... hierarchical phrase-based (HPB) model (Chi- ang, 2005; Chiang, 2007) has been widely adopted in statistical machine translation ...a phrase pair consisting of consecutive words; ... See full document

... We used these three corpora to extract a set of sentences that were aligned to each other across all four languages. For that purpose, we used English as the pivot. For each distinct English sentence, we extracted the ... See full document

... statistical machine translation relies on the word-based trans- lation model to describe the translation process ...word-to-word translation often fails to capture all properties of the ... See full document