[PDF] Top 20 A Lightweight Evaluation Framework for Machine Translation Reordering

... of translation quality and a reordering-only metric independently of lexical ...many machine trans- lation systems (including our own) assume that re- ordering and translation can be factored ... See full document

... Doubtless the design of a metric that is able to capture all the linguistic aspects that distinguish ‘correct’ translations from ‘incorrect’ ones is an ambitious and difficult goal. In- stead of building such a ... See full document

... HFE w/ art. 28.86 73.45 29.9 73.52 proposed 32.93 76.68 33.25 76.74 w/o art. 19.86 75.62 20.17 75.63 N -gram 32.15 76.52 32.28 76.46 Table 4: The effects of article generation: “w/o art.” de- notes evaluation ... See full document

... proved machine translation performance by reorder- ing source side sentences based on rules applied to the source side parse during training and ...Grammar framework which results in machine ... See full document

... Statistical Machine Translation ...in machine translation between languages with significant word order differences ...Based Machine Translation (EBMT) that translates input text ... See full document

... phrase reordering are much higher on A-E relative to C-E; this could be related to the fact that the word order differences between English and Arabic are much higher than the differences between English and ... See full document

... Syntactic reordering approaches are an ef- fective method for handling word-order dif- ferences between source and target lan- guages in statistical machine translation (SMT) ...for ... See full document

... for machine trans- lation reordering using only aligned par- allel ...pre-ordering framework results in significant gains in translation accuracy over standard phrase- based SMT and previously ... See full document

... on translation quality. The first evaluation metric is BLEU (Pap- ineni et ...evaluate translation quality between structurally different ...third evaluation metric is TER (Snover et ...fourth ... See full document

... We carried out experiments in two different settings, both involving data from NIST Open MT 2012. 2 The first setting uses data from the Chinese to En- glish constrained track, comprising 283M English tokens. We manually ... See full document

... hard reordering decision, the author uses the rules as soft constraints in the ...log-linear framework (Equation 2) a new jump model is added which uses the reordered source sentence to calculate the ... See full document

... Doing reordering as a preprocessing step, sepa- rately from translation, makes it easy to evaluate re- ordering performance independently from the MT ...a framework for evaluating the quality of ... See full document

... For evaluation, we validated the model with an interval of 1,000 batches on the dev ...the evaluation metric of EN-DE, and the ...the evaluation metric ... See full document

... demanding reordering task of translating between two distant languages, En- glish and ...described translation direction: English to ...the reordering challenges of this translation ... See full document

... In this paper, we propose a novel neural reorder- ing feature by including longer context for pre- dicting orientations. We utilize a long short-term memory recurrent neural network (LSTM-RNN) (Graves, 1997), and ... See full document

... word reordering between language pairs with substantial word order difference, such as Japanese with Subject-Object-Verb (SOV) structure and English with Subject-Verb-Object (SVO) struc- ture, is generally viewed ... See full document

... In Table 3 and Table 4, we show the trans- lation results for the BTEC task. First, we observe that the overall quality is rather high on this task. The average length of the used alignment templates is about five source ... See full document

... In this section, we will discuss the reordering con- straints from a theoretical point of view. We will answer the question of how many word-reorderings are permitted for the ITG constraints as well as for the IBM ... See full document

... a translation “phrase” is simply any contiguous word string that is consistent with a word alignment (a relation between source and target words), usually produced by a language-independent alignment pro- cedure ... See full document

... Human-Informed Translation and Interpreting Technology (HiT-IT 2019) took place in Varna, Bulgaria and spanned over two days (5-6 September 2019), as a post-RANLP 2019 conference ... See full document