[PDF] Top 20 MIPT System for World Level Quality Estimation

... We don’t have the scores for the WMT 18 Baseline system and the Shef-bRNN sys- tem on the development dataset, so we can compare them directly with only two of our systems from table 1. Both of these sys- tems ... See full document

... For the second consecutive year, the submissions of the UAlacant team tackle the word-level MTQE sub-task, but this year they also cover phrase-level MTQE. This year, the shared task featured a dataset ... See full document

... word-level Quality Estima- tion shared task. Our system is based on imitation learning, an approach to struc- tured prediction which relies on a classifier trained on data generated appropriately to ... See full document

... document- level QE shared tasks, for example, the gold stan- dard is generated through a linear combination of two separate human evaluation components, with weights tuned to optimize mean absolute error (MAE) and ... See full document

... Quality estimation (QE) of machine translation (MT) is a task of determining the quality of an au- tomatically translated text without any oracle (ref- erence) ...(i.e. estimation of how ... See full document

... a system on a set of incomplete sequences (1-to-N or ngrams), it might capture lo- cal dependencies which do not hold for complete ...the system on in- complete sequences as ... See full document

... The values for HTER among annotators in PE2 against PE1 were averaged in order to provide a better visualisation of changes made in the para- graphs from PE1 to PE2. Figure 1 shows the re- sults for individual paragraphs ... See full document

... Features play a key role in QE. A wide range of features from the source segments and their translations, often processed using external re- sources and tools, have been proposed. These go from simple, ... See full document

... translation quality is a challenging topic of research in the field of ...sentence level quality estimation problem on English-Hindi language ...translation quality estimation ... See full document

... neural machine translation (NMT) system (Bah- danau et al., 2014), trained with all data from the WMT 2015 English-to-German translation task (Bojar et al., 2015). The vocabulary size is 100,000 for both English ... See full document

... whole system of the higher vocational training with the purpose of increasing its quality and strengthening of attention on the development of practical - effective spheres of the trainee’s ...“education ... See full document

... (perplexity, level of back-off, intra-lingual triggers) and translation ta- ble (IBM1 table, inter-lingual ...word level, and the features at sentence level are computed by averaging over each word ... See full document

... our system for WMT2015 Shared Task on Quality Estimation, task 1, sentence-level prediction of post-edition ...best system leads to a perfor- mance in terms of Mean Absolute Error equal ... See full document

... estimating quality of a machine translation (MT) system without referring the ac- tual translation is now one of the key research ar- eas in MT domain (Blatz et ...document quality estimation ... See full document

... word level and sentence ...phrase level. On the other hand, the use of word-level and sentence-level predic- tions can help mitigate the uncertainty of phrase- level scores: there, a ... See full document

... We present an approach to address the chal- lenges of word-level translation quality estimation by learning these continuous space bilingual rep- resentations instead of relying on manual feature ... See full document

... translation for dissemination. Consequently, MT quality estimation (MTQE) (Blatz et al., 2004; Spe- cia et al., 2010; Specia and Soricut, 2013) has emerged as a mean to minimise the post-editing ef- fort by ... See full document

... the system combination ...the system combination, while it is the opposite in Case ...the system combination ...the system combination leads to a better TER score but the negation “no” is ... See full document

... Given different QE models, it is tempting to have an understanding of which QE models we should use. There have been several attempts to answer this important question (e.g. (Cohn and Specia, 2013; Soricut et al., 2012; ... See full document

... tion, we used the files provided by the organizers: 1832 source english sentences, their translations by the baseline translation system, and the score given by humans to these translations. We split these files ... See full document