[PDF] Top 20 Adaptive Quality Estimation for Machine Translation

... an adaptive and an empty model against a system trained in batch ...The adaptive model is built on top of an existing model created from the training data and exploits the new test instances to refine its ... See full document

... Meaningful conclusions about the relative performance of NLP systems are only pos- sible if the gold standard employed in a given evaluation is both valid and reli- able. In this paper, we explore the va- lidity of human ... See full document

... Human-targeted reference translations were readily available in the WMT-13 shared task data set, while the human assessment method described in Section 3.1, was again applied to translations via crowd- sourcing on ... See full document

... chine translation toolkit (Koehn et ...the translation model and lan- guage ...ferent quality translation systems, details of which are described in Table ... See full document

... Ondrej Bojar, Christian Buck, Christian Federmann, Barry Haddow, Philipp Koehn, Johannes Leveling, Christof Monz, Pavel Pecina, Matt Post, Herve Saint-Amand, Radu Soricut, Lucia Specia, and Aleˇs Tamchyna. 2014. Findings ... See full document

... The word-level QE task is conceived as a binary classification task. The goal is to label translation errors at word level by marking words either as “GOOD” or “BAD”. The WMT2015 QE task focuses on the F1 score ... See full document

... level translation QE problem, the approach is broadly divided into two phases: feature extraction and the quality ...the translation quality of the ...the translation quality by ... See full document

... Firstly, we describe the two variants of EBLEU method for this task. We score the five alternative translation sentences as compared to the source sentence according to the closeness of their POS sequences. The ... See full document

... The first approach is sensible because, in the limit, the models built should reflect the “average” strate- gies/preferences of translators. However, its cost makes it prohibitive. The second approach can lead to very ... See full document

... Quality Estimation (QE) for Machine Translation (MT) involves judging the correctness of the output of an MT system given an input and no reference translation (Blatz et ...a ... See full document

... The addition of new “bad” sentences leads to an improvement in quality, regardless of the sen- tence generation method used. Models trained on datasets generated by different strategies display the same trend: ... See full document

... for quality inference of a translated text is to determine the fluency of such a text and how well it conforms to the linguistic regularities of the target ...difficult machine learning ... See full document

... Q U E ST has recently been benchmarked on a number of datasets (Shah et al., 2013b; Shah et al., 2013a). To make this paper self-contained, we provide exper- iments with models trained offline which are already available ... See full document

... and machine translation outputs as features, and combined them with baseline fea- tures to improve the system performance of ...neural machine translation log-likelihood features based on ... See full document

... Proceedings for AMTA 2018 Workshop: Translation Quality Estimation and Automatic Post-Editing Boston, March 21, 2018 | Page 1.. Nicola Ueffing • Research scientist on eBay‘s machine tran[r] ... See full document

... To exploit parse tree information in our Machine Learning (ML) component, we used tree kernel functions. Tree kernels (Collins and Duffy, 2001) are kernel functions defined over pairs of tree struc- tures. They ... See full document

... multiple machine learning models, the recommended approach is to use a non-parametric multiple hypothesis test followed by a post-hoc analysis that compares each pair of hypothesis (Demˇsar, ...to machine ... See full document

... and to demonstrate the ability of evaluation of sys- tems trained on a representation distinct from that of gold labels made possible by the unit-free Pear- son correlation, we also include evaluation of sys- tems ... See full document

... this respect mainly due to a lack of such resources. The only available gold standard resource is a small set of 1000 sentences taken from Europarl (Koehn, 2005) and manually annotated with Prop- bank verb predicates ... See full document

... proves the correlation with human judgements. Soricut and Echihabi (2010) claim that pseudo- references should be produced by systems as dif- ferent as possible from the MT system of interest. This ensures that the ... See full document