[PDF] Top 20 Tree Kernels for Machine Translation Quality Estimation

... Both the English input text and the Spanish Machine Translations were annotated with syntactic parse trees from which to derive implicit features. In En- glish, we were able to produce both constituency and ... See full document

... of translation quality and subsequently employ HTER scores as a gold standard representation when evaluating QE systems, ultimately leading to rankings for competing ...of translation quality, ... See full document

... of machine translated text, Carter and Inkpen (2012) translated the Hansards of the 36th Parliament of Canada us- ing the Microsoft Bing MT web service, and conducted three detection experiments at docu- ment ... See full document

... Ondrej Bojar, Christian Buck, Christian Federmann, Barry Haddow, Philipp Koehn, Johannes Leveling, Christof Monz, Pavel Pecina, Matt Post, Herve Saint-Amand, Radu Soricut, Lucia Specia, and Aleˇs Tamchyna. 2014. Findings ... See full document

... The word-level QE task is conceived as a binary classification task. The goal is to label translation errors at word level by marking words either as “GOOD” or “BAD”. The WMT2015 QE task focuses on the F1 score ... See full document

... We developed our QE models using the regression methods. Specifically, we applied three different ensemble-based regression algorithms: Bagging [34], Extra Tree [35] and Random Forest [36]. These learning ... See full document

... Firstly, we describe the two variants of EBLEU method for this task. We score the five alternative translation sentences as compared to the source sentence according to the closeness of their POS sequences. The ... See full document

... Although concern surrounding the reliability of human annotations is by far the most common complaint with respect to human evaluation of MT, the validity of the particular gold standard representation used in a given ... See full document

... and machine translation outputs as features, and combined them with baseline fea- tures to improve the system performance of ...neural machine translation log-likelihood features based on ... See full document

... the quality of English-French ...constituency tree kernels perform well but the error rate can be further reduced when these are combined with hand-crafted syntactic ...of machine translated ... See full document

... combines translation systems which produce syntactic trees as ...generation tree and target- side SCFG tree are aligned and form the basis for computing structural similar- ...and tree-edit ... See full document

... Q U E ST has recently been benchmarked on a number of datasets (Shah et al., 2013b; Shah et al., 2013a). To make this paper self-contained, we provide exper- iments with models trained offline which are already available ... See full document

... numeric quality labels from the litera- ture, including the commonly used Human Trans- lation Error Rate (HTER) (Snover et ...real translation envi- ronments – where uncertainty estimates could be useful, ... See full document

... Proceedings for AMTA 2018 Workshop: Translation Quality Estimation and Automatic Post-Editing Boston, March 21, 2018 | Page 1.. Nicola Ueffing • Research scientist on eBay‘s machine tran[r] ... See full document

... The quality of the translations produced is considered high, with BLEU scores on a 1K-single reference test set reaching ...The quality label for each segment is post-editing distance, calculated as the ... See full document

... For EN-DE, the reasons for the bad perfor- mance of consensual features are not clear. This language pair showed the worst average quality scores for all systems. Reasons for this can include characteristics of ... See full document

... of quality estimation sys- tems and highlighted potential flaws in existing methods, with respect to the ability to boost scores by prediction of aggregate statistics specific to the particular test set in ... See full document

... Unlike syntactic parsing, semantic role la- belling does not produce a tree to be directly used in the tree kernel framework. There can be var- ious ways to accomplish this goal. We first try a method ... See full document

... automatic estimation of machine translation (MT) output quality is a hard task in which the selection of the appro- priate algorithm and the most predictive features over reasonably sized ... See full document

... vector machine (SVM) imple- mentation of tree ...resulting tree representation are word forms and dependency re- lations, omitting part-of-speech ... See full document