[PDF] Top 20 QuEst A translation quality estimation framework

... the translation industry, as a conse- quence of better translation quality, more user- friendly tools, and higher demand for ...the quality of trans- lated segments similar to “fuzzy match ... See full document

... While there has been tremendous progress in QE in the last years (Martins et al., 2016, 2017; Kim et al., 2017; Wang et al., 2018), the ability of researchers to reproduce state-of-the-art systems has been hampered by ... See full document

... automatic estimation of machine translation (MT) output quality is a hard task in which the selection of the appro- priate algorithm and the most predictive features over reasonably sized training ... See full document

... Existing QE researches have been usually fo- cused on finding desirable QE related features to use machine learning algorithms. Recently, however, there have been efforts to apply neu- ral networks to QE and these neural ... See full document

... ity Estimation Shared Task, for English- German sentence-level post-editing effort prediction and ...baseline QuEst++ set of ...Referential Translation Ma- chines (RTM), in both scoring and ranking ... See full document

... The log-probability and the perplexity of the target side are used as features. The development of these features was motivated by manual exam- ination of the common error types in the train- ing data. We noted that stop ... See full document

... The WMT evaluation campaigns (Bojar et al., 2014) goal is to create a framework to test the perfor- mance of participating systems for the QE task. The WMT organizers provide the datasets for training and testing ... See full document

... We apply the framework of Collobert et al. (2011) to learn bilingual correspondences “from scratch”, i.e. from raw input words. To this aim, a continuous space deep neural network is pre-trained by initializing ... See full document

... of Translation with Explicit OR- dering) scores MT outputs by aligning them with given ...a translation sen- tence and the corresponding reference ...17 QuEst baseline features provided by the shared ... See full document

... Unlike syntactic parsing, semantic role la- belling does not produce a tree to be directly used in the tree kernel framework. There can be var- ious ways to accomplish this goal. We first try a method inspired by ... See full document

... In addition to the provided resources, further tools were used to extract the features: A modified version of the QuEst++ framework, (Specia et al., 2015) with processors and features added and modified ... See full document

... Our framework leverages a one-dimensional convolution on the concatenated word embeddings of target and its aligned source words to extract salient local feature ...proposed framework achieves highly ... See full document

... We have proposed several novel features for trans- lation quality estimation, which are trained with the use of neural networks. When added to large standard feature sets for Task 1, the CSLM fea- tures led ... See full document

... In this paper we propose a novel MTL algorithm for QE that learns the structure shared by differ- ent tasks in an online fashion and from an input stream of instances from all the tasks. To this aim, we extend the online ... See full document

... Quality Estimation (QE) of Machine Translation (MT) have become increasingly popular over the last ...the quality of a machine translated text, QE systems have the potential to make MT more ... See full document

... Proceedings for AMTA 2018 Workshop: Translation Quality Estimation and Automatic Post-Editing Boston, March 21, 2018 | Page 207.. Symbiotic Human and Machine Translation.[r] ... See full document

... To sum up, these systems and pipelines are designed for terminology management or dictionary compilation pur- pose rather than translation quality evaluation. They can- not readily serve our purpose of ... See full document

... semantic framework for machine translation evalua- ...this framework, a new evaluation metric, which is able to operate without the need for reference translations, is implemented and ...(overall ... See full document

... The TED talks domain is formed by subtitles of several talks in a range of topics presented in the TED conferences. The complete dataset has been used for MT and automatic speech recognition systems evaluation within the ... See full document

... and to demonstrate the ability of evaluation of sys- tems trained on a representation distinct from that of gold labels made possible by the unit-free Pear- son correlation, we also include evaluation of sys- tems ... See full document