[PDF] Top 20 Discourse Structure in Machine Translation Evaluation

... MT evaluation is an integral part of the process of developing and tuning an SMT ...Reference-based evaluation measures compare the output of a system to one or more human translations (called references) ... See full document

... the discourse structures of an automatic and of a reference translation provides additional in- formation that can be valuable for evaluating MT ...preserve discourse relations. As an example, ... See full document

... Another concern is that BLEU-like n-gram matching metrics tend to favor phrase-based SMT systems over rule-based systems and other SMT paradigms. In particular, they are unable to cap- ture the syntactic and semantic ... See full document

... of discourse structure — specifically discourse devices used to organize information in a sen- tence — that significantly impact the qual- ity of machine ...in translation quality. Also ... See full document

... While we have implemented a number of variants of DTED, for WMT 2015 and WMT 2016 we use only the ‘Pure’ version which processes only the structure of the sentences while ignoring other in- formation such as word ... See full document

... an evaluation of discourse- level NMT models through the use of two dis- course test sets targeted at coreference and lexical ...exploit discourse-level context; poor results are found for ... See full document

... the discourse text with ordering structure is bet- ter trained with its original order while not to be scattered, ensuring the effectiveness of our other systems since they are all trained like the ... See full document

... our structure-related research question (Section ...of structure to the prediction of human opinions on the quality of adequacy in word order using two separate ...syntactic structure but otherwise ... See full document

... an evaluation method that as- sesses machine translations according to what they are (translations produced by a machine) and not to what they resemble (human ...the machine qualities of ... See full document

... few evaluation methods explicitly targeting on the quality of a docu- ...MT evaluation measures, based on the Discourse Representation Theory (Kamp and Reyle, 1993), that generate semantic trees to ... See full document

... Neural Machine Translation (NMT) models are now the most performant, to the ex- tent that in the past year they have been the best performing at WMT (Bojar et ...in evaluation, if we are to move ... See full document

... and evaluation of the above mentioned three MT systems, we can conclude that for languages with similar lexical and syntactic structure ...for translation is much larger than one ...repetitive ... See full document

... Statistical Machine Translation was held at ACL 2007 in Prague, Czech Republic, ACL 2008, Columbus, Ohio, USA, EACL 2009 in Athens, Greece, ACL 2010 in Uppsala, Sweden, EMNLP 2011 in Edinburgh, Scotland, ... See full document

... Penn Discourse TreeBank (PDTB, see Sec- tion 4), signaling discourse relations such as tem- porality or contrast between two spans of ...thereof. Discourse relations can also be present implicitly ... See full document

... erence translation for the second example uses the French connective car with a correct causal sense, instead of the wrong depuis que generated by SMT, which expresses a temporal ...erence translation uses ... See full document

... Evaluation in the ARPA Machine Translation Program 1993 Methodology Evaluation in the ARPA Machine Translation Program John S White, Theresa A O'Connell PRC Inc M c L e a n , VA 22102 1993 Methodology[.] ... See full document

... MT evaluation metric which is based on linguistic ...long translation and achieves significant higher correlation with human judgements than several other popular metrics at document-level and comparable ... See full document

... Idiosyncratic Gap A Tough Problem to Structure bound Machine Translation Idiosyncratic Gap A Tough Prolem to Structure bound Machine Translation Yoshihiko Nitre Advanced Research Laboratory Hitachi Lt[.] ... See full document

... EVALUATION OF MACHINE TRANSLATION E V A L U A T I O N O F M A C H I N E T R A N S L A T I O N John S White, Theresa A O'Connell P R C Inc M c L e a n , V A 2 2 1 0 2 a n d Lynn M Carlson D o D A B S T[.] ... See full document

... A MACHINE TRANSLATION SYSTEM FROM JAPANESE INTO ENGLISH BASED ON CONCEPTUAL STRUCTURE A MACHINE TRANSLATION SYSTEM FROM JAPANESE INTO ENGLISH BASED ON CONCEPTUAL STRUCTURE Hiroshi Uchida and Kenji Sug[.] ... See full document