machine translation evaluation
LAYERED: Metric for Machine Translation Evaluation
... Machine translation evaluation has always re- mained as the most popular measure to judge the quality of a system output compared to the refer- ence ...MT evaluation metric which is based on ...
7
Corpus based annotated test set for Machine Translation evaluation by an Industrial User
... Corpus based annotated test set for Machine Translation evaluation by an Industrial User Corpus based annotated test set for Machine Translation evaluation by an Industrial User Eva DAUPHIN and V~roni[.] ...
5
Extending Machine Translation Evaluation Metrics with Lexical Cohesion to Document Level
... to translation quality, so as to identify, apart from its use frequency, other significant aspects for MT evaluation at the docu- ment ...direct translation of those in a source text that do not fit ...
9
Statistical Significance Tests for Machine Translation Evaluation
... We would like to stress that comparing perfor- mance of a method that translates text from differ- ent languages instead of using different translation methods on the same input text is irrelevant for the purpose ...
8
Machine Translationness: Machine-likeness in Machine Translation Evaluation
... We evaluated the method by analysing the Pearson corre- lation between MTS scores and human quality perception. The MTS variable should decrease as the human rating in- creases (the higher quality the lower MTS). ...
8
Discourse Structure in Machine Translation Evaluation
... Our previous work (Guzm´an et al. 2014a) helps answer the question about the complementarity of the two sources of information in a more direct way. In that paper, we proposed a pairwise setting for learning MT ...
40
Pairwise Neural Machine Translation Evaluation
... The evaluation results have shown that our NN model yields state-of-the-art results when using lexical, syntactic and semantic features (the latter two based on compact ...
10
Iqmt: A Framework for Automatic Machine Translation Evaluation
... SMT systems are built as described in (Gim´enez and M`arquez, 2005). As to ‘SYSTRAN’, we used the freely available on-line version 8 . Let us note that evaluation is unfair to ‘SYSTRAN’ because SMT systems have ...
6
Reference bias in monolingual machine translation evaluation
... We note that even in such a scenario, human translations differ from each other. We measured the average similarity between the four references in the dataset using the Meteor evaluation met- ric (Denkowski and ...
6
A Reading Comprehension Corpus for Machine Translation Evaluation
... The machine translated corpus can be download from https: ...A machine translation (Google) and a human trans- lation are also shown in the ...
7
On the practice of error analysis for machine translation evaluation
... assess machine translation output in qualitative terms, which can be used as a basis for the generation of error profiles for different ...to evaluation it runs the risk of low inter-annotator ...
6
Using Contextual Information for Machine Translation Evaluation
... reference-based evaluation with various strategies: use of additional ref- erences (Albrecht and Hwa, 2008; Madnani and Dorr, 2013; Fomicheva et ...of machine learning tech- niques (Gupta et ...automatic ...
7
First Steps in Using Word Senses as Contextual Features in Maxent Models for Machine Translation
... maxent-based translation model does represent a step in the right direction, and merits further discussion and ...controlled evaluation, trained on a small, in-domain ...alternative machine ...
9
Automatic generation of paraphrases to be used as translation references in objective evaluation measures of machine translation
... for machine translation evaluation, not only are the paraphrase sets produced by this method correct sentences and valid paraphrases, but they also exhibit an internal lexical and syn- tactical ...
8
Continuous Measurement Scales in Human Evaluation of Machine Translation
... MT evaluation has been carried out for a number of years (LDC, 2005), but it has proven difficult to acquire consistent judgments, even from ex- pert ...assessors. Evaluation rounds such as the an- nual ...
9
Learning to translate with products of novices: a suite of open ended challenge problems for teaching MT
... We conceived of the assignment as one in which stu- dents could apply machine learning or feature engi- neering to the task of reranking the systems, so we provided several tools. The first of these, learn, was a ...
14
Machine Translation for Subtitling: A Large-Scale Evaluation
... the translation process; or- der for grammatical ordering errors in the target language; phrase for any multiword expression wrongly treated as separate words, or any separate words wrongly translated as a unit; ...
8
Evaluation Metrics for Knowledge Based Machine Translation
... Evaluation Metrics for Knowledge Based Machine Translation Evahmtion Metrics t'oi Knowledge Based Machine Translation E r i c I1 N y b e r g , 3 r d T e r u k o M i t a m u r a J a i m c G C a r b o n[.] ...
5
An Evaluation of METAL: the LRC Machine Translation System
... A METAL grammar rule consists of five analysis sections, plus an additional section for each target language: a top llne describing the phrase structure with an optional enumeration of e[r] ...
8
Integrating Meaning into Quality Evaluation of Machine Translation
... Machine translation (MT) quality is eval- uated through comparisons between MT outputs and the human translations ...this evaluation relies on form related features ...man evaluation of ...
10