[PDF] Top 20 ORANGE: a Method for Evaluating Automatic Evaluation Metrics for Machine Translation
Has 10000 "ORANGE: a Method for Evaluating Automatic Evaluation Metrics for Machine Translation" found on our website. Below are the top 20 most common "ORANGE: a Method for Evaluating Automatic Evaluation Metrics for Machine Translation".
ORANGE: a Method for Evaluating Automatic Evaluation Metrics for Machine Translation
... new automatic evaluation method, O RANGE , to evaluate automatic evaluation metrics for machine ...new method can be easily implemented and integrated with existing ... See full document
7
Iqmt: A Framework for Automatic Machine Translation Evaluation
... Our approach is based on QARLA (Amig´o et al., 2005), a probabilistic framework originally designed for the evalua- tion of text summarization systems. QARLA automatically identifies the features that distinguish human ... See full document
6
Proceedings of the Second Conference on Machine Translation
... three translation tasks: Machine Translation of News, Biomedical Translation, and Multimodal Machine Translation, two evaluation tasks: Metrics and Quality ... See full document
24
Better Evaluation Metrics Lead to Better Machine Translation
... exact method is not important for our ...An automatic MT evaluation metric compares the output of the decoder against the reference(s), and guides the tuning algorithm to- wards iteratively better ... See full document
10
Accurate Evaluation of Segment level Machine Translation Metrics
... for automatic metrics, and as with the translation shared task, human evaluation remains the official gold standard for ...shared translation task, as well as MT evaluation ... See full document
9
Predicting Human Assessment of Machine Translation Quality by Combining Automatic Evaluation Metrics using Binary Classifiers
... recent evaluation campaigns on newswire [19, 18] and travel data [17] investigated how well these evaluation metrics correlate with human ...some metrics when ranking MT system outputs on the ... See full document
7
Extending Machine Translation Evaluation Metrics with Lexical Cohesion to Document Level
... few evaluation methods explicitly targeting on the quality of a docu- ...Its automatic versions TER and TERp (Snover et ...based metrics. Comelles et al. (2010) present a family of automatic ... See full document
9
Modifications of Machine Translation Evaluation Metrics by Using Word Embeddings
... for Machine Translation (MT) research is how to evaluate the quality of translations automatically and ...word-based metrics such as BLEU (Papineni et ...in machine translation, but ... See full document
9
A Machine Learning Approach to the Automatic Evaluation of Machine Translation
... automated evaluation of an MT ...this method for exploring the data more intuitive than attempting to visualize the location of sentences in the high- dimensional space of the corresponding ...SVM. ... See full document
8
Achieving Accurate Conclusions in Evaluation of Automatic Machine Translation Metrics
... and automatic scores for n MT systems from the set of n systems for which we have genuine metric and human ...The method unfor- tunately does not produce accurate confidence inter- vals for correlation ... See full document
10
The Contribution of Linguistic Features to Automatic Machine Translation Evaluation
... Automatic evaluation methods based on similarity to human references have substantially accelerated the development cycle of many NLP tasks, such as Machine Translation, Automatic ... See full document
9
UPF Cobalt Submission to WMT15 Metrics Task
... Current automatic MT evaluation methods are grounded on the following key idea: the closer an MT is to a professional Human Translation (HT), the higher its ...Thus, metrics typ- ically ... See full document
7
Evaluating N gram based Evaluation Metrics for Automatic Keyphrase Extraction
... of automatic evaluation metrics that better account for ...individual evaluation exercise, and furthermore, the resources tend to be domain- ...keyphrase evaluation metric, our aim is ... See full document
9
Combining Coherence Models and Machine Translation Evaluation Metrics for Summarization Evaluation
... on evaluating summaries on content, readability, and over- all ...a machine translation metric to measure con- tent coverage, apply an enhanced discourse coherence model to evaluate summary read- ... See full document
9
Automatic generation of paraphrases to be used as translation references in objective evaluation measures of machine translation
... to evaluation of machine translation where the goal is to obtain high scores in BLEU and NIST, our goal here, when comparing a paraphrase to the seed sentence it has been produced for, is to get low ... See full document
8
Urdu to English Machine Translation using Bilingual Evaluation Understudy
... EBMT automatic process is carried out to identify the equivalent translation ...of translation into three ...corresponding translation fragments and 3) Re-combination that generates the target ... See full document
8
The Impact of Multiword Expression Compositionality on Machine Translation Evaluation
... match method, and utilis- ing compositionality has a more positive effect than ...match method (“0/1”) has a bigger impact, both positively and negatively, as a result of the polarisation of n-gram overlap ... See full document
6
Beyond Linguistic Equivalence An Empirical Study of Translation Evaluation in a Translation Learner Corpus
... well-known translation prob- lems, ...as translation prob- lems. Different translation strategies can be ap- plied to different kinds of problems, most impor- tantly to the translation of ... See full document
10
Metrics for Evaluation of Word level Machine Translation Quality Estimation
... all metrics identify them well. All metrics are sorted by dis- criminative power from best to worst, ...i.e. metrics at the top of the table require less samplings to tell one synthetic dataset from ... See full document
6
Automatic Evaluation of Chinese Translation Output: Word Level or Character Level?
... English-to-Chinese translation task evaluated 127 documents with 1,830 ...The method of manually scoring the 11 submitted Chinese system translations of each segment is the same as that used in ... See full document
6
Related subjects