Statistical Machine Translation and Evaluation Metrics
Better Evaluation Metrics Lead to Better Machine Translation
... phrase-based statistical machine translation system, with the TESLA metrics results in significantly better human- judged translation quality than the BLEU- tuned ...the machine ...
10
ORANGE: a Method for Evaluating Automatic Evaluation Metrics for Machine Translation
... automatic evaluation metrics using the O RANGE evaluation method is ...state-of-the-art statistical machine translation system, AlTemp (Och 2003), and the 2002 NIST ...
7
Using a Grammar Checker for Evaluation and Postprocessing of Statistical Machine Translation
... an Evaluation Tool A disadvantage of most current evaluation metrics for MT, is that they do not take grammar into ...existing metrics by in- dicating the grammaticality of a text, simply by ...
7
Improving Pronoun Translation for Statistical Machine Translation
... I will also be exploring other directions re- lated to problems identified during the course of the work completed to date. These include, but are not limited to, handling pronoun dropping in pro-drop languages, ...
10
Findings of the 2010 Joint Workshop on Statistical Machine Translation and Metrics for Machine Translation
... peer evaluation exclusively consisting of developers of machine translation systems, and thereby people who are used to machine transla- tion ...manual evaluation: How stable are man- ...
37
Evaluation Metrics for Knowledge Based Machine Translation
... Evaluation Metrics for Knowledge Based Machine Translation Evahmtion Metrics t'oi Knowledge Based Machine Translation E r i c I1 N y b e r g , 3 r d T e r u k o M i t a m u r a J a i m c G C a r b o n[.] ...
5
Accurate Evaluation of Segment level Machine Translation Metrics
... of translation quality assessments in the initial (x-axis) and replicate experiments (y- axis) for Spanish-to-English over W MT -13, where each point represents a standardized segment-level score computed as the ...
9
Statistical Significance Tests for Machine Translation Evaluation
... As in the previous section, we use a bootstrap re- sampling method for this: Given a small collection of translated sentences, we repeatedly (say, 1000 times) create new virtual test sets by drawing sen- tences with ...
8
Combining Coherence Models and Machine Translation Evaluation Metrics for Summarization Evaluation
... If no post-processing is performed to the generated summaries, the presentation of the extracted sen- tences may confuse readers. Knott (1996) argued that when the sentences of a text are randomly or- dered, the text ...
9
Metrics for Evaluation of Word level Machine Translation Quality Estimation
... 3.1 Comparison on real systems One of the purposes of system comparison is to identify the best-performing system. Therefore, we expect a good metric to be able to distinguish between systems as well as possible. One of ...
6
Modifications of Machine Translation Evaluation Metrics by Using Word Embeddings
... new metrics have appeared and shown their good performance (Machacek and Bojar, 2013; Machacek and Bojar, 2014; Stanojevi´c et ...existing metrics does not require developing a whole new met- ...existing ...
9
Achieving Accurate Conclusions in Evaluation of Automatic Machine Translation Metrics
... MT metrics potentially contain data for a very large number of ...the evaluation of metrics to a vastly larger pool of ...a translation shared task (as opposed to hybrids cre- ated by sampling ...
10
Achieving accurate conclusions in evaluation of automatic machine translation metrics
... MT metrics potentially contain data for a very large number of ...the evaluation of metrics to a vastly larger pool of ...a translation shared task (as opposed to hybrids cre- ated by sampling ...
10
Evaluation of Context-Dependent Phrasal Translation Lexicons for Statistical Machine Translation
... phrasal translation lexicons are more useful resources for phrase-based statistical machine translation (SMT) than conventional static phrasal translation lexicons, which ignore all ...
8
Evaluation of the Statistical Machine Translation Service for Croatian-English
... tems appeared and included this approach: the French multilingual system TI- TUS; the Chinese-English CULT system; the Spanish-English SPANAM; the Russian-English system Systran which was adopted by the US Air Force and ...
14
On Statistical Machine Translation and Translation Theory
... Most current approaches to SMT are founded on word alignments in the spirit of Brown et al. (1990). These word alignments have no clear theoretical status, but they can be seen as an embodiment of a fairly traditional ...
5
On Statistical Machine Translation and Translation Theory
... Most current approaches to SMT are founded on word alignments in the spirit of Brown et al. (1990). These word alignments have no clear theoretical status, but they can be seen as an embodiment of a fairly traditional ...
5
Extending Machine Translation Evaluation Metrics with Lexical Cohesion to Document Level
... sentence-level metrics Table 5 presents the correlation rates of evalua- tion metrics obtained in our experiments under dif- ferent settings, with their 95% conference intervals (CI) ...other ...
9
Learning the Impact of Machine Translation Evaluation Metrics for Semantic Textual Similarity
... 4.1 Evaluation of Individual Metric The Pearson correlation and RELIEF analysis of each single metric compared to the human- annotation scores are presented in Table ...other metrics have reasonable ...
6
An Investigation of Machine Translation Evaluation Metrics in Cross lingual Question Answering
... uation metrics and QA accuracy, demonstrating that translation accuracy is, in fact, important for ...for translation in CLQA tasks, which is nat- ural given the importance of matching entities in ...
8