Evaluation Metrics
Usability Evaluation Metrics of Tourism Mobile Applications
... suitable metrics as per suggested by the ...the metrics moved to suitable metrics. Metrics are being selected from the pro- posed usability evaluation metrics of tourism mobile ...
11
Linguistically Aware Coreference Evaluation Metrics
... score of a participating coreference resolver. One weakness shared by virtually all exist- ing coreference evaluation metrics is that they are linguistically agnostic, treating the mentions to be clustered ...
9
Representation Based Translation Evaluation Metrics
... translation evaluation metrics based on three widely used representa- ...representation metrics obtain bet- ter correlations with human judgment on both system-level and segment-level, compared to ...
6
Evaluation without references: IBM1 scores as evaluation metrics
... Current metrics for evaluating machine trans- lation quality have the huge drawback that they require human-quality reference transla- ...new metrics and human judgments are cal- culated on the data of the ...
5
A stakeholder assessment of basketball player evaluation metrics
... player evaluation metrics, and stakeholders have different levels of ...these metrics to make decisions, journalists write their columns in function of the rating system used, agents bargain about ...
31
Optimizing Differentiable Relaxations of Coreference Evaluation Metrics
... Coreference evaluation metrics are hard to optimize directly as they are non- differentiable functions, not easily decom- posable into elementary ...
10
Effective Question Answering Techniques and their Evaluation Metrics
... Question Answering (QA) is a focused way of information retrieval. Question Answering system tries to get back the accurate answers to questions posed in natural language provided a set of documents. Basically question ...
8
Evaluation Metrics for Knowledge Based Machine Translation
... Evaluation Metrics for Knowledge Based Machine Translation Evahmtion Metrics t'oi Knowledge Based Machine Translation E r i c I1 N y b e r g , 3 r d T e r u k o M i t a m u r a J a i m c G C a r b o n[.] ...
5
BLANC: Learning Evaluation Metrics for MT
... We introduce B LANC , a family of dy- namic, trainable evaluation metrics for ma- chine translation. Flexible, parametrized models can be learned from past data and automatically optimized to correlate well ...
8
Evaluation Metrics for Automatic Temporal Annotation of Texts
... of evaluation metrics of such in- formation, aiming at fair comparisons between systems, re- gardless of certain bias that are artificially introduced in current ...original metrics and their ...
6
A Survey of Accuracy Evaluation Metrics of Recommendation Tasks
... some evaluation metric. Indeed, many evaluation metrics have been suggested for comparing recommendation ...proper evaluation metric is often critical, as each metric may favor a different ...
28
Combining Coherence Models and Machine Translation Evaluation Metrics for Summarization Evaluation
... 2011 metrics and our three met- rics on both initial and update ...our metrics with a circle on these ...4b, evaluation metrics al- ways correlate better on the initial task than on the update ...
9
Meta evaluation of online and offline web search evaluation metrics
... studies, evaluation plays an essential part in Web search ...uation metrics are adopted in measuring the performance of search ...Offline metrics are usually based on relevance judgments of ...
10
Evaluation Metrics for Persuasive NLP with Google AdWords
... The paper is structured as follows: section 2 presents the main AdWords features, while section 3 describes how these features can be used for defining message persuasive- ness metrics. Section 4 describes some ...
5
Evaluation Metrics for Automatically Generated Metaphorical Expressions
... The result of 10% is shown in Table 6. The volunteer preferred 8 high-ranked expressions in 10 pairs. We regard the overall evaluation as valid in that high-ranked ones are preferred in most cases. Changing the ...
9
SParseval: Evaluation Metrics for Parsing Speech
... Since the SParseval tool was developed to cope with word and sentence segmentation mismatch that arises when parsing speech, we examine the impact of these factors on the metrics. Due to space limitations, we will ...
6
Methodologies to Develop Quantitative Risk Evaluation Metrics
... The goal of this work is to advance a new methodology to measure a severity cost for each host using the Common Vulnerability Scoring System (CVSS) based on base, temporal and environmental metrics by combining ...
8
Modulated evaluation metrics for drug-based ontologies
... The National Center for Biomedical Ontologies (NCBO) is a NIH-funded program to provide support tools, and a repository to store a wide range of ontologies from the biomedical field. Based on a random survey sam- ple of ...
8
Evaluating Evaluation Metrics for Minimalist Parsing
... All four measures are also divided into two sub- types depending on whether unpronounced leaves (e.g. the empty T-head in Fig. 1) are taken into ac- count — this is inspired by the exclusion of un- pronounced material in ...
9
Performance Evaluation of Distance Metrics in the Clustering Algorithms
... This section provides a description of the datasets and demonstrate the efficiency of well-known clustering algorithms based on ten different distance measures. The results are evaluated and compared using some widely ...
14