[PDF] Top 20 On Coreference Resolution Performance Metrics

... a coreference system – that is, an intuitively better system would get a higher score than a worse system, and is easy to ...that coreference systems are to recognize entities and propose a metric called ... See full document

... individual coreference resolvers in a collaborative ...growing coreference entities, with the objec- tive of getting a partition similar to the individual ...task-specific metrics, such as, for ... See full document

... Link selection yields a CR system that proposes a lot of singleton entities that are not coreferent with any other entity. The MUC scoring scheme does not give credit to singletons at all, thus the lower recall. ... See full document

... Statistical Statistical methods, often with mil- lions of parameters, ultimately surpassed the per- formance of rule-based systems on shared task data (Durrett and Klein, 2013; Bj¨orkelund and Kuhn, 2014). The system of ... See full document

... 2003 coreference corpus, which is composed of three sections: Broadcast News (BNEWS), Newswire (NWIRE), and Newspaper ...same performance trends can be observed on NPA- PER as ...the coreference ... See full document

... effective coreference model. Our work advances the state-of-the-art in coreference resolution by bringing learning- based coreference systems to the next level of ...2005 coreference ... See full document

... We submitted to the closed tasks for English and Chinese. The results on the English development set and testing set are displayed in Table 1 and Table 2 respectively. To indicate the progress we achieved within one ... See full document

... to coreference resolution, which we experimentally demonstrate as highly ...on performance along with the learning ...unrestricted coreference resolution task (dos Santos and Carvalho ... See full document

... a coreference resolution system but are not included in the gold data, or vice ...system performance, and Stoyanov et ...the metrics were updated to obtain ”better alignment for B 3 and CEAF ... See full document

... 3) Although each event mention is represented as a feature-rich linguistic object, there is no guarantee that all the features that describe event mentions have a positive impact for the task of event coreference. ... See full document

... Finally, Relax performances are compared with the best scores we have found using the same cor- pora and metrics. We compare our approach with specialized Rankers –groupwise classifier–, and a system using ILP not ... See full document

... Analyzing the results, we also found overmergings not implying any explicit contradictions. For example, in the sentence He sat near him, both he propositions are unlikely be coreferential, but our framework fails to ... See full document

... paging performance as observed in Omiecinski and Scheuermann ...additional performance gains by hashing the clusters based on the constituent mention string (details ... See full document

... Starting from Soon et al. (2001)’s feature set, we performed a greedy forward selection. The fea- ture selection used a 5-fold cross-validation over the training set, where we evaluated the features using the arithmetic ... See full document

... correct coreference link but the wrong, short mention span, the Avenue, has con- siderable effects to the overall ...evaluation metrics leading to a decrease in mention detection and coreference ... See full document

... The performance enhanced by the dictionaries we used for the open task are limited because the open dictionaries information which appears in the test data is not much more than that of the closed dictionaries ... See full document

... Clearly, our approach outperforms all baselines for both pronominal and non-pronominal men- tions, and across all metrics. On all mentions, our best classifier yields an absolute F1 increase of 13 points over ... See full document

... for coreference resolution systems, and identifying singletons be- fore mentions are linked improves res- olution ...Berkeley coreference resolution systems shows significant improvement for ... See full document

... event coreference resolution ...erence resolution with the ECB+ corpus is somewhat easier than with the KBP corpus, which partly explained the signif- icant differences of published in-document event ... See full document

... A natural language processing engineer might be in- terested in improving the performance of a corefer- ence resolution system since it is necessary for an- other task. The needs may differ depending on the ... See full document