[PDF] Top 20 Singletons and Coreference Resolution Evaluation

... of Coreference Resolu- tion has become an important enterprise in Natural Language ...with coreference resolution: the S EM E VAL 2010 task 1 “Coreference Resolution in Multiple ... See full document

... Our analysis shows that female entities are signif- icantly underrepresented in this corpus. To reduce the impact of such dataset bias, we propose to gen- erate an auxiliary dataset where all male entities are replaced ... See full document

... (Luo, 2005) without modifications. Yang et al. (2008) use only the MUC score. Bengtson & Roth (2008) and Stoyanov et al. (2009) derive variants from the B 3 algorithm (Bagga & Baldwin, 1998). Rahman & Ng ... See full document

... unrestricted coreference resolution that explores two key modeling techniques: latent coreference trees and automatic entropy-guided feature ...Empirical evaluation is performed on the ... See full document

... other coreference resolution sys- tems are publicly available ...based coreference resolution systems ...elements, evaluation settings and ... See full document

... that maximizes the desired evaluation metric on the training data. Experiments on development data showed that this step results in rather small but consistent improvements in our domain. As noted above, our ... See full document

... ... See full document

... the resolution of event coreference in an unsupervised way stem from (a) the choice of representing event mentions through a rich set of features and (b) the ability of modeling events described both within ... See full document

... invalid resolution of non-anaphors without additional ...the resolution of non-anaphors, and thus could be directly deployed to coreference ...The evaluation done on newswire domain shows that ... See full document

... systematic evaluation of different world knowl- edge sources for learning-based coreference reso- ...for coreference resolution, including FrameNet (Baker et ...to coreference-annotated ... See full document

... all evaluation metrics, while somewhat surpris- ingly being better ...for coreference resolution, improving the previous state of the art by ... See full document

... coreference resolution. Firstly, we consider the experimen- tal evaluation of projection method quality con- ducted by Grishina and Stede (2015) on the same dataset using gold annotations (without ... See full document

... state-of-the-art coreference resolver with additional links inferred by our system using all features and all world knowledge will improve the ...The evaluation of the “merged” output is presented in the ... See full document

... erence resolution, and ontology concept iden- tification — over full-text biomedical ...The coreference resolution task fo- cuses on linking coreferring base noun phrase mentions into chains using ... See full document

... Furthermore, including wrong linkage in the Recall equation prevents it from inflating com- pared to Precision when a large number of key mentions are incorrectly resolved. Evaluation is also sensitive to the ... See full document

... A coreference chain is defined by the property the ex- pressions it contains have to denote a specific discourse referent ...Our evaluation method so aims at evaluat- ing coreference ... See full document

... neural coreference models have advanced the state-of-the-art perfor- mance for coreference resolution, they are still trained with heuristic loss functions and make a sequence of local decisions for ... See full document

... However, the presence of a single correct coref- erent link is not sufficient for our intuition of suc- cessful resolution. Consider entities MZ22 and NW5 (Table 3): They also consist of two en- tities where only ... See full document

... Stanford coreference resolution system (Lee et ...entity coreference, such as exact string match and pronominal resolu- ...improve coreference resolution in two different ways: (i) ... See full document

... Most AL work focuses on instance selection where the unit of selection is one instance repre- sented as a feature vector. In this paper we also attempt document selection, where the unit of se- lection is a document, ... See full document