[PDF] Top 20 Using Collocation Statistics in Information Extraction

... There are only a small number of collocational contexts in which the classication of a proper name can be reliably determined. In most cases, a clear decision cannot be reached based on a single collocational context. ... See full document

... To facilitate discussion of differences between the other techniques, Figures 9 and 11 show the same information as Figures 8 and 10 but without church . The recall curve for blaheta grows particularly smoothly. ... See full document

... a collocation is a syn- tactic and semantic ...corpus, information of its empirical context (frequencies of open-class words occurring within a specified context window) and left and right im- mediate ... See full document

... automatic extraction of collocations is typically carried out employing some statistic indicating concurrency in order to identify words that co-occur more often than expected by ...mutual information and a ... See full document

... . Lin [Lin 1997] proposed a distributional hypothesis which says that if two words have similar sets of collocations, then they are probably similar. According to one definition [Miller 1992], two expressions are ... See full document

... Visual comparison of precision-recall curves is a powerfull evaluation tool in many research fields (e.g. information retrieval). However, it has a seri- ous weakness. One can easily compare two curves that never ... See full document

... The first type of feature consists of simple doc- ument frequency statistics for source-target pairs throughout the corpus. The second type consists of document frequency counts of source-target pairs when they ... See full document

... of collocation number to unique occurrence number of the words and the fact that high levels of this ratio are vague and imprecise due to dependence to the size of corpus and occurrence of other ...of using ... See full document

... Automatic extraction of monolingual and bilingual collocations is important for many applications, including natural language generation, word sense disambiguation, machine translation, lexicography, and cross ... See full document

... The extraction engine identifies seven semantic classes of entities mentioned in a document, of which the most frequent are persons, organizations, and GPE’s (geo-political entities – roughly, regions with a ... See full document

... Two corpuses are used in the experiments: one is a one million small data corpus, namely corpusS [18], tokenized by linguists with chunking information as well as PoS tagging. Another is a larger corpus with half ... See full document

... CLASS, Collocation Linking Algorithm based on Syntax and Statistics, is a greedy method that selects collocation ...the collocation pairs ... See full document

... AMs using machine ...set. Collocation extraction has been treated as a classification problem with AMs as input features in (Pecina and Schlesinger, ... See full document

... To generalize the words in sentiment sentences, we proposed two kinds of semantic features. The first one is a suffix or prefix character feature (prefix(·) or suffix(·)). In contrast to English, the suffix (for noun) or ... See full document

... two-part collocation extraction association measures that do not estimate expected probabili- ties on the basis of the independence as- ...mutual information and pointwise mutual ...three ... See full document

... Language input to the web services can be plain text to be inserted by the user in a plain text field or by uploading a plain text file whose source location can be specified. Al- ternatively, various format converters ... See full document

... Several approaches were employed in order to automatically identify monolingual collocations (and other multiword expressions) from corpora. Most strategies use statistical association mea- sures on windows of n-grams ... See full document

... the extraction of synonymous words from monolingual corpora (Carolyn et ...the extraction of synony- mous words and/or patterns from bilingual corpora (Barzilay and Mckeown, 2001; Shimohata and Sumita, ... See full document

... in collocation identification, it is in- teresting to note that they have relatively little to do with the linguistic properties (such as those men- tioned at the beginning) which are typically associ- ated with ... See full document

... desire. Using our approach towards cor- pus analysis which calculates collocation sets for any given text corpus, the application of various filters results in a raw semantic net or ontology which ... See full document