word frequencies
Characterizing Text Difficulty with Word Frequencies
... a word in common language use, and systemat- ically explore how such a word-level feature is best used to characterize the reading lev- els of texts, a text-level classification ...such word-level ...
11
Evaluating the effect of word frequencies in a probabilistic generative model of morphology
... Unsupervised morphology learning is concerned with the task of learning models of word-internal structure. By definition, a probabilistic genera- tive model describes the joint distribution of mor- phological ...
8
Extending the Cochran rule for the comparison of word frequencies between corpora
... full word frequency range. The 2 × 2 tables for comparing word frequencies across corpora are, in general, not as heavily skewed as for bigram data, so the log-likelihood ratio is suitable for our ...
12
Producing Power-Law Distributions and Damping Word Frequencies with Two-Stage Language Models
... corpus frequencies yields better morphological segmentations than learning directly from corpus frequen- ...corpus frequencies brings the assumptions of the model and the data more in line, whereas using ...
48
SUBTLEX- AL: Albanian word frequencies based on film subtitles
... that word frequency estimation based on subtitle files explains better the variance in word recognition performance than traditional words frequency estimates ...
8
The Role of Utterance Boundaries and Word Frequencies for Part of speech Learning in Brazilian Portuguese Through Distributional Analysis
... context word, only the occurrence (or not) of it is ...uses frequencies and the “cityblock” metric, al- lowing for a better comparison with the standard ...
8
Text Genre Detection Using Common Word Frequencies
... Microsoft Word coling2000 doc ? 7H[W?*HQUH?'HWHFWLRQ?8VLQJ?&RPPRQ? RUG?)UHTXHQFLHV? ? (??67$0$7$726??1??)$ 27$ ,6??DQG?*?? 2 ,1$ ,6? 'HSW??RI?(OHFWULFDO?DQG?&RPSXWHU?(QJLQHHULQJ? 8QLYHUVLW\?RI?3DWUDV?[.] ...
7
Creation and Analysis of a New Bangla Text Corpus BDNC01
... the word frequency and the fact is very influential in news paper ...some word types frequently, it may have a convention to use a language style or it may be biased with a political or social group ...on ...
9
Volume 2, Issue 3, March 2013 Page 505
... Figure 1 shows our framework to filter spam. The training dataset is the set of email that gives us a classification result. The test data is actually the email will run through our system which we test to see if ...
5
Using Multiple Knowledge Sources for Word Sense Discrimination
... To discriminate senses, an understander can consider a diversity of information, including syntactic tags, word frequencies, collocations, semantic context, role-related expectations, an[r] ...
30
Vocabulary Choice as an Indicator of Perspective
... while word recurrence has mainly to do with the topical composition of the ...tracing word frequencies is not going to be effective for perspective classification beyond noting the mere ...
5
A user centric model of voting intention from Social Media
... Social Media contain a multitude of user opinions which can be used to predict real- world phenomena in many domains in- cluding politics, finance and health. Most existing methods treat these problems as linear ...
11
The age of crime: A cognitive linguistic critical discourse study of media representations and semantic framings of youth offenders in the Uruguayan media
... via word frequencies and collocations) in a corpus of 489 articles (approximately 220,000 words) with youngsters as a thematic centre, followed by a fine-grained concordance analysis which focuses on ...
24
The Development and Evolution of Chinese Culture Communication Research Based on Social Network Analysis
... of word frequency, it was found that there were 86 word frequencies greater than 4 or equal to 4 at this stage, and the nodes at the core were still culturally propagated, with a centrality of ...
9
Chinese translation norms for 1429 English words
... the word frequencies of the English words and the Chinese translations (dominant translation) and for pairs that are unambiguous and ...the word frequency of English words and their French ...
14
Deconfounded Lexicon Induction for Interpretable Social Science
... We also compare the proposed algorithms: Deep Residualization using word frequencies DR+BOW and embeddings DR+ATTN, and Adversarial Selection using word frequencies A+BOW and embeddings [r] ...
11
Does Lexical Frequency affect rater judgement of essays? An experimental design using quantitative and qualitative data
... when word frequencies are relatively close together, even highly educated individuals in the field of linguistics (or related) have a hard time distinguishing between which words are of higher or lower ...
97
Understanding and Quantifying Creativity in Lexical Composition
... their Frequencies: To gain insights on the stratified sample of word pairs, we plot the label ( ∈ {creative, common} ) distribution of word pairs as a function of simple statistics, such as a range ...
13
How to Avoid Burning Ducks: Combining Linguistic Analysis and Corpus Statistics for German Compound Processing
... the word Inflation is greater than the frequency of the word Inflations); the same holds for deletable letters and hyphens ...characters. Word fre- quencies are derived from the true-cased corpus ...
11
Laws About Frequencies
... suppositions – for P would not still have been true had something logically inconsistent with P been true, for example. And perhaps P would not still have been true had some of the actual laws of nature not been laws, or ...
66