Unknown words
Pointing the Unknown Words
... and unknown words is an important issue that can potentially effect the performance of many NLP sys- tems, including traditional count-based and deep learning ...unseen words for the neural network ...
10
A Collaborative Framework for Collecting Thai Unknown Words from the Web
... Thai unknown words found on Web pages over the ...Thai unknown-word open ...extracting unknown words from Web pages of given ...of unknown- word candidates which are presented to ...
8
The Typology of Unknown Words: An Experimental Study of Two Corpora
... The Typology of Unknown Words An Experimental Study of Two Corpora The Typology of Unknown Words An Experimental Study of Two Corpora Xiaobo Ren and Francois Perrault xren@ccrit doc ca, perra ult@ ccr[.] ...
7
A Method for Automatic POS Guessing of Chinese Unknown Words
... The model based on CRFs is trained on the Modern Chinese Grammar Information Dictionary (Yu, 1998) and tested on the Contemporary Chinese Corpus of Peking University (Yu et al., 2002). The corpus is seg- mented and ...
8
Guessing Parts of Speech of Unknown Words Using Global Information
... of unknown words in the unlabeled data are ...that unknown words can have, de- scribed later), the sizes of training, test and un- labeled data, and the splitting method of ...data, ...
8
Hybrid Models for Semantic Classification of Chinese Unknown Words
... the words containing ...an unknown word and those of its component characters in three different ways, and combine two of them with a corpus-based model that uses contextual information to clas- sify ...
8
Translating Chinese Unknown Words by Automatically Acquired Templates
... of unknown words. When an unknown word is detected during translation, the model applies translation templates to the word to get a set of matched templates, and then translates the word into a set ...
5
A Multi Domain Web Based Algorithm for POS Tagging of Unknown Words
... of unknown words (words appearing only a small number of times in the training data of a super- vised POS ...an unknown word u is to be tagged by a trained POS tagger, our algo- rithm collects ...
9
Handling Unknown Words in Arabic FST Morphology
... recognizes words that it already knows in the lexical ...coined words with high ...extracting unknown words, lemmatizing them, and giving them a priority weight for inclusion in a ...
5
Hierarchical Memory Networks for Answer Selection on Unknown Words
... and unknown word problem as an important issue should be considered in NLP tasks, especially for QA task, where the words that we are mainly interested in are usually named entities which are mostly ...
10
Pruning False Unknown Words to Improve Chinese Word Segmentation
... and unknown word detection at the same ...known words is higher; and on the contrary if it focuses on unknown word detection, then the recall for unknown words is higher but the ...
12
A Corpus-based Approach to the Interpretation of Unknown Words with an Application to German
... These unknown words constitute a huge problem for NLP analysis tasks like POS-tagging or syntactic ...of unknown words that only needs a tokenized corpus and can be used in both offline and ...
6
Hybrid Methods for POS Guessing of Chinese Unknown Words
... disyllabic words. The trigram model covers all un- known words, but its precision needs to be ...longer words, but those are handled effectively by the rule-based ...trisyllabic unknown ...
6
A Hybrid Model for Sense Guessing of Chinese Unknown Words
... Abstract. This paper proposes a hybrid model to address the task of sense guessing for Chinese unknown words. Three types of similarity, i.e., positional, syntactic and semantic similarity, are analyzed; ...
10
Positioning Unknown Words in a Thesaurus by Using Information Extracted from a Corpus
... Positioning Unknown Words in a Thesaurus by Using Information Extracted from a Corpus P o s i t i o n i n g U n k n o w n W o r d s i n a T h e s a u r u s b y U s i n g I n f o r m a t i o n E x t r[.] ...
6
Morphological features help POS tagging of unknown words across language varieties
... that unknown words were a major source of difficulty in cross-variety ...tagging. Unknown words in English tend to be proper ...Mandarin unknown words were mostly common nouns ...
8
Translating Unknown Words by Analogical Learning
... Unknown words are a well-known hindrance to natural language applications. In particu- lar, they drastically impact machine transla- tion quality. An easy way out commercial translation systems usually ...
10
Dealing with Unknown Words in L2 Reading: Vocabulary and Lexical Inferencing Strategies
... Vocabulary learning strategies constitute a subclass of language learning strategies which can be applied to the four language skills. The aim of the present study is to explore the vocabulary strategies adopted by adult ...
15
A Neural Language Model for Dynamically Representing the Meanings of Unknown Words and Entities in a Discourse
... the unknown word problem used in recent studies (Kim et ...of unknown words from character em- beddings or subword ...common words using word embeddings, applied through a gating function ...
11
Processing Unknown Words in HPSG
... Processing Unknown Words in HPSG Processing Unknown Words in HPSG Petra Barg and M a r k u s Walther* S e m i n a r ftir A l l g e m e i n e S p r a c h w i s s e n s c h a f t H e i n r i c h ~ H e i[.] ...
5