• No results found

out-of-vocabulary words

A Large Corpus of Product Reviews in Portuguese: Tackling Out-Of-Vocabulary Words

A Large Corpus of Product Reviews in Portuguese: Tackling Out-Of-Vocabulary Words

... the out-of-vocabulary words in such genre of texts in Portuguese (Section 3) and (iii) the compilation of six lexical resources made freely available at the website Lexical Normalization of Product ...

7

Exploiting Parallel Corpus for Handling Out-of-Vocabulary Words

Exploiting Parallel Corpus for Handling Out-of-Vocabulary Words

... kanji-hiragana words cannot be translated into English. Some words are normalized and transformed into differ- ent written forms as they are pronouned the same (kun homophones), which leads to ...

10

Normalization of NSW (Non Standard Words) using DSM model in case of OOV (Out-Of-Vocabulary) words

Normalization of NSW (Non Standard Words) using DSM model in case of OOV (Out-Of-Vocabulary) words

... (Out-Of- Vocabulary Words) which may not by recognized ...OOV words are coming under NSW (Non Standard ...Recognition) words are vast number of words recognized by the social ...

7

Resolving Out-of-Vocabulary Words with Bilingual Embeddings in Machine Translation

Resolving Out-of-Vocabulary Words with Bilingual Embeddings in Machine Translation

... Out-of-vocabulary words account for a large proportion of errors in machine trans- lation systems, especially when the sys- tem is used on a different domain than the one where it was ...for ...

6

Bilingual Character Representation for Efficiently Addressing Out of Vocabulary Words in Code Switching Named Entity Recognition

Bilingual Character Representation for Efficiently Addressing Out of Vocabulary Words in Code Switching Named Entity Recognition

... We propose an LSTM-based model with hierarchical architecture on named entity recognition from code-switching Twitter data. Our model uses bilingual charac- ter representation and transfer learning to address ...

5

Capturing Out of Vocabulary Words in Arabic Text

Capturing Out of Vocabulary Words in Arabic Text

... loan words, where terms of one language appear transliter- ated in ...such out of vocabulary words is essential for suc- cessful cross-lingual information ...all words in a collection, ...

9

Paraphrasing Out of Vocabulary Words with Word Embeddings and Semantic Lexicons for Low Resource Statistical Machine Translation

Paraphrasing Out of Vocabulary Words with Word Embeddings and Semantic Lexicons for Low Resource Statistical Machine Translation

... Translation results using different methods are shown in Table 1. “Baseline” denotes the system without OOV para- phrasing; “Word2vec” denotes the system paraphrased with the word embeddings obtained by word2vec; ...

5

Class based Prediction Errors to Detect Hate Speech with Out of vocabulary Words

Class based Prediction Errors to Detect Hate Speech with Out of vocabulary Words

... new words and/or varied misspellings is the ...ing out-of-vocabulary splits from abusive tweet data show promising results, out- performing competitive text categorization strategies by ...

5

Analysis of Morph Based Speech Recognition and the Modeling of Out of Vocabulary Words Across Languages

Analysis of Morph Based Speech Recognition and the Modeling of Out of Vocabulary Words Across Languages

... As words and morphs are units of different length, their optimal performance may occur at different or- ders of the ...and words) and Tur2 (5-grams for morphs, 3-grams for ...

8

Sentiment Lexicon Interpolation and Polarity Estimation of Objective and Out-Of-Vocabulary Words to Improve Sentiment Classification on Microblogging

Sentiment Lexicon Interpolation and Polarity Estimation of Objective and Out-Of-Vocabulary Words to Improve Sentiment Classification on Microblogging

... larity words. The objective and OOV words should not be revised if their estimated scores are not re- liable ...of words in the add-on lexicon to that of the ...polarity words were smaller ...

10

Incorporate Web Search Technology to Solve Out-of-Vocabulary Words in Chinese Word Segmentation

Incorporate Web Search Technology to Solve Out-of-Vocabulary Words in Chinese Word Segmentation

... Chinese word segmentation plays an important role in many Chinese language processing tasks. In the past decade it has drawn a large body of research in Chinese language processing community. A variety of methods have ...

10

Lexicon Stratification for Translating Out of Vocabulary Words

Lexicon Stratification for Translating Out of Vocabulary Words

... n × k translation candidates. The translation can- didates are noisy: some of the generated donors may be erroneous, the errors are then propagated in translation. To allow the low-resource system to leverage good ...

7

Few Shot Representation Learning for Out Of Vocabulary Words

Few Shot Representation Learning for Out Of Vocabulary Words

... There have been emerging research studies that utilize the above meta-learning algorithms to NLP tasks, including language modelling (Vinyals et al., 2016), text classification (Yu et al., 2018), machine translation (Gu ...

11

Improved Modeling of Out Of Vocabulary Words Using Morphological Classes

Improved Modeling of Out Of Vocabulary Words Using Morphological Classes

... are words that appear in the recognition task at hand, but not in the training set, so called out- of-vocabulary (OOV) ...OOV words in language modeling for ...groups words into classes ...

5

Graph Propagation for Paraphrasing Out of Vocabulary Words in Statistical Machine Translation

Graph Propagation for Paraphrasing Out of Vocabulary Words in Statistical Machine Translation

... Table 4 shows the intrinsic results on the Eu- roparl corpus when using unigram nodes in each of the graphs. The results are evaluated on the dev-set based on the gold alignment created us- ing GIZA++. Each node is ...

11

Graph based Filtering of Out of Vocabulary Words for Encoder Decoder Models

Graph based Filtering of Out of Vocabulary Words for Encoder Decoder Models

... rank words using co- occurrence are employed in many natural language processing ...represent words, and edges represent co-occurrences between words within a fixed window; TextRank then executes the ...

8

Magnitude: A Fast, Efficient Universal Vector Embedding Utility Package

Magnitude: A Fast, Efficient Universal Vector Embedding Utility Package

... or out-of- vocabulary words, quantization of vector models, exact and approximate similarity search, concate- nating multiple vector models together, and ma- nipulating models that are larger than a ...

7

Context encoders as a simple but powerful extension of word2vec

Context encoders as a simple but powerful extension of word2vec

... of words, word2vec remains one of the most popular neural language mod- els used ...the vocabulary, the model fails to optimally represent words with multiple meanings and, additionally, it is not ...

5

The LIG Machine Translation System for WMT 2010

The LIG Machine Translation System for WMT 2010

... We observed, in the French source corpra, a spe- cial French form which generates almost always Out-Of-Vocabulary words in the English transla- tion. The special French form, named euphonious “t”, ...

6

Assamese to English Statistical Machine Translation Integrated with a Transliteration Module

Assamese to English Statistical Machine Translation Integrated with a Transliteration Module

... identifying out the Out of Vocabulary words (OOV) and transliterating those words to avoid the presence of Assamese words in the target English ...OOV words which may be ...

5

Show all 10000 documents...

Related subjects