[PDF] Top 20 A Two level Classifier for Discriminating Similar Languages

... Marco Lui, Ned Letcher, Oliver Adams, Long Duong, Paul Cook, and Timothy Baldwin. 2014. Explor- ing methods and resources for discriminating simi- lar languages. In Proceedings of the First Workshop on ... See full document

... Distinguishing between spoken Arabic varieties is also an active research area as there are sufficient phone and TV program recordings which are easy to transcribed. “The problem is somewhat mitigated in the speech ... See full document

... the Discriminating between Similar Languages (DSL) shared task, which was organized as part of the VarDial’2016 workshop at ...offered two subtasks: subtask 1 focused on the identification of ... See full document

... 2016b. Discriminating between Similar Languages and Arabic Dialect Identification: A Report on the Third DSL Shared ...Related Languages, Varieties and Dialects (VarDial), Osaka, ... See full document

... Not all varieties are to be considered equally since differences may stem from extra-linguistic factors. It is for instance assumed that Malay and Indonesian derive from a millenium-old lin- gua franca, so that shorter ... See full document

... into two main sub-tasks. Sub-task 1 aims at discriminating between similar languages and national language varieties; whereas Sub-task 2 focuses on Arabic dialect ...for two different ... See full document

... MaxEnt classifier with morphologi- cal features to discriminate between Uyghur and Kazakh conversational ...character level features we exploited are helpful while em- ploying the word unigrams led to worse ... See full document

... the softmax function (Barto, 1998), its normal- ization depends on the vocabulary size W which makes its usage impractical for high values of W . For this reason, more computationally efficient al- ternatives are used ... See full document

... the classifier predicting the specific language ...‘Group classifier’ and ‘Language / variety classifier’ in Figure 1 may include multiple layers for allowing the classifier to generalize ... See full document

... the Discriminating between Similar Languages (DSL) shared task, held at the VarDial 2017 ...14 languages across 6 language groups using a corpus of excerpts of journalistic ...texts. ... See full document

... In terms of features, the majority of the groups in previous years used sequences of characters and words. A notable exception is the use of word white-lists by Porta and Sancho (2014). Different learning algorithms were ... See full document

... on discriminating similar ...the two- stage approach (predicting language/group, then variant) to a flat ...the two-stage approach performs slightly better, everything else being kept equal, ... See full document

... of discriminating between similar languages presenting a system to discriminate between five languages of the Indo-Aryan family: Hindi, Braj Bhasha, Awadhi, Bhojpuri, and ... See full document

... Regarding the choice of only participating in the closed submission track, we first analysed the results of the 2014 edition where we realised that only two teams decided to participate in both open and closed ... See full document

... sented two very basic systems: classification with ranked dictionaries and Naive Bayes ...between languages on the basis of the perplexity of their ... See full document

... approach similar to the ones presented in the related work ...to two research questions: (i) are the linguistic patterns linked to each proficiency level in our two L2 languages ... See full document

... between similar languages is still not a fully solved problem – no known system reaches perfect ...a two-layer approach in which languages are first classified based on language groups barely ... See full document

... for Similar Languages, Varieties and ...including two task re-runs – Arabic Dialect Identification (ADI) and German Dialect Identification (GDI) –, and three new tasks – Mor- phosyntactic Tagging of ... See full document

... For Group F, FO1 utilizes ERG lexical type features in the same manner as FC1, the difference being that FC1 uses the shared task trn partition, whereas FO1 uses sentences sampled from existing corpora, specifically BNC ... See full document

... asked two native English speakers to perform a human evaluation on a small sample of the training and development data, which confirmed both our suspicion, and the fact that this was a difficult ... See full document