[PDF] Top 20 Discriminating between Similar Languages using Weighted Subword Features

... Table 2 shows the extraction, training, and test- ing times for n-gram lengths with a mininum of 2. One can conclude that the method is computa- tionnally efficient on the shared task data. Execu- tion with feature ... See full document

... the languages in Group F, and an evaluation for groups A-E was therefore performed separately; we discuss only this latter task and evaluation ...into discriminating between pairs or triples of ... See full document

... Discriminating between similar languages (DSL) on conversational texts is a challenging ...at discriminating between limited-resource languages on short conversational ... See full document

... the Discriminating between Similar Languages (DSL) shared task, which was organized as part of the VarDial’2016 workshop at ...very similar lan- guages and language varieties in ... See full document

... nized similar languages and language varieties using the re- sults of the first two DSL shared ...next. Using plurality voting and oracle, we estimate an upper bound on the achievable ... See full document

... Discriminating between similar languages or language varieties aims to detect lexical and semantic variations in order to classify these varieties of ...the Discriminating ... See full document

... ”Discriminating between similar languages” (DSL) shared ...discriminate between languages or variants within the ...predicted using a generative classifier with ... See full document

... Discriminating between Similar Lan- guages (DSL) is a challenging task addressed at the VarDial Workshop ...distinguish similar language ...to discriminating between ... See full document

... (Discriminating Similar Lan- guages) shared task has been organized in 2014 and the task participants presented their systems at the VarDial workshop at COLING ...of similar languages and ... See full document

... the Discriminating between Similar Languages shared task, I introduce an additional decision factor focusing on the token and subtoken ...classifier using a contrastive word and ... See full document

... the Discriminating between Similar Languages (DSL) shared task, held at the VarDial 2017 ...14 languages across 6 language groups using a corpus of excerpts of journalistic ... See full document

... Marco Lui, Ned Letcher, Oliver Adams, Long Duong, Paul Cook, and Timothy Baldwin. 2014. Explor- ing methods and resources for discriminating simi- lar languages. In Proceedings of the First Workshop on ... See full document

... second Discriminating Similar Languages shared task (DSL 2015) aimed to discriminate between 15 similar languages and varieties, with an added “other” ...of features: ... See full document

... trained using categorical cross entropy loss function for both outputs using Adam optimization ...realized using Keras (Chollet, 2015) with Tensorflow backend (Abadi et ... See full document

... Our preliminary experiments confirmed earlier findings that NN-based approaches are outper- formed by more simple linear models for language identification (C¸¨oltekin and Rama, 2016; Gamallo et al., 2016). We compared ... See full document

... discrimination between closely-related languages (Ljubeˇsi´c et ...confusable languages, such as Malay/Indonesian (Ranaivo-Malancon, 2006), South-Eastern European languages (Tiedemann and ... See full document

... Comparing between Figure 2 and Figure 3 shows that using extra training data has reduced the classification confusion in most cases, except for Levantine Arabic which is more confused with Gulf ... See full document

... two languages, our two-stage pro- cess makes it possible to rely on a simple binary classifier within each group, and avoid the extra complexity that comes with multiclass ... See full document

... Uralic languages from the ...Uralic languages (Kone Foundation, ...relevant languages based on the ISO 639- 3 division of the Uralic languages (SIL, ...relevant languages, such as ... See full document

... els, which were the best systems according to other evaluations (Padr`o and Padr`o, 2004). Finally, it will be very useful to perform a sound qualitative error analysis of the language varieties we know well: Por- ... See full document