[PDF] Top 20 Discriminating between Similar Languages Using PPM

... As it is seen from the table, Bulgarian and Macedonian can be reliably distinguished due to several specific characters in Macedonian alpha- bet which are frequent enough to appear in any sentence despite of the ... See full document

... the languages in Group F, and an evaluation for groups A-E was therefore performed separately; we discuss only this latter task and evaluation ...into discriminating between pairs or triples of ... See full document

... Discriminating between similar languages (DSL) on conversational texts is a challenging ...at discriminating between limited-resource languages on short conversational ... See full document

... The BRUniBP team’s submission is pre- sented for the Discriminating between Similar Languages Shared Task 2015. Our method is a two phase classifier that uti- lizes both character and ... See full document

... the Discriminating between Similar Languages (DSL) shared task, which was organized as part of the VarDial’2016 workshop at ...very similar lan- guages and language varieties in ... See full document

... nized similar languages and language varieties using the re- sults of the first two DSL shared ...next. Using plurality voting and oracle, we estimate an upper bound on the achievable ... See full document

... Discriminating between similar languages or language varieties aims to detect lexical and semantic variations in order to classify these varieties of ...the Discriminating ... See full document

... ”Discriminating between similar languages” (DSL) shared ...discriminate between languages or variants within the ...predicted using a generative classifier with ... See full document

... Discriminating between Similar Lan- guages (DSL) is a challenging task addressed at the VarDial Workshop ...distinguish similar language ...to discriminating between ... See full document

... The present contribution revolves around a contrastive subword n-gram model which has been tested in the Discriminating be- tween Similar Languages shared task. I present and discuss the method used ... See full document

... the Discriminating between Similar Languages shared task, I introduce an additional decision factor focusing on the token and subtoken ...classifier using a contrastive word and subword ... See full document

... the Discriminating between Similar Languages (DSL) shared task, held at the VarDial 2017 ...14 languages across 6 language groups using a corpus of excerpts of journalistic ... See full document

... second Discriminating Similar Languages shared task (DSL 2015) aimed to discriminate between 15 similar languages and varieties, with an added “other” ... See full document

... Our preliminary experiments confirmed earlier findings that NN-based approaches are outper- formed by more simple linear models for language identification (C¸¨oltekin and Rama, 2016; Gamallo et al., 2016). We compared ... See full document

... of languages from text had been reported in studies over two decades ago (Beesley, 1988; Cavnar and Trenkle, 1994; Dunning, ...the languages to be discriminated are closely related (Tiedemann and Ljubeši´c, ... See full document

... discrimination between closely-related languages (Ljubeˇsi´c et ...confusable languages, such as Malay/Indonesian (Ranaivo-Malancon, 2006), South-Eastern European languages (Tiedemann and ... See full document

... Comparing between Figure 2 and Figure 3 shows that using extra training data has reduced the classification confusion in most cases, except for Levantine Arabic which is more confused with Gulf ... See full document

... We described the National Research Council’s entry to the second shared task on Discriminat- ing between similar languages. Our system uses a fairly straightforward processing and modeling approach, ... See full document

... els, which were the best systems according to other evaluations (Padr`o and Padr`o, 2004). Finally, it will be very useful to perform a sound qualitative error analysis of the language varieties we know well: Por- ... See full document

... inate between the six language ...up using character n-grams from 7 to 1 characters in ...below) between the groups perfectly on both the development and the test data, if we are not considering the ... See full document