[PDF] Top 20 Choosing Transfer Languages for Cross Lingual Learning

... examine cross-lingual trans- fer in four NLP tasks: machine translation (MT), entity linking (EL), part-of-speech (POS) tagging and dependency parsing ...best transfer languages based on the ... See full document

... of cross- lingual unsupervised adaptation, although limited to the sort of linear projections that we argue are too simple for mapping between embeddings in distant ...unsupervised learning, propose ... See full document

... supervised learning, using word embed- dings as explanatory ...across languages by exploiting collections of cross-lingual embeddings aligned to a sin- gle vector ...across languages, ... See full document

... The best performing combination (in bold) varies between datasets. However, the “Char+Dense” combination seems to be the most reliable one, providing consistent and significant TL gains over all three evaluated corpora. ... See full document

... Table 3 also shows the results for English. Not surprisingly, since we have an order of magnitude more data for English, the model trained and tested on English data still performs better than any of the evaluated ... See full document

... of cross- lingual knowledge extraction by using the imbal- ance between Wikipedias of different ...this cross-lingual information extraction task as a transfer learning-based ... See full document

... different languages rarely cover the exact same semantic ...across languages using semantic relations that have been used to relate the meaning of En- glish ...a cross-lingual relation ... See full document

... where λ is used to scale the discriminator loss ( L d ). In this way, the generator is guided to build language-agnostic representations in order to fool the discriminator while being helpful for the pars- ing task. ... See full document

... all languages into a single semantic space so that words with similar meanings are close to each other regardless of ...other languages into English to obtain a multilingual embedding ... See full document

... We study the first point qualitatively by em- ploying three human users who are asked to use the system by giving 20 messages each. They have to eventually assign three scores to the system, Usability score, Fluency ... See full document

... for cross- lingual transfer of delexicalized ...low-resource languages. In a realistic experiment over cross-lingual POS tags and varying quantities of input text, our method ... See full document

... the learning-to-rank based method outper- forms the language-model based ...three learning to rank algorithms using Ranklib tool including Ran- dom Forests (RF-EToP-TQ-rev), ADARank (AD- EToP-TQ-rev) and ... See full document

... evaluation are given in Table 5, again comparing the results of projecting from English to that of the most accurate model for each target language. We see that there are large differences in accuracy across attributes ... See full document

... Amir Mohamed Yosef, Sandro Bauer, Johannes Hof- fart, Marc Spaniol, and Gerhard Weikum. 2012. Hyena: Hierarchical type classification for entity names. In Proceedings of COLING 2012: Posters. The COLING 2012 Organizing ... See full document

... the languages’ dis- tances to ...some languages that are closer to English, order-sensitive mod- els perform better, possibly benefiting from be- ing able to capture similar word ordering infor- ... See full document

... pared with the model with comparable F1 scores. This shows that the model learned with zero-shot can roughly identify the answer spans in con- text but less accurate. In row (c), we fine-tuned a BERT model pre-trained on ... See full document

... Furthermore, in the case of TRL, we hypothe- size a scenario in which we do not have access to a huge amount of data and avoid using ELMo as the input. We perform a preliminary experiment with a randomly initialized ... See full document

... multiple languages as the source languages. Since we have four languages for each of Germanic, Slavic, and Romance language families, we evaluated the per- formance of those languages using ... See full document

... The effect of L1 interference on lexical choice in L2 has been pointed out in a number of stud- ies (Chang et al., 2008; Rozovskaya, 2010; Ro- zovskaya, 2011; Dahlmeier and Ng, 2011). Some of these studies also ... See full document

... multiple languages to leverage transfer learning from a high-resource language to a low-resource ...close languages, we expect the en- fr system to benefit more from transfer ... See full document