[PDF] Top 20 Low Rank Tensors for Verbs in Compositional Distributional Semantics

... tensor rank decomposi- tion (Kolda and Bader, 2009) to represent each verb’s tensor as a sum of tensor products of vec- ...full tensors and thus we are able to improve on both memory usage and ...using ... See full document

... to semantics (sometimes called distribu- tional semantics ) naturally captures collocations, scales well to large lexicons and does not require words to be manually disambiguated (Sch¨ utze, ...adjectives, ... See full document

... positional distributional semantic framework in the vein of that of Coecke et ...the compositional mechanism of Baroni and Zamparelli (2010) as a specific case, thereby uniting both lines of research in a ... See full document

... example, verbs like eat can be used in transitive or intransitive construc- tions (children eat meat/children eat), or in passive (meat is ...ing verbs (demolish) would become tensors, which makes ... See full document

... adjectives, verbs or adverbs) in the corpus. We built a rank of these co-occurrence counts, and excluded as stop words from the dimensions any element of any POS whose rank was from 0 to ... See full document

... We use the experimental setting previously described (Vecchi et al., 2011; Kochmar and Briscoe, 2013) and populate the semantic space with the constituent nouns and adjectives from the test ANs, frequent nouns and ... See full document

... We situate our work within the Categorial framework (Coecke et al., 2010; Baroni et al., 2014; Clark, 2013, 2015) where nouns and sen- tences are considered atomic types, represented as vectors, and other words as ... See full document

... about 2.8 billion tokens. 4 We collect co-occurrence statistics for the top 8K Ns and 4K As, plus any other word from our NP dataset that was below this rank. Our context elements are composed of the top 10K ... See full document

... Table 5 shows the results for the baseline methods, using Count, Count-SVD, and Skip- Gram vectors. The highest MAP score for all three types of vectors is achieved with vector addition, adding the vectors for head noun, ... See full document

... with compositional meanings of phrases and ...as verbs, adjectives, and prepositions, in an intuitive relational manner, but also to stay faithful to their original linguistic ... See full document

... Compositional distributional semantics is a subfield of Computational Linguistics which investigates methods for represent- ing the meanings of phrases and sen- ...verb tensors on a sentence ... See full document

... glish consisting of the same amount of spoken, fiction, mag- azine, newspaper, and academic prose data for each year between 1990 and 2012. Admittedly, a more ecologically valid choice would have been to use data from a ... See full document

... so-called distributional hypothesis that words that occur in similar contexts tend to have similar meanings, and to various proposals for how to implement this hypothesis (Curran, 2004), including alternative ... See full document

... areas, low rank approaches based on matrix factorization play a central role (Lee and Seung, 2001; Salakhutdinov and Mnih, 2008; Mackey et ...the low rank representation of a user’s (sparse) ... See full document

... Modern NLP models rely heavily on engi- neered features, which often combine word and contextual information into complex lexi- cal features. Such combination results in large numbers of features, which can lead to over- ... See full document

... Accurate multilingual transfer parsing typ- ically relies on careful feature engineer- ing. In this paper, we propose a hierar- chical tensor-based approach for this task. This approach induces a compact feature ... See full document

... On compositional semantics On compositional semantics W I o d e k Z a d r o z n y I B M Research T J W a t s o n R e s e a r c h C e n t e r Y o r k t o w n H e i g h t s , N Y 10598 W L O D Z @ WATSO[.] ... See full document

... provides distributional repre- sentations of determiners, nouns and ...and low nu- merals (one to four), to multi-word units analyzed as single determiners in the literature, such as a few, all that, too ... See full document

... We proposed the Forest Convolutional Network FCN model that addresses the three issues: 1 how to make the composition functions adaptive, 2 how to deal with different branching factors o[r] ... See full document

... More recent approaches explored a broader range of features. Among others, Toutanova et al. (2008), Martins and Almeida (2014) and Yang and Zong (2014) have explored high-order features involving several arguments and ... See full document