cross-modal
Adversarial Learning Based Semantic Correlation Representation for Cross-Modal Retrieval
... for cross-modal retrieval, which performs much better than traditional hand-crafted ...compact cross-modal hash codes from intra-modal and an inter-modal ...deep ...
19
Cross-Modal Transfer of Statistical Information Benefits from Sleep
... The second caveat regards the auditory task that preceded the visual task. In order to minimise and control task effects, we standardised the task order across participants, rather than have some participants whose ...
30
Abstraction as a basis for the computational interpretation of creative cross-modal metaphor
... Abstract. Various approaches to computational metaphor interpretation are based on pre- existing similarities between source and target domains and/or are based on metaphors already observed to be prevalent in the ...
14
Cross-modal deactivations during modality-specific selective attention
... During behavioral experiments, prominent performance decrements are observed for targets in the unattended modality. This suggests that an important neural conse- quence of modality-specific selective attention is the ...
11
A Model for the Cross-Modal Influence of Visual Context upon Language Procesing
... for cross- modal integration as proposed by ...For cross-modal interaction, we use integration constraints that stipulate to what degree the cross-modally integrated semantic repre- ...
6
Cross modal Retrieval of Chinese CQA Based on CCA Algorithm
... using cross-modal information such as text and ...CCA cross-modal retrieval ...get cross-model search results of questions and ...the cross-modal retrieval method based on ...
8
Aligning Multilingual Word Embeddings for Cross Modal Retrieval Task
... In recent years, there has been a huge and sig- nificant amount of research in text and image re- trieval tasks which needs the joint modeling of both modalities. Further, a large number of image- text datasets have ...
7
Time matters less when outcomes differ: uni modal versus cross modal comparisons in intertemporal choice
... making cross-modal choices we may care less about when the good is received, because we construe the options in terms of their more abstract and functional character- istics (perhaps improving a ...
16
Coupled CycleGAN: Unsupervised Hashing Network for Cross-Modal Retrieval
... efficiently. Cross- modal retrieval, which aims to search the images ...based cross-modal retrieval, mapping multi-modal data into compact binary codes and conducting retrieval via fast ...
8
Multi and Cross Modal Semantics Beyond Vision: Grounding in Auditory Perception
... Multi-modal models that rely on raw image data have typically used “bag of visual words” (BoVW) representations (Sivic and Zisserman, 2003). We follow a similar approach for the auditory modality and construct bag ...
10
Summarizing Complex Events: a Cross Modal Solution of Storylines Extraction and Reconstruction
... In this paper, we study the feasibility of automati- cally generating cross-modal story maps and present a novel solution to this challenging problem. Our works mainly tackle the problems of storylines ex- ...
11
Attribute Guided Network for Cross Modal Zero Shot Hashing
... In order to address the CMZSH problem, both the require- ments of knowledge transferability from seen categories to unseen categories and cross-modal retrieval should be fulfilled. Attributes and word ...
19
Visual, Auditory and Cross Modal Lexical Decision: A Comparison between Dyslexic and Typical Readers
... Taking into consideration the limitations of the information processing system, which pertain to the decoding activity as well, the decoding process among dyslexics is lengthy and is not synchronized in terms of speed. ...
16
Is this a wampimuk? Cross modal mapping between distributional semantics and the visual world
... ment in the future with more sophisticated neural network architectures inspired by recent work in machine translation (Gao et al., 2013) and mul- timodal deep learning (Srivastava and Salakhut- dinov, 2012). ...
12
The Cross-modal Representation of Metaphors
... correlations or the structural similarity between two domains; metaphor helps to structure our ordinary conceptual system; and metaphor can be grounded in the body or socio-cultural experiences. According to Lakoff and ...
9
Do Neural Network Cross Modal Mappings Really Bridge Modalities?
... Neural network and linear mappings are popu- lar tools to bridge modalities in cross-modal re- trieval systems. Lazaridou et al. (2015b) leverage a text-to-image linear mapping to retrieve images given text ...
7
Enhancing emotional experiences to dance through music: the role of valence and arousal in the cross-modal bias
... the cross-modal ...extent cross-modal influences impact not only our perception and conscious affective experiences, but also our psychophysiological emotional ...a cross-modal ...
10
Cross Modal Commentator: Automatic Machine Commenting Based on Cross Modal Information
... of cross-modal automatic commenting, which aims at enabling the AI agent to make comments by integrating multiple modal ...multiple modal information and co-attention, the generated comments ...
7
Semantic Correlation based Deep Cross Modal Hashing for Faster Retrieval
... based cross-modal hashing techniques are currently hot research topic where feature extraction as well as generation of the hash code can be achieved in the common ...Deep Cross-modal hashing ...
5
5-HTR2A and 5-HTR3A but not 5-HTR1A antagonism impairs the cross-modal reactivation of deprived visual cortex in adulthood
... Upon ISH, the cryostat sections were Nissl-counterstained (1% cresyl violet; Fluka, Sigma-Aldrich) according to standard procedures to visualize cortical boundaries be- tween different visual and somatosensory areas and ...
19