language and vision
Exploiting Text Corpora for Data Enrichment in Language and Vision Applications
... natural language processing and computer vision ...a language model is often used to generate sentences for image ...computer vision with language models extracted from a dependency ...
99
Multilevel Language and Vision Integration for Text-to-Clip Retrieval
... and Language: In this paper our task is to lo- cate the visual events that match a query sentence in a ...to vision and lan- guage, but can be applied across modalities such as image, video, text, and sound ...
8
Quantifiers in a Multimodal World: Hallucinating Vision with Language and Sound
... on language and vision, for which various tasks have been proposed, ...spoken language to perform various tasks, such as image-audio re- trieval (Chrupała et ...from language and vi- sion ...
12
Analysis by Synthesis: A (Re-)Emerging Program of Research for Language and Vision
... of language comprehension at levels more abstract than speech ...of language, whether it is phonological, lexical, or syntactic, or ...in vision as well as language and other areas of ...
27
Combining Language and Vision with a Multimodal Skip gram Model
... and vision tasks, and could be used as input in systems benefiting from prior visual knowl- edge ...grounded language acquisition, an avenue of research we plan to explore ...
11
Integrating Vision and Language Datasets to Measure Word Concreteness
... between language and vision (Miller and Johnson-Laird, 1976; Wino- grad, 1972; Jackendoff, 1983; Waltz, ...large vision and language (VL) datasets have become increasingly popular, mostly used ...
6
Evaluating the Representational Hub of Language and Vision Models
... computer vision implement the bottom-up processing of the “Hub and Spoke” architecture pro- posed in cognitive science to represent how the brain processes and combines multi-sensory ...various ...
12
A Survey of Current Datasets for Vision and Language Research
... together language and vision in one in- telligent system has long been an ambition in AI research, beginning with SHRDLU as one of the first vision-language integration systems (Wino- grad, ...
7
An Analysis of Action Recognition Datasets for Language and Vision Tasks
... Relevant Language and Vision Tasks Template based description generation systems for both videos and images rely on identifying subject–verb–object triples and use language mod- eling to generate or ...
8
Learning the Meaning of Quantifiers from Language and Vision
... of language acquisition, and the mechanisms underlying their comprehension and pro- cessing have received attention from experimental pragmatics, cognitive psychology, and ...computer vision, I test the ...
122
Integrating Language and Vision to Generate Natural Language Descriptions of Videos in the Wild
... natural language processing and computer vision to improve recognition and description of entities and activities in real-world ...the vision system alone, as well as over a previous n-gram ...
10
Connecting Language and Vision to Actions
... for language-vision tasks. Although models that link vision, language and actions have a rich history (Tellex et ...natural language instruc- tions (Anderson et ...grounded ...
5
Natural Language Semantics With Pictures: Some Language & Vision Datasets and Potential Uses for Computational Semantics
... that language / vision corpora can be a fertile hunting ground for semanticists interested in grounded lexical ...via language descriptions (captions), and probe those for the likely presence of ...
12
Multi modal Discriminative Model for Vision and Language Navigation
... natural language grounding task where agents have to interpret natural language instructions in the context of visual scenes in a dynamic environment to achieve prescribed navigation ...natural ...
10
Space and the Vision–Language Interface: A Model-Theoretic Approach
... A third topic pertains to a complex case, that of the relation between vision and language with respect to reference systems and their computation. Again, works like Carlson-Radvansky & Irwin (1994), ...
56
Are You Looking? Grounding to Multiple Modalities in Vision and Language Navigation
... their vision-based counterparts under two state-of-the- art model models (Fried et ...of vision in vision-and-language tasks. In several vision-and-language tasks, high perfor- ...
7
Chinese Language Learner Motivation: Vision, Socialization and Progression
... well-prepared language students struggle at certain points. A positive language student who enjoys the classes is not necessarily a motivated language learner, and vice ...the language. ...
18
Real-Time Vision Based Sign Language Recognition System
... sign language, computer vision, natural language processing, biomedical, biometrics, pattern recognition, and much more ...Computer Vision) library [2] to perform image ...
6
Stay on the Path: Instruction Fidelity in Vision and Language Navigation
... connects language to other modalities. A particularly exciting direction is Vision-and-Language Navigation (VLN), in which agents interpret natural lan- guage instructions and visual scenes to move ...
11
Preschool hearing, speech, language, and vision screening
... and language therapists or specialist teachers) or parents and others in the child’s ...expressive language (e V ect size of norm- refereced measures was + ...receptive language the reverse was ...
9