multimodal interaction
A POMDP-based Multimodal Interaction System Using a Humanoid Robot
... Furthermore, in this study we have built an inter- action system with two strata in the framework of POMDP – we have set the first stratum so as it de- cides to start interaction based on the physical dis- tance ...
7
A multimodal interaction for map navigation and evaluation study of its usability
... A part that many users are not aware of is that the multimodal interaction has already been implemented for a long time ago before it has been proposed. For example, in kiosk machine (Johnston & ...
9
Integration of Multimodal Interaction as Assistance in Virtual Environments
... integrating multimodal interaction (tactile, visual, auditory) as assistance for the purpose of representing the accessed content from the crawled database extracted from the web according to the level of ...
5
Ethical Responsibilities of Researchers and Participants in the Development of Multimodal Interaction Corpora
... of multimodal interaction participants directly influences the nature of infocommunication as well as the the kind of information that is transmitted ...
6
An Evaluation Framework for Multimodal Interaction
... of multimodal interaction systems and provided an outline of its use evaluating a sample interaction in a system that uses linguistic, gestural, and visual ...given interaction, and so the ...
8
Tangible Objects for the Acquisition of Multimodal Interaction Patterns
... intuitive interaction for end-users, however, usually only through predefined input ...for multimodal interaction pattern identification, using head gesture and speech inputs for a 3D graph ...that ...
6
A Multimodal Interaction Framework for Blended Learning
... For a given client application three main sections form the description of the multimodal interaction scenario. The first part, dictionary, indicates how particular data will be tied to which COALS token. ...
9
A Review of Multimodal Interaction Technique in Augmented Reality Environment
... audio-based interaction are speech recognition, speaker recognition, auditory emotion analysis and musical ...Touch interaction technique includes single and multi-touch interaction, as most of touch ...
10
Clavius: Bi Directional Parsing for Generic Multimodal Interaction
... Since the seminal work of Bolt (Bolt, 1980), the methods applied to multimodal interaction (MMI) have diverged towards unreconcilable approaches retrofitted to models not specifically amenable to the ...
6
A System for Multimodal Interaction with Kinect-Enabled Virtual Windows
... real multimodal interaction linked to a Virtual ...of interaction markers in the video streams (both recorded or live) can be significantly improved to ensure service diversity ...the ...
5
Capturing multimodal interaction at medical meetings in a hospital setting: Opportunities and Challenges
... This paper highlights the issues involved in gathering a corpus of data on the multimodal interaction that occurs at a team meeting of medical specialists. Difficulties in capturing the data are described, ...
6
Leveraging Multimodal Interaction and Adaptive Interfaces for Location-based Augmented Reality Islamic Tourism Application
... leveraging multimodal interaction and adaptive interface based on Islamic tourism information was proposed to enhance user experience while ...and multimodal interaction to solve this ...
8
Corpus of Multimodal Interaction for Collaborative Planning
... collaborative multimodal planning system in the form of a conversational agent called VERSO using both visual and natu- ral language interaction, which in our case will be images of the plan and ...
6
Biometric Data Art: Personalized Narratives and Multimodal Interaction
... new multimodal experience using the human body data and audiovisual ...as interaction design, data visualization/sonification, interactive art installations and sound ...
207
Abstract. Key words: Voice-enabled Interfaces, Multimodal Interaction, Usability. 1. Introduction
... required. Multimodal interfaces, combining voice- enabled mode - to override the constraint imposed by the small size of screens - and visual mode can simplify the interaction but they raise news challenges ...
8
FOUR EASY PIECES FOR ASSESSING THE USABILITY OF MULTIMODAL INTERACTION: THE CARE PROPERTIES
... The current definitions of the CARE properties provide a formal framework for reasoning about the design of multimodal systems. We have previously shown how the CARE properties can be used as constraints for the ...
7
Studying multimodal interaction at an interactive museum exhibit on steampower locomotive
... occasionally work in a team with strangers. Often, at some point during their interaction with the exhibit visitors stand back and appear to attempt to gain an overview of the whole exhibit, trying to work it out. ...
7
Utilization of multimodal interaction signals for automatic summarisation of academic presentations
... Group engagement detection in multimodal meetings was performed by (Gatica- Perez et al., 2005). In this work annotators were asked to label 15 second intervals from 4-party meetings according to 5 levels of ...
265
Restructuring multimodal interaction data for browsing and search
... Furthermore, the model could be used to extend that approach in a number of useful ways. First of all, the temporal graph could be used to produce dynamic summaries adapted to different contexts. Selection of a text ...
36
Neural machine translation for multimodal interaction
... used a separate visual attention mechanism to incorporate spatial visual context into NMT. Other important works by Specia et al. (2016b); Caglayan et al. (2017); Elliott et al. (2017) claimed that systems trained on a ...
93