Multimodal Analysis
A System for the Semantic Multimodal Analysis of News Audio-Visual Content
... of multimodal analysis and in particular the possible improvement of analysis results when considering larger story-telling units (scenes) rather than visual shots as the elementary pieces of video ...
16
Multimodal Analysis of Human Fear
... Multimodal analysis of human emotion is an emerging field for human emotion classification. Different parameters from different domain can be used an in combination for getting good results. There is a ...
6
Usability of Musical Digital Libraries: a Multimodal Analysis.
... The method employed in this work has been to apply a novel theory-based usability evaluation technique, Evaluating Multimodal Usability (EMU: [11]), to four different web- accessible music digital libraries. These ...
8
EUMSSI: a Platform for Multimodal Analysis and Recommendation using UIMA
... “normal” analysis en- gines only see one specific view that is presented to ...text analysis engines don’t need to be aware that they are being applied to an ASR view or an OCR view; they just see a regular ...
9
Cigarette advertisements: A systemic functional grammar and multimodal analysis
... as multimodal resources which are commonly combined in the advertisement to make an effective means of communication to attract viewers to buy an advertised ...
11
Multimodal analysis of verbal and nonverbal behaviour on the example of clinical depression
... emotion analysis to date either used discrete emotion classes, such as the basic emotions suggested by Ekman [1999], or the two-dimensional emotion model by Russell ...
205
Picturesque Wounds: A Multimodal Analysis of Self-Injury Photographs on Flickr
... discourse analysis of texts attached to these images was then conducted to explore the context of ...discourse analysis developed in social psychology that allows an exploration of how people utilize ...
23
Multimodal Semantic Analysis and Annotation for Basketball Video
... We have presented a novel semantic analysis and annota- tion approach by using multimodal analysis of video and au- dio information and tested in basketball videos. In shot and scene boundary ...
13
Evidence and circularity in multimodal discourse analysis
... of multimodal discourse supports the adoption of a critical, or evaluative, stance with regard to text ...how multimodal analysis might make a contribution, beyond academic research, to document ...
40
A Multimodal Literary Analysis of a Television Commercial
... the multimodal approach of anchoring the analysis of a mode within its socio-cultural context, the identification of the physical and geographical setting of the scene as a Christian mission school in ...
14
Multimodal Interpretation and Analysis of Traffic Survey Data
... The multimodal analysis of the data collected includes the traffic volume study which identifies the peak flow of traffic, road use pattern which helps in identifying the pattern of the road use with ...
9
MSMO: Multimodal Summarization with Multimodal Output
... current multimodal summarization systems is usually represented in ...that multimodal output can signifi- cantly improve user satisfaction for informa- tiveness of ...task, multimodal summarization ...
11
Seq2Seq2Sentiment: Multimodal Sequence to Sequence Models for Sentiment Analysis
... baseline multimodal approach we were unable to outperform the baseline unimodal text ...performing multimodal model is one that incorporates the text domain so much (see Tables 2 and ...
11
From analysis to modeling of engagement as sequences of multimodal behaviors
... In this section, we present an analysis of the manual an- notation. Each single modality (gesture, rest positions, en- gagement, etc.) has been annotated by one annotator. The inter-annotator agreement (Cohen’s ...
6
Multimodal Sentiment Analysis - A Study on Classification Techniques for Multimodal Sentiment Analysis
... sentiment analysis (SA) also called opinion mining (OM) is used to find the users opinion about a particular topic, product or problem in a more efficient ...in multimodal data both audio as well as video ...
9
LAMP: A Multimodal Web Platform for Collaborative Linguistic Analysis
... Although our LAMP architecture has been used success- fully for the Quranic Arabic Corpus website, we argue that the technology concepts we present are a general model of online corpus development, applicable to related ...
8
A Linked Data Model for Multimodal Sentiment and Emotion Analysis
... sentiment analysis, the results from a service that analyses both the captions from a YouTube video and the video comments would look like the document in Listing ...of analysis: textual sentiment ...
9
VistaNet: Visual Aspect Attention Network for Multimodal Sentiment Analysis
... sentiment analysis called Visual Aspect Attention Net- work or ...outperforms multimodal baselines that uses both textual and visual features on sentiment anal- ysis, supporting our hypothesis that the ...
8
Multimodal Transformer for Unaligned Multimodal Language Sequences
... For the word-aligned version, following (Zadeh et al., 2018a; Tsai et al., 2019; Pham et al., 2019), we first use P2FA (Yuan and Liberman, 2008) to obtain the aligned timesteps (segmented w.r.t. words) for audio and ...
12
Twente Debate Corpus — A Multimodal Corpus for Head Movement Analysis
... the analysis of debates, in which participants not only try to convince each other and respond to each other with words, but also ...automatic analysis of arguments in debates has received some attention ...
5