Towards IMACA: Intelligent multimodal affective conversational agent

Citation

Hussain A, Cambria E, Mazzocco T, Grassi M, Wang Q & Durrani T (2012) Towards IMACA: Intelligent multimodal affective conversational agent. In: Huang T, Zeng Z, Li C & Leung C (eds.) Neural Information Processing: 19th International Conference, ICONIP 2012, Doha, Qatar, November 12-15, 2012, Proceedings, Part I. Lecture Notes in Computer Science, 7663. Berlin Heidelberg: Springer, pp. 656-663. http://link.springer.com/chapter/10.1007/978-3-642-34475-6_79#

Abstract
A key aspect when trying to achieve natural interaction in machines is multimodality. Besides verbal communication, in fact, humans interact also through many other channels, e.g., facial expressions, gestures, eye contact, posture, and voice tone. Such channels convey not only semantics, but also emotional cues that are essential for interpreting the message transmitted. The importance of the affective information and the capability of properly managing it, in fact, has been more and more understood as fundamental for the development of a new generation of emotion-aware applications for several scenarios like e-learning, e-health, and human-computer interaction. To this end, this work investigates the adoption of different paradigms in the fields of text, vocal, and video analysis, in order to lay the basis for the development of an intelligent multimodal affective conversational agent.

Keywords
AI; HCI; Multimodal Sentiment Analysis

People

Professor Tariq Durrani

Honorary Professor, Computing Science