Skip to Main content Skip to Navigation
Conference papers

Perception of intensity incongruence in synthesized multimodal expressions of laughter

Abstract : In this paper, we study perception of intensity incongruence between auditory and visual modalities of synthesized expressions of laughter. In particular, we investigate whether incongruent expressions are perceived as 1) regulated, and 2) unsuccessful in terms of animation synthesis. For this purpose, we conducted a perceptive study with the use of a virtual agent. Congruent and incongruent multimodal expressions of laughter were synthesized from natural audiovisual laughter episodes, using machine learning algorithms. Next, the intensity of facial expressions and body movements were systematically manipulated to check whether the resulting incongruent expressions are perceived differently compared to the corresponding congruent expressions. Results show that 1) intensity incongruence lowers the perception of believability and plausibility, and 2) the in-congruent laughter expressions displaying high intensity in the audio modality and low intensity in the body movement and facial expression are perceived as more fake than the corresponding congruent expressions. Such results have implications for both animation synthesis as well as expression regulation research.
Complete list of metadata
Contributor : TelecomParis HAL Connect in order to contact the contributor
Submitted on : Sunday, December 15, 2019 - 12:49:12 PM
Last modification on : Friday, June 3, 2022 - 4:24:03 PM


  • HAL Id : hal-02412184, version 1


Radoslaw Niewiadomski, yu Ding, Maurizio Mancini, Catherine Pelachaud, Gualtiero Volpe, et al.. Perception of intensity incongruence in synthesized multimodal expressions of laughter. Affective Computing and Intelligent Interaction (ACII), 2015 International Conference on, Sep 2015, Xi’an, China. pp.684 - 690. ⟨hal-02412184⟩



Record views