Perception of intensity incongruence in synthesized multimodal expressions of laughter - Télécom Paris Accéder directement au contenu
Communication Dans Un Congrès Année : 2015

Perception of intensity incongruence in synthesized multimodal expressions of laughter

Résumé

In this paper, we study perception of intensity incongruence between auditory and visual modalities of synthesized expressions of laughter. In particular, we investigate whether incongruent expressions are perceived as 1) regulated, and 2) unsuccessful in terms of animation synthesis. For this purpose, we conducted a perceptive study with the use of a virtual agent. Congruent and incongruent multimodal expressions of laughter were synthesized from natural audiovisual laughter episodes, using machine learning algorithms. Next, the intensity of facial expressions and body movements were systematically manipulated to check whether the resulting incongruent expressions are perceived differently compared to the corresponding congruent expressions. Results show that 1) intensity incongruence lowers the perception of believability and plausibility, and 2) the in-congruent laughter expressions displaying high intensity in the audio modality and low intensity in the body movement and facial expression are perceived as more fake than the corresponding congruent expressions. Such results have implications for both animation synthesis as well as expression regulation research.
Fichier non déposé

Dates et versions

hal-02412184 , version 1 (15-12-2019)

Identifiants

  • HAL Id : hal-02412184 , version 1

Citer

Radoslaw Niewiadomski, Yu Ding, Maurizio Mancini, Catherine Pelachaud, Gualtiero Volpe, et al.. Perception of intensity incongruence in synthesized multimodal expressions of laughter. Affective Computing and Intelligent Interaction (ACII), 2015 International Conference on, Sep 2015, Xi’an, China. pp.684 - 690. ⟨hal-02412184⟩
25 Consultations
0 Téléchargements

Partager

Gmail Facebook X LinkedIn More