A deepfake-based study on facial expressiveness and social outcomes - Université de La Réunion Access content directly
Journal Articles Scientific Reports Year : 2024

A deepfake-based study on facial expressiveness and social outcomes

Abstract

Artificial intelligence (AI)-generated media is used in entertainment, art, education, and marketing. AI-generated faces or facial expressions using deepfake-based technologies might also contribute to nonverbal behavior studies. As a proof of concept, in this research, we test the replicability of past results regarding the positive effects of facial expressiveness (e.g., gazing, nodding, and smiling) on social outcomes. Because the facial expressions when listening to someone (i.e., nonverbal immediacy) encompass several behaviors that are typically related (i.e., smiling while nodding), the effect of combinations of these behaviors is challenging to study. We thus test the effect of facial expressiveness (gazing, nodding, and smiling vs. none) on first impression judgements in a job interview setting using AI-generated experimental video material. We measure how competent, warm, and favorably independent observers ( n = 823) perceive the targets ( n = 159) showing AI-generated facial expressions. Our results replicate past research showing that the more targets are facially expressive, the more they are perceived favorably. Apart from supporting evidence of the importance of facial expressiveness for conveying a positive impression, we show the benefits of relying on AI-generated experimental video material for the study of nonverbal behavior.

Dates and versions

hal-04577938 , version 1 (16-05-2024)

Identifiers

Cite

Laetitia Renier, Kumar Shubham, Rahil Satyanarayan Vijay, Swasti Shreya Mishra, Emmanuelle Kleinlogel, et al.. A deepfake-based study on facial expressiveness and social outcomes. Scientific Reports, 2024, 14 (1), pp.3642. ⟨10.1038/s41598-024-53475-5⟩. ⟨hal-04577938⟩

Collections

AFRIQ UNIV-REUNION
0 View
0 Download

Altmetric

Share

Gmail Mastodon Facebook X LinkedIn More