Kiran Chhatre

Kiran Chhatre

Auto-generated profile, based on publicly available information

Kiran Chhatre

KTH Royal Institute of Technology, Stockholm, Sweden

Research Focus & Metrics

Academic Career Length

5Years (2022-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
10 December 2023
Verified
Conference Paper
Open access
RDRadek Daněček
Radek Daněček
KCKiran Chhatre
Kiran Chhatre
STShashank Tripathi
Shashank Tripathi
YWYandong Wen
Yandong Wen
MBMichael Black
Michael Black
TBTimo Bolkart
Timo Bolkart
To be widely adopted, 3D facial avatars must be animated easily, realistically, and directly from speech signals. While the best recent methods generate 3D animations that are synchronized with the input audio, they largely ignore the impact of emotions on facial expressions. Realistic facial animation requires lip-sync together with the natural expression of emotion. To that end, we propose EMOTE (Expressive Model Optimized for Talking with Emotion), which generates 3D talking-head avatars that maintain lip-sync from speech while enabling explicit control over the expression of emotion. To achieve this, we supervise EMOTE with decoupled losses for speech (i.e., lip-sync) and emotion. These losses are based on two key observations: (1) deformations of the face due to speech are spatially localized around the mouth and have high temporal frequency, whereas (2) facial expressions may deform the whole face and occur over longer intervals. Thus we train EMOTE with a per-frame lip-reading loss to preserve the speech-dependent content, while supervising emotion at the sequence level. Furthermore, we employ a content-emotion exchange mechanism in order to supervise different emotions on the same audio, while maintaining the lip motion synchronized with the speech. To employ deep perceptual losses without getting undesirable artifacts, we devise a motion prior in the form of a temporal VAE. Due to the absence of high-quality aligned emotional 3D face datasets with speech, EMOTE is trained with 3D pseudo-ground-truth extracted from an emotional video dataset (i.e., MEAD). Extensive qualitative and perceptual evaluations demonstrate that EMOTE produces speech-driven facial animations with better lip-sync than state-of-the-art methods trained on the same data, while offering additional, high-quality emotional control.


16 September 2025
Verified
Conference Paper
Open access
HDHaoyang Du
Haoyang Du
KCKiran Chhatre
Kiran Chhatre
CPChristopher Peters
Christopher Peters
BKBrian Keegan
Brian Keegan
RMRachel McDonnell
Rachel McDonnell
CECathy Ennis
Cathy Ennis

6 May 2025
Verified
Conference Paper
Open access
KCKiran Chhatre
Kiran Chhatre
RGRenan Guarese
Renan Guarese
Andrii MatviienkoAndrii Matviienko
Andrii Matviienko
CPChristopher Peters
Christopher Peters