Simon Alexanderson

Simon Alexanderson

Auto-generated profile, based on publicly available information

Simon Alexanderson

Division of Speech, Music and Hearing KTH Royal Institute of Technology Sweden

Research Focus & Metrics

Academic Career Length

13Years (2014-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
26 July 2023 in ACM Transactions on Graphics
Verified
Journal Article
Open access
SASimon Alexanderson
Simon Alexanderson
RNRajmund Nagy
Rajmund Nagy
Jonas BeskowJonas Beskow
Jonas Beskow
GHGustav Eje Henter
Gustav Eje Henter
Diffusion models have experienced a surge of interest as highly expressive yet efficiently trainable probabilistic models. We show that these models are an excellent fit for synthesising human motion that co-occurs with audio, e.g., dancing and co-speech gesticulation, since motion is complex and highly ambiguous given audio, calling for a probabilistic description. Specifically, we adapt the DiffWave architecture to model 3D pose sequences, putting Conformers in place of dilated convolutions for improved modelling power. We also demonstrate control over motion style, using classifier-free guidance to adjust the strength of the stylistic expression. Experiments on gesture and dance generation confirm that the proposed method achieves top-of-the-line motion quality, with distinctive styles whose expression can be made more or less pronounced. We also synthesise path-driven locomotion using the same model architecture. Finally, we generalise the guidance procedure to obtain product-of-expert ensembles of diffusion models and demonstrate how these may be used for, e.g., style interpolation, a contribution we believe is of independent interest.

1 May 2020 in Computer Graphics Forum
Verified
Journal Article
Closed access
PDF file
SASimon Alexanderson
Simon Alexanderson
GHGustav Eje Henter
Gustav Eje Henter
TKTaras Kucherenko
Taras Kucherenko
Jonas BeskowJonas Beskow
Jonas Beskow

9 October 2023
Verified
Conference Paper
Open access
ADAnna Deichler
Anna Deichler
SMShivam Mehta
Shivam Mehta
SASimon Alexanderson
Simon Alexanderson
Jonas BeskowJonas Beskow
Jonas Beskow
This paper describes a system developed for the GENEA (Generation and Evaluation of Non-verbal Behaviour for Embodied Agents) Challenge 2023. Our solution builds on an existing diffusion-based motion synthesis model. We propose a contrastive speech and motion pretraining (CSMP) module, which learns a joint embedding for speech and gesture with the aim to learn a semantic coupling between these modalities. The output of the CSMP module is used as a conditioning signal in the diffusion-based gesture synthesis model in order to achieve semantically-aware co-speech gesture generation. Our entry achieved highest human-likeness and highest speech appropriateness rating among the submitted entries. This indicates that our system is a promising approach to achieve human-like co-speech gestures in agents that carry semantic meaning.

1 December 2017 in Computers & Graphics
Verified
Journal Article
Closed access
SASimon Alexanderson
Simon Alexanderson
COCarol O'Sullivan
Carol O'Sullivan
JBJonas Beskow
Jonas Beskow

17 December 2019
Verified
Conference Paper
Open access
PDF file
DADui Ardal
Dui Ardal
SASimon Alexandersson
Simon Alexandersson
MLMirko Lempert
Mirko Lempert
APAndré Tiago Abelho Pereira
André Tiago Abelho Pereira
Figure 1: Two participants performing a collaborative previs session (left); a screenshot of a participant's interface (right).

1 March 2014 in Computer Speech & Language
Verified
Journal Article
Open access
SASimon Alexanderson
Simon Alexanderson
Jonas BeskowJonas Beskow
Jonas Beskow
In this paper we study the production and perception of speech in diverse conditions for the purposes of accurate, flexible and highly intelligible talking face animation. We recorded audio, video and facial motion capture data of a talker uttering a,set of 180 short sentences, under three conditions: normal speech (in quiet), Lombard speech (in noise), and whispering. We then produced an animated 3D avatar with similar shape and appearance as the original talker and used an error minimization procedure to drive the animated version of the talker in a way that matched the original performance as closely as possible. In a perceptual intelligibility study with degraded audio we then compared the animated talker against the real talker and the audio alone, in terms of audio-visual word recognition rate across the three different production conditions. We found that the visual intelligibility of the animated talker was on par with the real talker for the Lombard and whisper conditions. In addition we created two incongruent conditions where normal speech audio was paired with animated Lombard speech or whispering. When compared to the congruent normal speech condition, Lombard animation yields a significant increase in intelligibility, despite the AV-incongruence. In a separate evaluation, we gathered subjective opinions on the different animations, and found that some degree of incongruence was generally accepted. (C) 2013 Elsevier Ltd. All rights reserved.