Darren Cosker

Darren Cosker

Auto-generated profile, based on publicly available information

Darren Cosker

Microsoft, United Kingdom

Research Focus & Metrics

Academic Career Length

6Years (2021-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
19 April 2023
Verified
Conference Paper
Open access
ASAnca Salagean
Anca Salagean
ECEleanor Crellin
Eleanor Crellin
MPMartin Parsons
Martin Parsons
DCDarren Cosker
Darren Cosker
DFDanaë Stanton Fraser
Danaë Stanton Fraser
Embodying virtual twins – photorealistic and personalized avatars – will soon be easily achievable in consumer-grade VR. For the first time, we explored how photorealism and personalization impact self-identification, as well as embodiment, avatar perception and presence. Twenty participants were individually scanned and, in a two-hour session, embodied four avatars (high photorealism personalized, low photorealism personalized, high photorealism generic, low photorealism generic). Questionnaire responses revealed stronger mid-immersion body ownership for the high photorealism personalized avatars compared to all other avatar types, and stronger embodiment for high photorealism compared to low photorealism avatars and for personalized compared to generic avatars. In a self-other face distinction task, participants took significantly longer to pause the face morphing videos of high photorealism personalized avatars, suggesting a stronger self-identification bias with these avatars. Photorealism and personalization were perceptually positive features; how employing these avatars in VR applications impacts users over time requires longitudinal investigation.

19 November 2024 in ACM Transactions on Graphics
Verified
Journal Article
Open access
CHCharlie Hewitt
Charlie Hewitt
FSFatemeh Saleh
Fatemeh Saleh
SASadegh Aliakbarian
Sadegh Aliakbarian
LPLohit Petikam
Lohit Petikam
SRShideh Rezaeifar
Shideh Rezaeifar
TBTadas Baltrusaitis
Tadas Baltrusaitis
We tackle the problem of highly-accurate, holistic performance capture for the face, body and hands simultaneously. Motion-capture technologies used in film and game production typically focus only on face, body or hand capture independently, involve complex and expensive hardware and a high degree of manual intervention from skilled operators. While machine-learning-based approaches exist to overcome these problems, they usually only support a single camera, often operate on a single part of the body, do not produce precise world-space results, and rarely generalize outside specific contexts. In this work, we introduce the first technique for markerfree, high-quality reconstruction of the complete human body, including eyes and tongue, without requiring any calibration, manual intervention or custom hardware. Our approach produces stable world-space results from arbitrary camera rigs as well as supporting varied capture environments and clothing. We achieve this through a hybrid approach that leverages machine learning models trained exclusively on synthetic data and powerful parametric models of human shape and motion. We evaluate our method on a number of body, face and hand reconstruction benchmarks and demonstrate state-of-the-art results that generalize on diverse datasets.

19 April 2023
Verified
Conference Paper
Open access
ALAna Levordashka
Ana Levordashka
JEJamie Eastman
Jamie Eastman
ESEleni Anna Skoulikari
Eleni Anna Skoulikari
ASAnca Salagean
Anca Salagean
DCDarren Cosker
Darren Cosker
DFDanaë Stanton Fraser
Danaë Stanton Fraser

16 August 2023 in Proceedings of the ACM on Computer Graphics and Interactive Techniques
Verified
Journal Article
Open access
DEDónal Egan
Dónal Egan
DCDarren Cosker
Darren Cosker
RMRachel McDonnell
Rachel McDonnell
Virtual reality (VR) allows us to immerse ourselves in alternative worlds in which we can embody avatars to take on new identities. Usually, these avatars are humanoid or possess very strong anthropomorphic qualities. Allowing users of VR to embody non-humanoid virtual characters or animals presents additional challenges. Extreme morphological differences and the complexities of different characters' motions can make the construction of a real-time mapping between input human motion and target character motion a difficult challenge. Previous animal embodiment work has focused on direct mapping of human motion to the target animal via inverse kinematics. This can lead to the target animal moving in a way which is inappropriate or unnatural for the animal type. We present a novel real-time method, incorporating two neural networks, for mapping human motion to realistic quadruped motion. Crucially, the output quadruped motions are realistic, while also being faithful to the input user motions. We incorporate our mapping into a VR embodiment system in which users can embody a virtual quadruped from a first person perspective. Further, we evaluate our system via a perceptual experiment in which we investigate the quality of the synthesised motion, the system's response to user input and the sense of embodiment experienced by users. The main findings of the study are that the system responds as well as traditional embodiment systems to user input, produces higher quality motion and users experience a higher sense of body ownership when compared to a baseline method in which the human to quadruped motion mapping relies solely on inverse kinematics. Finally, our embodiment system relies solely on consumer-grade hardware, thus making it appropriate for use in applications such as VR gaming or VR social platforms.

21 November 2024
Verified
Conference Paper
Open access
DEDonal Egan
Donal Egan
AJAlberto Jovane
Alberto Jovane
JSJan Szkaradek
Jan Szkaradek
GFGeorge Fletcher
George Fletcher
DCDarren Cosker
Darren Cosker
RMRachel McDonnell
Rachel McDonnell
Many VR animal embodiment sytsems suffer from poor animation fidelity, typically animating the animal avatars using inverse kinematics. We address this issue, presenting a novel deep-learning method, centred around a shared codebook, for mapping human motion to quadruped motion. Rather than trying to directly bridge the gap from human motion to quadruped motion, a task which has proven difficult, we first use a rule-based retargeter, relying on inverse and forward kinematics, to retarget human motions to an intermediate motion domain in which the motions share the same skeleton as the quadruped. We then use finite scalar quantization to construct a shared latent space, or codebook, between this intermediate domain and the quadruped motion domain. We do this by first pre-defining a finite number of discrete latent codes and then teaching these codes, using unsupervised deep-learning, to represent semantically similar motions in the two domains. We incorporate our real-time human-to-quadruped motion mapping into a VR quadruped embodiment system. The output quadruped animations are natural and realistic, while also preserving the semantics of users’ actions. Moreover, there is a strong synchrony between the input human motions and retargeted quadruped motions, an important factor for inducing a strong sense of VR embodiment.

23 April 2021 in bioRxiv
Verified
Preprint
Open access
PDF file
LNLaurie Needham
Laurie Needham
MEMurray Evans
Murray Evans
DCDarren P. Cosker
Darren P. Cosker
LWLogan Wade
Logan Wade
PMPolly M. McGuigan
Polly M. McGuigan
SCSteffi Colyer
Steffi Colyer
Human movement researchers are often restricted to laboratory environments and data capture techniques that are time and/or resource intensive. Markerless pose estimation algorithms show great potential to facilitate large scale movement studies ‘in the wild’, i.e., outside of the constraints imposed by marker-based motion capture. However, the accuracy of such algorithms has not yet been fully evaluated. We computed 3D joint centre locations using several deep-learning based pose estimation methods (OpenPose, AlphaPose, DeepLabCut) and compared to marker-based motion capture. Participants performed walking, running and jumping activities while marker-based motion capture data and multi-camera high speed images (200 Hz) were captured. The pose estimation algorithms were applied to 2D image data and 3D joint centre locations were reconstructed. Pose estimation derived joint centres demonstrated systematic differences at the hip and knee (~30 − 50 mm), most likely due to mislabeling of ground truth data in the training datasets. Where systematic differences were lower, e.g., the ankle, differences of 1 − 15 mm were observed depending on the activity. Markerless motion capture represents a highly promising emerging technology that could free movement scientists from laboratory environments. We provide recommendations relating to domain specific datasets and benchmarks, which will be vital to realising this goal.