Mallikarjun B R

Mallikarjun B R

Auto-generated profile, based on publicly available information

Mallikarjun B R

Max Planck Institute for Informatics, Saarbrücken, Germany

Research Focus & Metrics

Academic Career Length

3Years (2024-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
9 April 2024 in ACM Transactions on Graphics
Verified
Journal Article
Open access
KTKartik Teotia
Kartik Teotia
MRMallikarjun B R
Mallikarjun B R
XPXingang Pan
Xingang Pan
HKHyeongwoo Kim
Hyeongwoo Kim
PGPablo Garrido
Pablo Garrido
CTChristian Theobalt
Christian Theobalt
Multi-view volumetric rendering techniques have recently shown great potential in modeling and synthesizing high-quality head avatars. A common approach to capture full head dynamic performances is to track the underlying geometry using a mesh-based template or 3D cube-based graphics primitives. While these model-based approaches achieve promising results, they often fail to learn complex geometric details such as the mouth interior, hair, and topological changes over time. This article presents a novel approach to building highly photorealistic digital head avatars. Our method learns a canonical space via an implicit function parameterized by a neural network. It leverages multiresolution hash encoding in the learned feature space, allowing for high quality, faster training, and high-resolution rendering. At test time, our method is driven by a monocular RGB video. Here, an image encoder extracts face-specific features that also condition the learnable canonical space. This encourages deformation-dependent texture variations during training. We also propose a novel optical flow-based loss that ensures correspondences in the learned canonical space, thus encouraging artifact-free and temporally consistent renderings. We show results on challenging facial expressions and show free-viewpoint renderings at interactive real-time rates for a resolution of 480 x 270. Our method outperforms related approaches both visually and numerically. We will release our multiple-identity dataset to encourage further research.

13 July 2024
Verified
Conference Paper
Open access
PRPramod Rao
Pramod Rao
GFGereon Fox
Gereon Fox
AMAbhimitra Meka
Abhimitra Meka
MRMallikarjun B R
Mallikarjun B R
FZFangneng Zhan
Fangneng Zhan
CTChristian Theobalt
Christian Theobalt
Achieving photorealistic 3D view synthesis and relighting of human portraits is pivotal for advancing AR/VR applications. Existing methodologies in portrait relighting demonstrate substantial limitations in terms of generalization and 3D consistency, coupled with inaccuracies in physically realistic lighting and identity preservation. Furthermore, personalization from a single view is difficult to achieve and often requires multiview images during the testing phase or involves slow optimization processes. This paper introduces Lite2Relight , a novel technique that can predict 3D consistent head poses of portraits while performing physically plausible light editing at interactive speed. Our method uniquely extends the generative capabilities and efficient volumetric representation of EG3D, leveraging a lightstage dataset to implicitly disentangle face reflectance and perform relighting under target HDRI environment maps. By utilizing a pre-trained geometry-aware encoder and a feature alignment module, we map input images into a relightable 3D space, enhancing them with a strong face geometry and reflectance prior. Through extensive quantitative and qualitative evaluations, we show that our method outperforms the state-of-the-art methods in terms of efficacy, photorealism, and practical application. This includes producing 3D-consistent results of the full head, including hair, eyes, and expressions. Lite2Relight paves the way for large-scale adoption of photorealistic portrait editing in various domains, offering a robust, interactive solution to a previously constrained problem.

14 December 2025
Verified
Conference Paper
Open access
PRPramod Rao
Pramod Rao
AMAbhimitra Meka
Abhimitra Meka
XZXilong Zhou
Xilong Zhou
GFGereon Fox
Gereon Fox
MRMallikarjun B R
Mallikarjun B R
CTChristian Theobalt
Christian Theobalt