Akshay Krishnan

Akshay Krishnan

Auto-generated profile, based on publicly available information

Akshay Krishnan

Google research

Research Focus & Metrics

Academic Career Length

4Years (2023-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
1 November 2024
Verified
Book Chapter
Closed access
PDF file
AKAkshay Krishnan
Akshay Krishnan
AKAbhijit Kundu
Abhijit Kundu
KMKevis-Kokitsi Maninis
Kevis-Kokitsi Maninis
JHJames Hays
James Hays
MBMatthew Brown
Matthew Brown

11 July 2024 in arXiv
Verified
Preprint
Open access
PDF file
AKAkshay Krishnan
Akshay Krishnan
AKAbhijit Kundu
Abhijit Kundu
KMKevis-Kokitsi Maninis
Kevis-Kokitsi Maninis
JHJames Hays
James Hays
MBMatthew Brown
Matthew Brown
We propose OmniNOCS, a large-scale monocular dataset with 3D Normalized Object Coordinate Space (NOCS) maps, object masks, and 3D bounding box annotations for indoor and outdoor scenes. OmniNOCS has 20 times more object classes and 200 times more instances than existing NOCS datasets (NOCS-Real275, Wild6D). We use OmniNOCS to train a novel, transformer-based monocular NOCS prediction model (NOCSformer) that can predict accurate NOCS, instance masks and poses from 2D object detections across diverse classes. It is the first NOCS model that can generalize to a broad range of classes when prompted with 2D boxes. We evaluate our model on the task of 3D oriented bounding box prediction, where it achieves comparable results to state-of-the-art 3D detection methods such as Cube R-CNN. Unlike other 3D detection methods, our model also provides detailed and accurate 3D object shape and segmentation. We propose a novel benchmark for the task of NOCS prediction based on OmniNOCS, which we hope will serve as a useful baseline for future work in this area. Our dataset and code will be at the project website: https://omninocs.github.io.

6 April 2023 in arXiv
Verified
Preprint
Open access
PDF file
AKAkshay Krishnan
Akshay Krishnan
ARAmit Raj
Amit Raj
XZXianling Zhang
Xianling Zhang
ACAlexandra Carlson
Alexandra Carlson
NTNathan Tseng
Nathan Tseng
JHJames Hays
James Hays
Neural fields have recently enjoyed great success in representing and rendering 3D scenes. However, most state-of-the-art implicit representations model static or dynamic scenes as a whole, with minor variations. Existing work on learning disentangled world and object neural fields do not consider the problem of composing objects into different world neural fields in a lighting-aware manner. We present Lighting-Aware Neural Field (LANe) for the compositional synthesis of driving scenes in a physically consistent manner. Specifically, we learn a scene representation that disentangles the static background and transient elements into a world-NeRF and class-specific object-NeRFs to allow compositional synthesis of multiple objects in the scene. Furthermore, we explicitly designed both the world and object models to handle lighting variation, which allows us to compose objects into scenes with spatially varying lighting. This is achieved by constructing a light field of the scene and using it in conjunction with a learned shader to modulate the appearance of the object NeRFs. We demonstrate the performance of our model on a synthetic dataset of diverse lighting conditions rendered with the CARLA simulator, as well as a novel real-world dataset of cars collected at different times of the day. Our approach shows that it outperforms state-of-the-art compositional scene synthesis on the challenging dataset setup, via composing object-NeRFs learned from one scene into an entirely different scene whilst still respecting the lighting variations in the novel scene. For more results, please visit our project website https://lane-composition.github.io/.