Lu Gan

Lu Gan

Auto-generated profile, based on publicly available information

Lu Gan

Institute for Robotics and Intelligent Machines, Georgia Institute of Technology, Atlanta, GA, USA

Research Focus & Metrics

Academic Career Length

10Years (2017-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
9 January 2020 in IEEE Robotics and Automation Letters
Verified
Journal Article
Closed access
LGLu Gan
Lu Gan
RZRay Zhang
Ray Zhang
JGJessy W. Grizzle
Jessy W. Grizzle
RERyan M. Eustice
Ryan M. Eustice
MGMaani Ghaffari
Maani Ghaffari
This article develops a Bayesian continuous 3D semantic occupancy map from noisy point clouds by generalizing the Bayesian kernel inference model for building occupancy maps, a binary problem, to semantic maps, a multi-class problem. The proposed method provides a unified probabilistic model for both occupancy and semantic probabilities and nicely reverts to the original occupancy mapping framework when only one occupied class exists in obtained measurements. The Bayesian spatial kernel inference relaxes the independent grid assumption and brings smoothness and continuity to the map inference, enabling to exploit local correlations present in the environment and increasing the performance. The accompanying software uses multi-threading and vectorization, and runs at about 2 Hz on a laptop CPU. Evaluations using multiple sequences of stereo camera and LiDAR datasets show that the proposed method consistently outperforms current baselines. We also present a qualitative evaluation using data collected with a bipedal robot platform on the University of Michigan - North Campus.

4 July 2022 in IEEE Robotics and Automation Letters
Verified
Journal Article
Closed access
LGLu Gan
Lu Gan
JGJessy W. Grizzle
Jessy W. Grizzle
RERyan M. Eustice
Ryan M. Eustice
MGMaani Ghaffari
Maani Ghaffari
This work reports ondeveloping a deep inverse reinforcement learning method for legged robots terrain traversability modeling that incorporates both exteroceptive and proprioceptive sensory data. Existing works use robot-agnostic exteroceptive environmental features or handcrafted kinematic features; instead, we propose to also learn robot-specific inertial features from proprioceptive sensory data for reward approximation in a single deep neural network. Incorporating the inertial features can improve the model fidelity and provide a reward that depends on the robot’s state during deployment. We train the reward network using the Maximum Entropy Deep Inverse Reinforcement Learning (MEDIRL) algorithm and propose simultaneously minimizing a trajectory ranking loss to deal with the suboptimality of legged robot demonstrations. The demonstrated trajectories are ranked by locomotion energy consumption, in order to learn an energy-aware reward function and a more energy-efficient policy than demonstration. We evaluate our method using a dataset collected by an MIT Mini-Cheetah robot and a Mini-Cheetah simulator. The code is publicly available. 1

3 January 2024
Verified
Conference Paper
Open access
SDSri Aditya Deevi
Sri Aditya Deevi
CLConnor Lee
Connor Lee
LGLu Gan
Lu Gan
SNSushruth Nagesh
Sushruth Nagesh
GPGaurav Pandey
Gaurav Pandey
SCSoon-Jo Chung
Soon-Jo Chung
Multimodal deep sensor fusion has the potential to enable autonomous vehicles to visually understand their surrounding environments in all weather conditions. However, existing deep sensor fusion methods usually employ convoluted architectures with intermingled multimodal features, requiring large coregistered multimodal datasets for training. In this work, we present an efficient and modular RGB-X fusion network that can leverage and fuse pre-trained single-modal models via scene-specific fusion modules, thereby enabling joint input-adaptive network architectures to be created using small, coregistered multimodal datasets. Our experiments demonstrate the superiority of our method compared to existing works on RGB-thermal and RGB-gated datasets, performing fusion using only a small amount of additional parameters. Our code is available at https://github.com/dsriaditya999/RGBXFusion.

31 August 2022 in IEEE Transactions on Robotics
Verified
Journal Article
Closed access
LGLu Gan
Lu Gan
YKYoungji Kim
Youngji Kim
JGJessy W. Grizzle
Jessy W. Grizzle
JWJeffrey M. Walls
Jeffrey M. Walls
AKAyoung Kim
Ayoung Kim
MGMaani Ghaffari
Maani Ghaffari
In this article, we present a novel and flexible multitask multilayer Bayesian mapping framework with readily extendable attribute layers. The proposed framework goes beyond modern metric-semantic maps to provide even richer environmental information for robots in a single mapping formalism while exploiting intralayer and interlayer correlations. It removes the need for a robot to access and process information from many separate maps when performing a complex task, advancing the way robots interact with their environments. To this end, we design a multitask deep neural network with attention mechanisms as our front-end to provide heterogeneous observations for multiple map layers simultaneously. Our back-end runs a scalable closed-form Bayesian inference with only logarithmic time complexity. We apply the framework to build a dense robotic map, including metric-semantic occupancy and traversability layers. Traversability ground truth labels are automatically generated from exteroceptive sensory data in a self-supervised manner. We present extensive experimental results on publicly available datasets and data collected by a three-dimensional bipedal robot platform and show reliable mapping performance in different environments. Finally, we also discuss how the current framework can be extended to incorporate more information, such as friction, signal strength, temperature, and physical quantity concentration using Gaussian map layers. The software for reproducing the presented results or running on customized data is made publicly available.

10 April 2023 in Stochastic Environmental Research and Risk Assessment
Verified
Journal Article
Closed access
PDF file
LGLu Gan
Lu Gan
Ümüt HalikÜmüt Halik
Ümüt Halik
Lei ShiLei Shi
Lei Shi
Martin WelpMartin Welp
Martin Welp

8 September 2022 in IEEE Access
Verified
Journal Article
Open access
AUAishwarya Unnikrishnan
Aishwarya Unnikrishnan
JWJoey Wilson
Joey Wilson
LGLu Gan
Lu Gan
ACAndrew Capodieci
Andrew Capodieci
PJParamsothy Jayakumar
Paramsothy Jayakumar
MGMaani Ghaffari
Maani Ghaffari
This paper reports on a dynamic semantic mapping framework that incorporates 3D scene flow measurements into a closed-form Bayesian inference model. Existence of dynamic objects in the environment can cause artifacts and traces in current mapping algorithms, leading to an inconsistent map posterior. We leverage state-of-the-art semantic segmentation and 3D flow estimation using deep learning to provide measurements for map inference. We develop a Bayesian model that propagates the scene with flow and infers a 3D continuous (i.e., can be queried at arbitrary resolution) semantic occupancy map outperforming its static counterpart. Extensive experiments using publicly available data sets show that the proposed framework improves over its predecessors and input measurements from deep neural networks consistently.