Jean Oh

Jean Oh

Auto-generated profile, based on publicly available information

Jean Oh

Carnegie Mellon University

Research Focus & Metrics

Academic Career Length

21Years (2006-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
1 October 2023
Verified
Conference Paper
Open access
IBInhwan Bae
Inhwan Bae
JOJean Oh
Jean Oh
HJHae-Gon Jeon
Hae-Gon Jeon
Capturing high-dimensional social interactions and feasible futures is essential for predicting trajectories. To address this complex nature, several attempts have been devoted to reducing the dimensionality of the output variables via parametric curve fitting such as the Bézier curve and B-spline function. However, these functions, which originate in computer graphics fields, are not suitable to account for socially acceptable human dynamics. In this paper, we present EigenTrajectory ($\mathbb{E}\mathbb{T}$), a trajectory prediction approach that uses a novel trajectory descriptor to form a compact space, known here as $\mathbb{E}\mathbb{T}$ space, in place of Euclidean space, for representing pedestrian movements. We first reduce the complexity of the trajectory descriptor via a low-rank approximation. We transform the pedestrians' history paths into our $\mathbb{E}\mathbb{T}$ space represented by spatio-temporal principle components, and feed them into off-the-shelf trajectory forecasting models. The inputs and outputs of the models as well as social interactions are all gathered and aggregated in the corresponding $\mathbb{E}\mathbb{T}$ space. Lastly, we propose a trajectory anchor-based refinement method to cover all possible futures in the proposed $\mathbb{E}\mathbb{T}$ space. Extensive experiments demonstrate that our EigenTrajectory predictor can significantly improve both the prediction accuracy and reliability of existing trajectory forecasting models on public benchmarks, indicating that the proposed descriptor is suited to represent pedestrian behaviors. Code is publicly available at https://github.com/inhwanbae/EigenTrajectory.

28 December 2020 in IEEE Robotics and Automation Letters
Verified
Journal Article
Closed access
DZDapeng Zhao
Dapeng Zhao
JOJean Oh
Jean Oh
As more and more robots are envisioned to co-operate with humans sharing the same space, it is desired for robots to be able to predict others‘ trajectories to navigate in a safe and self-explanatory way. In this paper, we propose a Convolutional Neural Network-based approach to learn, detect,and extract patterns in sequential trajectory data, known here as Social Pattern Extraction Convolution (Social-PEC). A set of experiments carried out on the human trajectory prediction problem shows that our model performs comparably to the state of the art and outperforms in some cases. More importantly,the proposed approach unveils the obscurity in the previous use of pooling layer, presenting a way to intuitively explain the decision-making process.

13 November 2015
Verified
Book Chapter
Open access
PDF file
FDFelix Duvallet
Felix Duvallet
MWMatthew R. Walter
Matthew R. Walter
THThomas Howard
Thomas Howard
SHSachithra Hemachandra
Sachithra Hemachandra
JOJean Oh
Jean Oh
ASAnthony Stentz
Anthony Stentz
Natural language provides a flexible, intuitive way for people to command robots, which is becoming increasingly important as robots transition to working alongside people in our homes and workplaces. To follow instructions in unknown environments, robots will be expected to reason about parts of the environments that were described in the instruction, but that the robot has no direct knowledge about. However, most existing approaches to natural language understanding require that the robot’s environment be known a priori. This paper proposes a probabilistic framework that enables robots to follow commands given in natural language, without any prior knowledge of the environment. The novelty lies in exploiting environment information implicit in the instruction, thereby treating language as a type of sensor that is used to formulate a prior distribution over the unknown parts of the environment. The algorithm then uses this learned distribution to infer a sequence of actions that are most consistent with the command, updating our belief as we gather more metric information. We evaluate our approach through simulation as well as experiments on two mobile robots; our results demonstrate the algorithm’s ability to follow navigation commands with performance comparable to that of a fully-known environment.

14 February 2025 in IEEE Robotics and Automation Letters
Verified
Journal Article
Closed access
JKJaeyeul Kim
Jaeyeul Kim
JWJungwan Woo
Jungwan Woo
USUkcheol Shin
Ukcheol Shin
JOJean Oh
Jean Oh
SISunghoon Im
Sunghoon Im
Understanding the motion states of the surrounding environment is critical for safe autonomous driving. These motion states can be accurately derived from scene flow, which captures the three-dimensional motion field of points. Existing LiDAR scene flow methods extract spatial features from each point cloud and then fuse them channel-wise, resulting in the implicit extraction of spatio-temporal features. Furthermore, they utilize 2D Bird's Eye View and process only two frames, missing crucial spatial information along the Z-axis and the broader temporal context, leading to suboptimal performance. To address these limitations, we propose Flow4D, which temporally fuses multiple point clouds after the 3D intra-voxel feature encoder, enabling more explicit extraction of spatio-temporal features through a 4D voxel network. However, while using 4D convolution improves performance, it significantly increases the computational load. For further efficiency, we introduce the Spatio-Temporal Decomposition Block (STDB), which combines 3D and 1D convolutions instead of using heavy 4D convolution. In addition, Flow4D further improves performance by using five frames to take advantage of richer temporal information. As a result, the proposed method achieves a 45.9% higher performance compared to the state-of-the-art while running in real-time, and won 1st place in the 2024 Argoverse 2 Scene Flow Challenge.

1 March 2022 in Field Robotics
Verified
Journal Article
Open access
THThomas M. Howard
Thomas M. Howard
ESEthan Stump
Ethan Stump
JFJonathan Fink
Jonathan Fink
JAJacob Arkin
Jacob Arkin
RPRohan Paul
Rohan Paul
NRNicholas Roy
Nicholas Roy

29 January 2025 in IEEE Robotics and Automation Letters
Verified
Journal Article
Closed access
DDDevansh Dhrafani
Devansh Dhrafani
YLYifei Liu
Yifei Liu
AJAndrew Jong
Andrew Jong
USUkcheol Shin
Ukcheol Shin
YHYao He
Yao He
SSSebastian Scherer
Sebastian Scherer
Robust depth perception in visually-degraded environments is crucial for autonomous aerial systems. Thermal imaging cameras, which capture infrared radiation, are robust to visual degradation. However, due to lack of a large-scale dataset, the use of thermal cameras for uncrewed aerial system (UAS) depth perception has remained largely unexplored. This paper presents a stereo thermal depth perception dataset for autonomous aerial perception applications. The dataset consists of stereo thermal images, LiDAR, IMU and ground truth depth maps captured in urban and forest settings under diverse conditions like day, night, rain, and smoke. We benchmark representative stereo depth estimation algorithms, offering insights into their performance in degraded conditions. Models trained on our dataset generalize well to unseen smoky conditions, highlighting the robustness of stereo thermal imaging for depth perception. We aim for this work to enhance robotic perception in disaster scenarios, allowing for exploration and operations in previously unreachable areas.