Francis Engelmann

Francis Engelmann

Auto-generated profile, based on publicly available information

Francis Engelmann

Stanford University, Stanford, USA

Research Focus & Metrics

Academic Career Length

11Years (2016-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
1 October 2017
Verified
Conference Paper
Closed access
FEFrancis Engelmann
Francis Engelmann
TKTheodora Kontogianni
Theodora Kontogianni
AHAlexander Hermans
Alexander Hermans
BLBastian Leibe
Bastian Leibe
Deep learning approaches have made tremendous progress in the field of semantic segmentation over the past few years. However, most current approaches operate in the 2D image space. Direct semantic segmentation of unstructured 3D point clouds is still an open research problem. The recently proposed PointNet architecture presents an interesting step ahead in that it can operate on unstructured point clouds, achieving encouraging segmentation results. However, it subdivides the input points into a grid of blocks and processes each such block individually. In this paper, we investigate the question how such an architecture can be extended to incorporate larger-scale spatial context. We build upon PointNet and propose two extensions that enlarge the receptive field over the 3D scene. We evaluate the proposed strategies on challenging indoor and outdoor datasets and show improved results in both scenarios.

23 January 2019
Verified
Book Chapter
Open access
PDF file
FEFrancis Engelmann
Francis Engelmann
TKTheodora Kontogianni
Theodora Kontogianni
JSJonas Schult
Jonas Schult
BLBastian Leibe
Bastian Leibe
In this paper, we present a deep learning architecture which addresses the problem of 3D semantic segmentation of unstructured point clouds (Fig. 1 ). Compared to previous work, we introduce grouping techniques which define point neighborhoods in the initial world space and the learned feature space. Neighborhoods are important as they allow to compute local or global point features depending on the spatial extend of the neighborhood. Additionally, we incorporate dedicated loss functions to further structure the learned point feature space: the pairwise distance loss and the centroid loss. We show how to apply these mechanisms to the task of 3D semantic segmentation of point clouds and report state-of-the-art performance on indoor and outdoor datasets.

31 October 2024
Verified
Book Chapter
Closed access
PDF file
RHRui Huang
Rui Huang
SPSongyou Peng
Songyou Peng
ATAyça Takmaz
Ayça Takmaz
FTFederico Tombari
Federico Tombari
MPMarc Pollefeys
Marc Pollefeys
FEFrancis Engelmann
Francis Engelmann

1 September 2017
Verified
Conference Paper
Closed access
AKAnton Kasyanov
Anton Kasyanov
FEFrancis Engelmann
Francis Engelmann
JSJorg Stuckler
Jorg Stuckler
BLBastian Leibe
Bastian Leibe
Complementing images with inertial measurements has become one of the most popular approaches to achieve highly accurate and robust real-time camera pose tracking. In this paper, we present a keyframe-based approach to visual-inertial simultaneous localization and mapping (SLAM) for monocular and stereo cameras. Our visual-inertial SLAM system is based on a real-time capable visual-inertial odometry method that provides locally consistent trajectory and map estimates. We achieve global consistency in the estimate through online loop-closing and non-linear optimization. Furthermore, our system supports relocalization in a map that has been previously obtained and allows for continued SLAM operation. We evaluate our approach in terms of accuracy, relocalization capability and run-time efficiency on public indoor benchmark datasets and on newly recorded outdoor sequences. We demonstrate state-of-the-art performance of our system compared to a visual-inertial odometry method and baseline visual SLAM approaches in recovering the trajectory of the camera.

1 March 2017
Verified
Conference Paper
Closed access
FEFrancis Engelmann
Francis Engelmann
JSJorg Stuckler
Jorg Stuckler
BLBastian Leibe
Bastian Leibe
Inferring the pose and shape of vehicles in 3D from a movable platform still remains a challenging task due to the projective sensing principle of cameras, difficult surface properties e.g. reflections or transparency, and illumination changes between images. In this paper, we propose to use 3D shape and motion priors to regularize the estimation of the trajectory and the shape of vehicles in sequences of stereo images. We represent shapes by 3D signed distance functions and embed them in a low-dimensional manifold. Our optimization method allows for imposing a common shape across all image observations along an object track. We employ a motion model to regularize the trajectory to plausible object motions. We evaluate our method on the KITTI dataset and show state-of-the-art results in terms of shape reconstruction and pose estimation accuracy.

27 August 2016
Verified
Book Chapter
Closed access
PDF file
FEFrancis Engelmann
Francis Engelmann
JSJörg Stückler
Jörg Stückler
BLBastian Leibe
Bastian Leibe