Friedhelm Hamann

Friedhelm Hamann

Auto-generated profile, based on publicly available information

Friedhelm Hamann

Technical University of Berlin

Research Focus & Metrics

Academic Career Length

4Years (2023-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
30 October 2023 in IEEE Transactions on Pattern Analysis and Machine Intelligence
Verified
Journal Article
Open access
SSShintaro Shiba
Shintaro Shiba
FHFriedhelm Hamann
Friedhelm Hamann
Yoshimitsu AokiYoshimitsu Aoki
Yoshimitsu Aoki
GGGuillermo Gallego
Guillermo Gallego
Schlieren imaging is an optical technique to observe the flow of transparent media, such as air or water, without any particle seeding. However, conventional frame-based techniques require both high spatial and temporal resolution cameras, which impose bright illumination and expensive computation limitations. Event cameras offer potential advantages (high dynamic range, high temporal resolution, and data efficiency) to overcome such limitations due to their bio-inspired sensing principle. This paper presents a novel technique for perceiving air convection using events and frames by providing the first theoretical analysis that connects event data and schlieren. We formulate the problem as a variational optimization one combining the linearized event generation model with a physically-motivated parameterization that estimates the temporal derivative of the air density. The experiments with accurately aligned frame- and event camera data reveal that the proposed method enables event cameras to obtain on par results with existing frame-based optical flow techniques. Moreover, the proposed method works under dark conditions where frame-based schlieren fails, and also enables slow-motion analysis by leveraging the event camera's advantages. Our work pioneers and opens a new stack of event camera applications, as we publish the source code as well as the first schlieren dataset with high-quality frame and event data. https://github.com/tub-rip/event_based_bos .

28 October 2024
Verified
Book Chapter
Closed access
PDF file
FHFriedhelm Hamann
Friedhelm Hamann
ZWZiyun Wang
Ziyun Wang
IAIoannis Asmanis
Ioannis Asmanis
KCKenneth Chaney
Kenneth Chaney
GGGuillermo Gallego
Guillermo Gallego
KDKostas Daniilidis
Kostas Daniilidis

11 November 2024 in Advanced Intelligent Systems
Verified
Journal Article
Open access
FHFriedhelm Hamann
Friedhelm Hamann
SGSuman Ghosh
Suman Ghosh
IMIgnacio Juárez Martínez
Ignacio Juárez Martínez
THTom Hart
Tom Hart
AKAlex Kacelnik
Alex Kacelnik
GGGuillermo Gallego
Guillermo Gallego
Event cameras are novel bioinspired vision sensors that measure pixel‐wise brightness changes asynchronously instead of images at a given frame rate. They offer promising advantages, namely, a high dynamic range, low latency, and minimal motion blur. Modern computer vision algorithms often rely on artificial neural network approaches, which require image‐like representations of the data and cannot fully exploit the characteristics of event data. Herein, approaches to action recognition based on the Fourier transform are proposed. The approaches are intended to recognize oscillating motion patterns commonly present in nature. In particular, the approaches are applied to a recent dataset of breeding penguins annotated for “ecstatic display,” a behavior where the observed penguins flap their wings at a certain frequency. It is found that the approaches are both simple and effective, producing slightly lower results than a deep neural network (DNN) while relying just on a tiny fraction of the parameters compared to the DNN (five orders of magnitude fewer parameters). They work well despite the uncontrolled, diverse data present in the dataset. It is hoped that this work opens a new perspective on event‐based processing and action recognition.


15 July 2024 in arXiv
Verified
Preprint
Open access
PDF file
FHFriedhelm Hamann
Friedhelm Hamann
ZWZiyun Wang
Ziyun Wang
IAIoannis Asmanis
Ioannis Asmanis
KCKenneth Chaney
Kenneth Chaney
GGGuillermo Gallego
Guillermo Gallego
KDKostas Daniilidis
Kostas Daniilidis
Current optical flow and point-tracking methods rely heavily on synthetic datasets. Event cameras are novel vision sensors with advantages in challenging visual conditions, but state-of-the-art frame-based methods cannot be easily adapted to event data due to the limitations of current event simulators. We introduce a novel self-supervised loss combining the Contrast Maximization framework with a non-linear motion prior in the form of pixel-level trajectories and propose an efficient solution to solve the high-dimensional assignment problem between non-linear trajectories and events. Their effectiveness is demonstrated in two scenarios: In dense continuous-time motion estimation, our method improves the zero-shot performance of a synthetically trained model on the real-world dataset EVIMO2 by 29%. In optical flow estimation, our method elevates a simple UNet to achieve state-of-the-art performance among self-supervised methods on the DSEC optical flow benchmark. Our code is available at https://github.com/tub-rip/MotionPriorCMax.

5 September 2024 in arXiv
Verified
Preprint
Open access
PDF file
FHFriedhelm Hamann
Friedhelm Hamann
HLHanxiong Li
Hanxiong Li
PMPaul Mieske
Paul Mieske
Lars LewejohannLars Lewejohann
Lars Lewejohann
GGGuillermo Gallego
Guillermo Gallego
Enabled by large annotated datasets, tracking and segmentation of objects in videos has made remarkable progress in recent years. Despite these advancements, algorithms still struggle under degraded conditions and during fast movements. Event cameras are novel sensors with high temporal resolution and high dynamic range that offer promising advantages to address these challenges. However, annotated data for developing learning-based mask-level tracking algorithms with events is not available. To this end, we introduce: ($i$) a new task termed \emph{space-time instance segmentation}, similar to video instance segmentation, whose goal is to segment instances throughout the entire duration of the sensor input (here, the input are quasi-continuous events and optionally aligned frames); and ($ii$) \emph{\dname}, a dataset for the new task, containing aligned grayscale frames and events. It includes annotated ground-truth labels (pixel-level instance segmentation masks) of a group of up to seven freely moving and interacting mice. We also provide two reference methods, which show that leveraging event data can consistently improve tracking performance, especially when used in combination with conventional cameras. The results highlight the potential of event-aided tracking in difficult scenarios. We hope our dataset opens the field of event-based video instance segmentation and enables the development of robust tracking algorithms for challenging conditions.\url{https://github.com/tub-rip/MouseSIS}