28 August 2023 in IEEE Transactions on Radar Systems
The capturing of hands, including their poses, shapes and motions, has numerous potential applications, such as human-machine interfaces and medical use cases. However, in the radar context, most existing methods only allow for the recognition of dynamic hand gestures based on Doppler evaluations due to the respective systems’ limited lateral resolution. Radar-based high-resolution three-dimensional (3D) imaging using multiple-input multiple-output (MIMO) radars is currently the state-of-the-art in personnel security scanning. However, the associated imaging techniques suffer from computationally burdensome reconstruction algorithms that sample the entire 3D space of interest, thereby making them less suitable for real-time applications. Moreover, their application in hand motion tracking scenarios is limited by low frame rates that result from a high number of transmit frequencies. Hence, we present an efficient and powerful approach for the radar-based 3D reconstruction of hand poses. The method extends the frequency shift keying continuous wave radar principle and reconstructs the hand surface using only two carrier frequencies. Instead of reconstructing an entire 3D volume, only two single-tone radar images are computed. Depth information is derived from phase differences between corresponding pixels in the images. The approach significantly reduces computational load by three orders of magnitude compared with the state-of-the-art and enables higher frame rates. Within this paper, this novel reconstruction principle is analyzed and compared to a state-of-the-art radar imaging approach using a MIMO radar system with 94 transmitting and 94 receiving antennas. Detailed simulations of point targets and comprehensive measurements demonstrate the excellent imaging performance of our approach.
19 February 2025 in IEEE Journal of Microwaves
Near-field multiple-input multiple-output (MIMO) radar systems allow for high-resolution spatial imaging by leveraging multiple antennas to transmit and receive signals across multiple perspectives. This capability is particularly advantageous in challenging environments, where optical imaging techniques struggle. We present a novel approach to inverse rendering for near-field MIMO radar systems, aimed at reconstructing material properties such as surface roughness, dielectric constants, and conductivity from radar and ground-truth mesh data, for example obtained from multi-view stereo. Drawing inspiration from physically based rendering techniques in computer graphics, we formalize an advanced inverse rendering algorithm that integrates electromagnetic wave propagation models directly into the optimization process. To avoid bias from conventional radar image reconstruction algorithms in the optimization process, we directly derive gradients from raw radar outputs, resulting in more accurate material characterization. We validate our approach through extensive experiments on both synthetic and real radar datasets, demonstrating its effectiveness in a multitude of scenarios.
7 October 2024 in IEEE Journal of Microwaves
The radar-based analysis of human motion is actively being researched due to its contact- and markerless nature and ability to measure motion directly via the Doppler effect. Especially in medical and biomechanical fields, precise movement analysis is crucial. However, existing radar-based studies typically exhibit low lateral resolution, focusing on velocity evaluations and the tracking of scattering centers resolvable in the range or Doppler domains. In this work, we present a novel concept that enables a pixel-wise velocity analysis of human motion in radar near-field imaging scenarios. For this, we utilize the well-established back-projection technique to reconstruct consecutive radar images and perform a subsequent pixel-wise phase comparison. To accurately capture pixel-specific velocities along the depth dimension, this is followed by corrections of near-field geometry distortions accounting for aperture properties and pixel positions. Our theoretical derivations are supported by comprehensive point target simulations. To assess the performance of the proposed approach, we conducted a proof-of-concept study. We tracked a hand surface's movement while performing a finger tapping motion and compared the fingertip position and velocity determined by the radar with the respective values obtained from an optical marker-based system. The results showed a velocity measurement accuracy of $8.1 \,\mathrm{mms}^{-1}$ and a tracking accuracy of $1.4 \,\mathrm{m}\mathrm{m}$ , demonstrating the great potential of our approach. The high angular resolution of the velocity measurement enables the tracking of the entire illuminated body shell, extending the range of future applications of radar-based motion analysis.
11 March 2026 in ACM Transactions on Graphics
Utilizing the complementary strengths of wavelength-specific range or depth sensors is crucial for robust computer-assisted tasks such as autonomous driving. Despite this, there is still little research done at the intersection of optical depth sensors and radars operating close range, where the target is decimeters away from the sensors. Together with a growing interest in high-resolution imaging radars operating in the near field, the question arises how these sensors behave in comparison to their traditional optical counterparts. In this work, we take on the unique challenge of jointly characterizing depth imagers from both, the optical and radio-frequency domain using a multimodal spatial calibration. We collect data from four depth imagers, with three optical sensors of varying operation principle and an imaging radar. We provide a comprehensive evaluation of their depth measurements with respect to distinct object materials, geometries, and object-to-sensor distances. Specifically, we reveal scattering effects of partially transmissive materials and investigate the response of radio-frequency signals. All object measurements are made public in form of a multimodal dataset, called MAROON, which can be accessed at: https://vwirth.github.io/maroon .
1 September 2026 in IEEE Journal of Microwaves