Light Detection and Ranging (LIDAR) sensors, employing direct Time-of-Flight (dTOF) measurements, are crucial for precise surface localization and are increasingly integrated into compact chip designs. These sensors have extensive use in proximity sensing in various applications. This paper presents the innovative use of LIDAR sensors for ranging within wave guides to accurately detect touch and pressure. In our OptoSkin sensors, light propagates via total internal reflection (TIR) within the wave guide. Then it is reflected back to the sensor as a result of wave guide deformation and/or scattering in the contact area, a phenomenon attributed to frustrated total internal reflection (FTIR). We have designed, simulated, and implemented different OptoSkin sensors using wave guides constructed from a flexible rod, rigid curved 3D printed resin, and planar soft silicone rubber, respectively. Each configuration is equipped with multiple LIDAR sensors, demonstrating effective localization of touch points. In addition, pressure sensing was performed on the elastic wave guides. These novel touch sensors show great potential for applications such as robotic sensor skins, which enhance tactile responsiveness and interaction.
Optical tactile sensors offer a promising avenue for advanced sensing and perception. We focus on frustrated total internal reflection (FTIR) tactile sensors that utilize time-of-flight (ToF) measurements. We analyze the complex behavior of ToF signals within optical waveguides in the time domain, where phenomena like internal reflections and scattering significantly influence light propagation, especially in the presence of touch. Leveraging this analysis, we develop a real-time processing algorithm that enhances FTIR tactile sensing capabilities, allowing for precise detection. We evaluate our algorithm on an OptoSkin sensor setup, demonstrating a significant improvement in multi-touch detection and contact shape reconstruction accuracy. This work represents a significant step towards high-resolution, low-cost optical tactile sensors, and advances the understanding of time-resolved light transport within waveguides and in scattering media.
Non-line-of-sight (NLOS) imaging is an inverse problem that consists of reconstructing a hidden scene out of the direct line-of-sight given the time-resolved light scattered back by the hidden scene on a relay wall. Phasor fields transforms NLOS imaging into virtual LOS imaging by treating the relay wall as a secondary camera, which allows reconstruction of the hidden scene using a forward diffraction operator based on the Rayleigh-Sommerfeld diffraction (RSD) integral. In this work, we leverage the unitary property of the forward diffraction operator and the dual space it introduces, concepts already studied in inverse diffraction, to explain how phasor fields can be understood as an inverse diffraction method for solving the hidden object reconstruction, even though initially it might appear it is using a forward diffraction operator. We present two analogies, alternative to the classical virtual camera metaphor in phasor fields, to NLOS imaging, relating the relay wall either as a phase conjugator and a hologram recorder. Based on this, we express NLOS imaging as an inverse diffraction problem, which is ill-posed under general conditions, in a formulation named inverse phasor fields, that we solve numerically. This enables us to analyze which conditions make the NLOS problem formulated as inverse diffraction well-posed, and propose a new quality metric based on the matrix rank of the forward diffraction operator, which we relate to the Rayleigh criterion for lateral resolution of an imaging system already used in phasor fields.
We investigate crosstalk effects in a dual-modality tactile–proximity sensing system based on Time-of-Flight (ToF) technology integrated within a flat poly(methyl methacrylate) (PMMA) light guide. Building on the OptoSkin framework, we employ two commercially available TMF8828 multi-zone ToF sensors, one configured for tactile detection via frustrated total internal reflection (FTIR) and the other for external proximity measurements through the same transparent substrate. Controlled experiments were conducted using a 2 cm2 silicone pad for tactile interaction and an A4-sized diffuse white target for proximity detection. Additional measurements with a movable PMMA sheet were performed to quantify signal attenuation, peak broadening, and confidence degradation under transparent-substrate conditions. The results demonstrate that the TMF8828 can simultaneously resolve both contact-induced scattering and distant reflections, but that localized interference zones occur when sensor fields of view overlap within the substrate. Histogram analysis reveals the underlying multi-path contributions, providing diagnostic insight not available from black-box ToF devices. These findings highlight both the opportunities and limitations of integrating multiple ToF sensors into transparent waveguides and inform design strategies for scalable robotic skins, wearable interfaces, and multi-modal human–machine interaction systems.
Robust next‐event estimation (NEE) remains a challenge in scenes characterized by sparse or small‐scale geometry where indirect illumination is the primary transport mechanism. In these scenes, traditional path construction, which relies on local directional sampling, often fails to find intersections with the sparse geometry, and standard NEE also struggles as it typically connects vertices directly to emitters, failing when those connections are occluded or require intermediate bounces. We propose a novel approach that constructs paths via direct geometry sampling. Instead of relying on stochastic ray casting, we repurpose the scene's bounding volume hierarchy (BVH) as a hierarchical sampling structure. By performing a stochastic top‐down traversal, we transform the selection of the next path vertex into a hierarchical problem. To prioritize high‐throughput connections, the traversal is guided by a proxy contribution function evaluated at each internal node. This function leverages aggregated statistics of the geometry contained in the BVH nodes to efficiently estimate contribution during traversal. We demonstrate orders of magnitude improvements in complex scenarios such as indirect illumination from sparse geometry or rendering discrete scattering media.