A trust-aware safe control system for autonomous navigation in the presence of humans, specifically pedestrians, is presented. The system combines model predictive control (MPC) with control barrier functions (CBFs) and system-to-human trust (SHT) estimation to ensure safe and reliable navigation in human-populated environments. In the context of this article, we refer to SHT as the confidence score that a system has in an agent/pedestrian’s attentiveness. Pedestrian SHT values are computed based on features, extracted from camera sensor images, such as mutual eye contact, smartphone usage, and pose fluctuations and are integrated into the MPC controller’s CBF constraints, allowing the autonomous vehicle to make informed decisions considering pedestrian behavior. Simulations conducted in the CARLA driving simulator demonstrate the feasibility and effectiveness of the proposed system, showcasing more conservative behavior around inattentive pedestrians and vice versa. The results highlight the practicality of the system in real-world applications, providing a promising approach to enhance the safety and efficiency of autonomous navigation systems, especially self-driving vehicles.
15 June 2026 in IEEE Robotics and Automation Letters
Current Visual Simultaneous Localization and Mapping (VSLAM) systems often struggle to create maps that are both semantically rich and easy to interpret. While incorporating semantic scene knowledge helps build richer maps with contextual associations among mapped objects, representing them in structured formats such as scene graphs has not been widely addressed, leading to complex map comprehension and limited scalability. This paper introduces vS-Graphs, a novel real-time VSLAM framework that integrates vision-based scene understanding with map reconstruction and comprehensible graphbased representation. The framework infers structural elements (i.e., rooms and floors) from detected building components (i.e., walls and ground surfaces) and incorporates them into optimizable 3D scene graphs. This solution enhances the reconstructed map's semantic richness, comprehensibility, and localization accuracy. Extensive experiments on standard benchmarks and real-world datasets demonstrate that vS-Graphs achieves an average of 15.22% accuracy gain across all tested datasets compared to state-of-the-art VSLAM methods. Furthermore, the proposed framework achieves environment-driven semantic entity detection accuracy comparable to that of precise LiDARbased frameworks, using only visual features. The code is publicly available at https://github.com/snt-arg/visual sgraphs and is actively being improved.
22 January 2026 in IEEE Robotics and Automation Letters
3D Scene Graphs integrate both metric and semantic information, yet their structure remains underexploited for improving path planning efficiency and interpretability. In this work, we present S-Path, a Situationally-aware Path planner that leverages the metric-semantic structure of indoor 3D Scene Graphs to significantly enhance planning efficiency. S-Path follows a two-stage process: it first performs a search over a semantic graph derived from the scene graph to yield a human-understandable high-level path. This also identifies relevant regions for planning, which later allows the decomposition of the problem into smaller, independent subproblems that can be solved in parallel. We also introduce a replanning mechanism that, in the event of an infeasible path, reuses information from previously solved subproblems to update semantic heuristics and prioritize re-use to further improve the efficiency of future planning attempts. Extensive experiments on both real-world and simulated environments show that S-Path achieves average reductions of 6× in planning time while maintaining comparable path optimality to classical sampling-based planners, and surpassing them in complex scenarios, making it an efficient and interpretable path planner for environments represented by indoor 3D scene graphs.