Future UAV (unmanned aerial vehicle) operations in urban environments demand a PNT (position, navigation, and timing) solution that is both robust and resilient. While a GNSS (global navigation satellite system) can provide an accurate position under open-sky assumptions, the complexity of urban operations leads to NLOS (non-line-of-sight) and multipath effects, which in turn impact the accuracy of the PNT data. A key research question within the research community pertains to determining the appropriate hybrid fusion architecture that can ensure the resilience and continuity of UAV operations in urban environments, minimizing significant degradations of PNT data. In this context, we present a novel federated fusion architecture that integrates data from the GNSS, the IMU (inertial measurement unit), a monocular camera, and a barometer to cope with the GNSS multipath and positioning performance degradation. Within the federated fusion architecture, local filters are implemented using EKFs (extended Kalman filters), while a master filter is used in the form of a GRU (gated recurrent unit) block. Data collection is performed by setting up a virtual environment in AirSim for the visual odometry aid and barometer data, while Spirent GSS7000 hardware is used to collect the GNSS and IMU data. The hybrid fusion architecture is compared to a classic federated architecture (formed only by EKFs) and tested under different light and weather conditions to assess its resilience, including multipath and GNSS outages. The proposed solution demonstrates improved resilience and robustness in a range of degraded conditions while maintaining a good level of positioning performance with a 95th percentile error of 0.54 m for the square scenario and 1.72 m for the survey scenario.

Vision-based navigation systems (VINS) are increasingly utilised as an alternative to GNSS for UAVs operating in urban environments, but they suffer from performance degradation under visual fault conditions like illumination variation, rapid motion, texture-less environments, and weather effects. While hybrid architecture incorporating Kalman filters and machine learning (ML) improves performance, they often lack evidence of providing contingency for non-Gaussian error distributions, limiting operational safety. To address these shortcomings, an enhanced hybrid VINS architecture is proposed, featuring a Bayesian GRU-based error correction network (B-GRU) to provide a contingency while compensating model errors. To the best of the authors’ knowledge, this is the first attempt to estimate uncertainty using a B-GRU compensator while addressing data uncertainty for VINS applications. The system architecture integrates an Error-State Kalman Filter (ESKF) and the B-GRU, compensating for position errors with uncertainty prediction. The proposed approach is validated using datasets from MATLAB incorporated in an Unreal Engine simulated environment, replicating the complex fault conditions. The ML model is trained on various visual failure modes to adapt the variability in the signal patterns during flights with simulated datasets and tested across varied flight paths and lighting scenarios. The results demonstrate that the fusion strategy effectively corrects erroneous measurements arising from corrupted sensor data and imperfect models and achieves an improvement of 78.06% compared to SOTA hybrid VIO on the horizontal axis while capturing complex flight dynamics in an unseen environment. A comparative analysis demonstrates the effectiveness of B-GRU in mitigating failure modes with a predictive error boundary, achieving a 72% improvement in performance compared to the architecture that integrates GRU-based error compensation. This approach shows a step forward in enhancing positioning accuracy and contingency in challenging urban environments.

Future smart cities will consist of a heterogeneous environment, including UGVs (Unmanned Ground Vehicles) and UAVs (Unmanned Aerial Vehicles), used for different applications such as last mile delivery. Considering the vulnerabilities of GNSS (Global Navigation System Satellite) in urban environments, a resilient PNT (Position, Navigation, Timing) solution is needed. A key research question within the PNT community is the capability to deliver a robust and resilient time solution to multiple devices simultaneously. The paper is proposing an innovative time dissemination framework, based on IQuila’s SDN (Software Defined Network) and quantum random key encryption from Quantum Dice to multiple users. The time signal is disseminated using a wireless IEEE 802.11ax, through a wireless AP (Access point) which is received by each user, where a KF (Kalman Filter) is used to enhance the timing resilience of each client into the framework. Each user is equipped with a Jetson Nano board as CC (Companion Computer), a GNSS receiver, an IEEE 802.11ax wireless card, an embedded RTC (Real Time clock) system, and a Pixhawk 2.1 as FCU (Flight Control Unit). The paper is presenting the performance of the fusion framework using the MUEAVI (Multi-user Environment for Autonomous Vehicle Innovation) Cranfield’s University facility. Results showed that an alternative timing source can securely be delivered fulfilling last mile delivery requirements for aerial platforms achieving sub millisecond offset.