26 March 2025 in IEEE Transactions on Intelligent Transportation Systems
Sensor fusion plays an increasingly important role in real-time traffic perception using roadside sensing devices because the use of single type of sensors often fail to deliver satisfactory performance in certain harsh environment. This paper investigates asynchronous data fusion for lane-level vehicle tracking with randomly delayed measurements and inaccurate detections from millimeter wave (MMW) radars and magnetic sensors in tunnels, where vehicle tracking with single type of sensors can not meet the requirements of reliable and accurate lane-level tracking due to inaccurate radar detections at far distances, noisy radar detections in tunnel environment, and missed or false vehicle detections by magnetic sensors. A multisensor data association algorithm is first designed to assign the measurements of MMW radar and magnetic sensors to a particular vehicle. A multi-lane estimation model is then developed, which employs Bayesian weight mixture filtering to fuse MMW radar and magnetic sensor measurements and to estimate the lane in which a vehicle is located. Finally, the proposed algorithm is implemented in a real environment -the Xianfengding Tunnel located in Jiangxi Province, China. Experiments are conducted to validate the accuracy of the proposed method using real data. The proposed method and the collected data are further integrated to establish a real-time digital twin system aimed at supporting advanced traffic management. The fusion results and the real radar measurement dataset of the tunnel are made available at https://github.com/futianxuan/data.
9 March 2026 in IEEE Internet of Things Journal
Accurately estimating the real-time state of dynamic systems from noisy measurements is a fundamental task in signal processing. State-space models (SSMs) are commonly utilized to model system dynamics and account for uncertainty in both system state evolution and measurement data. Kalman filter (KF) and its variants are widely recognized for their low computational complexity and ability to address state evolution and measurement update. In practice, accurately modeling the system dynamics and obtaining model parameters are difficult, especially for nonlinear systems. These tasks often require predefined motion and measurement models that rely on coarse approximations and extensive manual tuning. In this article, we propose the deep-Learning-aided Kalman filter (DL-KF), a robust deep-learning-aided KF designed to perform KF in nonlinear dynamic environments where the process model is unavailable, and the system noise is also unknown. However, a linear measurement model is assumed. DL-KF utilizes a long short-term memory (LSTM) network to capture nonlinear process dynamics and generate state priors from historical measurements. Additionally, a gated recurrent unit (GRU) is utilized to independently learn innovation covariance, addressing measurement noise uncertainty, followed by the computation of the Kalman gain within the KF framework. By integrating an SSM framework with deep learning modules, the proposed method strikes the balance between the flexibility of a data-driven approach and the interpretability of classical Kalman-based approaches. Empirical results demonstrate that DL-KF significantly outperforms traditional model-based filters, including the KF, extended KF (EKF), and unscented KF (UKF). Furthermore, it surpasses state-of-the-art (SOTA) hybrid methods such as KalmanNet, Split-KalmanNet, and adaptive KalmanNet (AKNet), particularly in challenging scenarios involving high nonlinearity (e.g., the Lorenz attractor) and maneuver-induced model mismatches. The algorithm’s efficacy and robustness are further validated through extensive experiments on real-world tunnel radar and the University of Michigan north campus long-term (NCLT) datasets.
10 March 2025 in IEEE Transactions on Intelligent Transportation Systems
Smart road studs have been extensively deployed as road safety and data collection devices. Accurate and reliable detection of smart road studs and its further integration into the perception and control modules of connected and autonomous vehicles (CAVs) undoubtedly benefit road boundary detection, localization of CAVs and augument the safety of CAVs’ driving. This work investigates real-time, accurate and reliable detection of smart road studs, which is a challenging task for CAVs because existing methods fail to achieve accurate and real-time smart road stud detection, especially in harsh road environment. To address these challenges, we first build a real-world smart road stud dataset, and then propose and validate a lightweight and efficient smart road stud detection model based on the you only look once 8th version (YOLOv8), called SRS-YOLO. First, a Squeeze-and-Excitation (SE) attention module is used to improve the coarse-to-fine (C2F) module to differentiate the channel importance of feature maps and improve the detection accuracy of smart road studs. Second, a novel downsampling module (DownS) that integrates the average pooling and the max pooling is designed to reduce the number of parameters and minimize information loss during the downsampling process. Third, the loss function is replaced with the Normalized Wasserstein Distance (NWD) loss to alleviate the sensitivity to location deviations when computing the loss for small targets. The experimental results demonstrate that the proposed SRS-YOLO outperforms other state-of-the-art methods, and achieves a 87.92% mean average precision at a real-time speed of 78 frames/s. Our dataset is available at: https://github.com/wky-xidian/smart-road-stud-dataset.
1 January 2026 in IEEE Internet of Things Journal
10 February 2026 in IEEE Sensors Journal
3D object detection, a sought-after feature for connected and autonomous vehicles (CAVs), offers precise localization and classification of obstacles by estimating their spatial attributes from 2D images. This approach addresses the limitation of traditional 2D detection, which lacks spatial information. However, the task becomes challenging in complex environments with occlusions and restricted line-of-sight views, such as intersections and winding roads. Fortunately, roadside infrastructure equipped with traffic cameras, commonly deployed at these critical locations, offers a wider field of view. It can therefore provide valuable support to CAVs and improve object detection performance. Vehicle-to-infrastructure (V2I) cooperative 3D detection frameworks leverage vehicle-to-everything (V2X) communication to transmit roadside data to CAVs. By integrating multi-view observations from both vehicle-mounted and roadside cameras, these frameworks enable a more accurate and semantically rich understanding of the driving environment. In this paper, we propose V2IFormer, a multi-view feature fusion framework based on BEV representations, designed to enhance 3D object detection. Specifically, V2IFormer extracts semantic features from 2D images captured by both vehicle-mounted and roadside cameras and transforms them into BEV features. At the CAV side, a deformable mutual-attention algorithm is employed to dynamically select spatial features and fuse the most informative BEV representations from both sources. This strategy reduces interference from irrelevant or corrupted features and improves fusion efficiency. Finally, we validate the effectiveness of V2IFormer on the DAIR-V2X benchmark. Our framework achieves state-of-the-art 3D object detection performance, particularly in scenarios with occlusion and limited line-of-sight.
19 January 2026 in IEEE Internet of Things Journal
The integration of the global navigation satellite system (GNSS), an odometer, and an inertial navigation system (INS) holds significant potential for achieving high-precision vehicle localization. However, the GNSS is vulnerable to obstructions and jamming, and the odometer is unreliable in harsh road conditions. These factors can lead to cumulative positioning errors in GNSS-denied environments. To address these issues, a novel multisource information fusion-based vehicle localization method that integrates an onboard binocular camera, an INS, and smart road studs (SRSs) —Internet of Things (IoT) devices extensively used for road safety and data collection in intelligent transportation systems—is introduced. We construct a position measurement model directly in the camera coordinate system through an enhanced You Only Look Once 8th version (YOLOv8) algorithm for SRS detection, combined with binocular vision measurement and position transformations. Additionally, we propose a method to enhance vehicle localization accuracy by integrating vehicle speed without relying on additional hardware speed sensors. The vehicle’s speed is estimated from the image sequences captured by the onboard camera using a deep neural network (DNN), named Speed-Net. The final navigation results are produced by fusing the SRS-aided positioning information, the estimated vehicle speed, and INS data through an error-state extended Kalman filter (ESEKF). Real-world experiments demonstrate the effectiveness of the proposed SRS/velocity/INS integrated vehicle localization method.