Pedestrian trajectory prediction in dynamic scenes remains a challenging and critical problem in numerous applications, such as self-driving cars and socially aware robots. Challenges concentrate on capturing pedestrians' motion patterns and social interactions, as well as handling the future uncertainties. Recent studies focus on modeling pedestrians' motion patterns with recurrent neural networks, capturing social interactions with pooling- or graph-based methods, and handling future uncertainties by using the random Gaussian noise as the latent variable. However, they do not integrate specific obstacle avoidance experiences (OAEs) that may improve prediction performance. For example, pedestrians' future trajectories are always influenced by others in front. Here, we propose the Graph-based Trajectory Predictor with Pseudo-Oracle (GTPPO), an encoder-decoder-based method conditioned on pedestrians' future behaviors. Pedestrians' motion patterns are encoded with a long short-term memory unit, which introduces temporal attention to highlight specific time steps. Their interactions are captured by a graph-based attention mechanism, which draws OAE into the data-driven learning process of graph attention. Future uncertainties are handled by generating multimodal outputs with an informative latent variable. Such a variable is generated by a novel pseudo-oracle predictor, which minimizes the knowledge gap between historical and ground-truth trajectories. Finally, the GTPPO is evaluated on ETH, UCY, and Stanford Drone datasets, and the results demonstrate state-of-the-art performance. Besides, the qualitative evaluations show successful cases of handling sudden motion changes in the future. Such findings indicate that GTPPO can peek into the future.
As an effective means of solving collision problems caused by the limited perspective on board, the cooperative roadside system is gaining popularity. To improve the vehicle detection abilities in such online safety systems, in this paper, we propose a novel multi-sensor multi-level enhanced convolutional network model, called multi-sensor multi-level enhanced convolutional network architecture (MME-YOLO), with consideration of hybrid realistic scene of scales, illumination, and occlusion. MME-YOLO consists of two tightly coupled structures, i.e., the enhanced inference head and the LiDAR-Image composite module. More specifically, the enhanced inference head preliminarily equips the network with stronger inference abilities for redundant visual cues by attention-guided feature selection blocks and anchor-based/anchor-free ensemble head. Furthermore, the LiDAR-Image composite module cascades the multi-level feature maps from the LiDAR subnet to the image subnet, which strengthens the generalization of the detector in complex scenarios. Compared with YOLOv3, the enhanced inference head achieves a 5.83% and 4.88% mAP improvement on visual dataset LVSH and UA-DETRAC, respectively. Integrated with the composite module, the overall architecture gains 91.63% mAP in the collected Road-side Dataset. Experiments show that even under the abnormal lightings and the inconsistent scales at evening rush hours, the proposed MME-YOLO maintains reliable recognition accuracy and robust detection performance.
Many intelligent transportation system applications require accurate, reliable, and continuous vehicle positioning. How to achieve such positioning performance in extended GPS-denied environments such as tunnels is the main challenge for land vehicles. This paper proposes a hybrid multi-sensor fusion strategy for vehicle positioning in tunnels. First, the preliminary positioning algorithm is developed. The Radio Frequency Identification (RFID) technology is introduced to achieve preliminary positioning in the tunnel. The received signal strength (RSS) is used as an indicator to calculate the distances between the RFID tags and reader, and then a Least Mean Square (LMS) federated filter is designed to provide the preliminary position information for subsequent global fusion. Further, to improve the positioning performance in the tunnel, an interactive multiple model (IMM)-based global fusion algorithm is developed to fuse the data from preliminary positioning results and low-cost in-vehicle sensors, such as electronic compasses and wheel speed sensors. In the actual implementation of IMM, the strong tracking extended Kalman filter (STEKF) algorithm is designed to replace the conventional extended Kalman filter (EKF) to achieve model individual filtering. Finally, the proposed strategy is evaluated through experiments. The results validate the feasibility and effectiveness of the proposed strategy.
Light detection and ranging (LiDAR) positioning has received great attention especially when satellites fail. However, the positioning accuracy is still subjected to the following. First, the LiDAR positioning accuracy is affected by the sparsity due to LiDAR beams and environment. Second, the existing methods for suppressing cumulative errors are based on ego-vehicle sensing that requires the motion of repeated paths. Moreover, the output frequency of LiDAR is low. To solve the above problems, an enhanced-LiDAR/ultrawideband (UWB)/inertial navigation system integrated positioning methodology is proposed. First, the enhanced LiDAR odometry module is designed to improve the resolution of LiDAR beams for more accurate odometry. Then, the cooperative optimization module is proposed to introduce UWB observation to suppress the accumulated error without relying on ego-vehicle sensing. Finally, the factor graph fusion module is used to fuse multisensor information dynamically and improve the output frequency. Experimental results prove the effectiveness of our methodology.
The design and construct pn heterojunction to reduce the recombination rate of photogenerated electron-hole pairs can effectively improve photocatalytic activity. In this study, ZnO/NiO heterojunctions were fabricated by annealing a Zn/Ni metal organic framework precursor synthesized via coprecipitation. The effects of the precursor annealing temperature on the microstructure, morphology, and optical properties of the ZnO/NiO nanocomposites were investigated using X-ray diffraction, scanning electron microscopy, transmission electron microscopy, X-ray photoelectron spectroscopy, and UV-vis absorption spectroscopy. The results showed that the nanocomposite was composed of hexagonal wurtzite ZnO and cubic NiO, with the former being the dominant phase. Large ZnO nanoparticles were attached to small NiO nanoparticles, and a pn heterojunction interface was formed. The photodegradation performance of the nanomaterials was evaluated by monitoring the degradation of RhB under irradiation by ultraviolet light. The ZnO/NiO nanocomposites exhibited excellent photocatalytic activity when the annealing temperature was 550 °C. The photodegradation mechanism was also analyzed in detail, revealing that the heterojunction between the n-type ZnO and the p-type NiO played an important role in impeding the recombination of photogenerated electron-hole pairs and improving the photocatalytic efficiency.