Pedestrian trajectory prediction is one of the main concerns of computer vision problems in the automotive industry, especially in the field of advanced driver assistance systems. The ability to anticipate the next movements of pedestrians on the street is a key task in many areas, e.g., self-driving auto vehicles, mobile robots or advanced surveillance systems, and they still represent a technological challenge. The performance of state-of-the-art pedestrian trajectory prediction methods currently benefits from the advancements in sensors and associated signal processing technologies. The current paper reviews the most recent deep learning-based solutions for the problem of pedestrian trajectory prediction along with employed sensors and afferent processing methodologies, and it performs an overview of the available datasets, performance metrics used in the evaluation process, and practical applications. Finally, the current work exposes the research gaps from the literature and outlines potential new research directions.

Predicting pedestrian trajectories in urban scenarios is a challenging task that has a wide range of applications, from video surveillance to autonomous driving. The task is difficult since pedestrian behavior is affected by both their individual path’s history, their interactions with others, and with the environment. For predicting pedestrian trajectories, an attention-based interaction-aware spatio-temporal graph neural network is introduced. This paper introduces an approach based on two components: a spatial graph neural network (SGNN) for interaction-modeling and a temporal graph neural network (TGNN) for motion feature extraction. The SGNN uses an attention method to periodically collect spatial interactions between all pedestrians. The TGNN employs an attention method as well, this time to collect each pedestrian’s temporal motion pattern. Finally, in the graph’s temporal dimension characteristics, a time-extrapolator convolutional neural network (CNN) is employed to predict the trajectories. Using a lower variable size (data and model) and a better accuracy, the proposed method is compact, efficient, and better than the one represented by the social-STGCNN. Moreover, using three video surveillance datasets (ETH, UCY, and SDD), D-STGCN achieves better experimental results considering the average displacement error (ADE) and final displacement error (FDE) metrics, in addition to predicting more social trajectories.

Typically, devices work to improve life quality, measure parameters, and make decisions. They also signalize statuses, and take actions accordingly. When working, they measure different values. These are to be compared against thresholds. Some time ago, vision systems came into play. They use camera(s) to deliver(s) images to a processor module. The received images are processed to perform detections (typically, they focus to detect objects, pedestrians, mopeds, cyclists, etc.). Images are analyzed and thresholds are used to compare the computed values. The important thing is that images are affected by noise. Therefore, the vision system performance can be affected by weather in some applications (for example, in automotive). An interesting case in this domain is when the measured/computed values show small variations near the threshold (not exceeding) but very close to it. The system is not able to signalize/declare a state in this case. It is also important to mention that changing the threshold does not guarantee solving the problem in any future case, since this may happen again. This paper proposes the Alpha-Beta family of filters as a solution to this problem. The members can track a signal based on measured values. This reveals errors when the tracked-signal’s first derivative changes sign. These errors are used in this paper to bypass the threshold problem. Since these errors appear in both situations (when the first derivative decreases from positive to negative and increases from negative to positive), the proposed method works when the observed data are in the vicinity of the threshold but above it.