Since the data acquired by a PTZ camera change while adjusting the pan, tilt and zoom parameters, the results of tracking algorithms are difficult to reproduce; such difficulty limits the development and the comparison of tracking algorithms with PTZ cameras. The recently introduced 360-degree cameras acquire spherical views of the environment, generally stored as equirectangular images. Each pixel of an equirectangular image corresponds to a point on the spherical surface. A gnomonic projection can be used to project the points on the spherical surface onto a plane tangent to the sphere. Such tangent plane can be interpreted as the image plane of a virtual PTZ camera oriented towards the point of tangency. This paper proposes a framework to simulate PTZ cameras from 360-degree video enabling, in this way, the development and comparison of PTZ-based tracking algorithms. Furthermore, within the above mentioned framework, this paper presents a novel pedestrian tracking algorithm for 360-degree videos. The proposed algorithm aims at estimating the pan, tilt and zoom parameters required to control the virtual camera in such a way that the target is always at the center of the virtual camera view. The proposed method belongs to the category of tracking-by-detection algorithms; it also exploits the use of a dynamic memory to store the appearance models of the best past target detections. Preliminary results on a publicly available benchmark demonstrate the viability of the proposed approach.
The study of human behaviors in cognitive sciences provides clues to understand and describe people’s personal and interpersonal functioning. In particular, the temporal analysis of behavioral dynamics can be a powerful tool to reveal events, correlations and causalities but also to discover abnormal behaviors. However, the annotation of these dynamics can be expensive in terms of temporal and human resources. To tackle this challenge, this paper proposes a methodology to semi-automatically annotate behavioral data. Behavioral dynamics can be expressed as sequences of simple dynamical processes: transitions between such processes are generally known as change-points. This paper describes the necessary steps to detect and classify change-points in behavioral data by using a dataset collected in a real use-case scenario. This dataset includes motor observations from children with typical development and with neuro-developmental disorders. Abnormal movements which are present in such disorders are useful to validate the system in conditions that are challenging even for experienced annotators. Results show that the system: can be effective in the semi-automated annotation task; can be efficient in presence of abnormal behaviors; may achieve good performance when trained with limited manually annotated data.