The rapid advancement in deep forgery technology in recent years has created highly deceptive face video content, posing significant security risks. Detecting these fakes is increasingly urgent and challenging. To improve the accuracy of deepfake face detection models and strengthen their resistance to adversarial attacks, this manuscript introduces a method for detecting forged faces and defending against adversarial attacks based on a multi-feature decision fusion. This approach allows for rapid detection of fake faces while effectively countering adversarial attacks. Firstly, an improved IMTCCN network was employed to precisely extract facial features, complemented by a diffusion model for noise reduction and artifact removal. Subsequently, the FG-TEFusionNet (Facial-geometry and Texture enhancement fusion-Net) model was developed for deepfake face detection and assessment. This model comprises two key modules: one for extracting temporal features between video frames and another for spatial features within frames. Initially, a facial geometry landmark calibration module based on the LRNet baseline framework ensured an accurate representation of facial geometry. A SENet attention mechanism was then integrated into the dual-stream RNN to enhance the model’s capability to extract inter-frame information and derive preliminary assessment results based on inter-frame relationships. Additionally, a Gram image texture feature module was designed and integrated into EfficientNet and the attention maps of WSDAN (Weakly Supervised Data Augmentation Network). This module aims to extract deep-level feature information from the texture structure of image frames, addressing the limitations of purely geometric features. The final decisions from both modules were integrated using a voting method, completing the deepfake face detection process. Ultimately, the model’s robustness was validated by generating adversarial samples using the I-FGSM algorithm and optimizing model performance through adversarial training. Extensive experiments demonstrated the superior performance and effectiveness of the proposed method across four subsets of FaceForensics++ and the Celeb-DF dataset.
Video anomaly detection refers to the rapid identification and localization of anomalous events during video surveillance. It has become a challenging task due to the dependence of anomalous event definitions on specific scenes and the scarcity, diversity and non-exhaustiveness of anomalous events. This manuscript proposes a robust frame prediction-based method for video anomaly detection, it can solve the problems of underutilized spatio-temporal sequence information and difficulty in capturing subtle motions. Firstly, a spatial-temporal feature fusion network is constructed using FusionNet and LSTM. Secondly, feature optimization is performed on this spatio-temporal feature fusion network using optical flow feature enhancement. To further improve the robustness of the model, patch GAN is added to FusionNet-LSTM for adversarial training, and the objective function in training is optimized with apparent constraints and image similarity constraints to approach the real frame. Finally, to reduce the sequence error, a PNSR-based mean normalized anomaly score calculation is used in the manuscript. Experiments show that the average accuracy of the proposed method for anomalous event detection on UCSD Ped2 and CUHK Avenue datasets is 96.9% and 86.1% respectively, which is 1.5% and 1.0% better than the benchmark model U-Net, and the model has low computational complexity where FLOP is 6.196G and the number of parameters is 6.829M. It can meet the application requirements of real-time video anomaly detection and has great value for security video surveillance.
For the precise measurement of complex surfaces, determining the position, direction, and path of a laser sensor probe is crucial before obtaining exact measurements. Accurate surface measurement hinges on modifying the overtures of a laser sensor and planning the scan path of the point laser displacement sensor probe to optimize the alignment of its measurement velocity and accuracy. This manuscript proposes a 3D surface laser scanning path planning technique that utilizes adaptive ant colony optimization with sub-population and fuzzy logic (SFACO), which involves the consideration of the measurement point layout, probe attitude, and path planning. Firstly, this study is based on a four-coordinate measuring machine paired with a point laser displacement sensor probe. The laser scanning four-coordinate measuring instrument is used to establish a coordinate system, and the relationship between them is transformed. The readings of each axis of the object being measured under the normal measuring attitude are then reversed through the coordinate system transformation, thus resulting in the optimal measuring attitude. The nominal distance matrix, which demonstrates the significance of the optimal measuring attitude, is then created based on the readings of all the points to be measured. Subsequently, a fuzzy ACO algorithm that integrates multiple swarm adaptive and dynamic domain structures is suggested to enhance the algorithm’s performance by refining and utilizing multiple swarm adaptive and fuzzy operators. The efficacy of the algorithm is verified through experiments with 13 popular TSP benchmark datasets, thereby demonstrating the complexity of the SFACO approach. Ultimately, the path planning problem of surface 3D laser scanning measurement is addressed by employing the proposed SFACO algorithm in conjunction with a nominal distance matrix.
4 January 2022 in Journal of Advanced Transportation
In traffic scenarios, vehicle trajectories can provide almost all the dynamic information of moving vehicles. Analyzing the vehicle trajectory in the monitoring scene can grasp the dynamic road traffic information. Cross-camera association of vehicle trajectories in multiple cameras can break the isolation of target information between single cameras and obtain the overall road operation conditions in a large-scale video surveillance area, which helps road traffic managers to conduct traffic analysis, prediction, and control. Based on the framework of DBT automatic target detection, this paper proposes a cross-camera vehicle trajectory correlation matching method based on the Euclidean distance metric correlation of trajectory points. For the multitarget vehicle trajectory acquired in a single camera, we first perform 3D trajectory reconstruction based on the combined camera calibration in the overlapping area and then complete the similarity association between the cross-camera trajectories and the cross-camera trajectory update, and complete the trajectory transfer of the vehicle between adjacent cameras. Experiments show that the method in this paper can well solve the problem that the current tracking technology is difficult to match the vehicle trajectory under different cameras in complex traffic scenes and essentially achieves long-term and long-distance continuous tracking and trajectory acquisition of multiple targets across cameras.