Fernando Rendón Segador

Dr. Fernando Rendón Segador

University of Sevilla
orcid

Research Focus & Metrics

Academic Career Length

6Years (2021-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
3 July 2021 in Electronics
Verified
Journal Article
Open access
PDF file
FSFernando Rendón Segador
Fernando Rendón Segador
Juan Antonio Alvarez-GarciaJuan Antonio Alvarez-Garcia
Juan Antonio Alvarez-Garcia
FRFernando Enriquez de Salamanca Ros
Fernando Enriquez de Salamanca Ros
Oscar Deniz SuarezOscar Deniz Suarez
Oscar Deniz Suarez
Introducing efficient automatic violence detection in video surveillance or audiovisual content monitoring systems would greatly facilitate the work of closed-circuit television (CCTV) operators, rating agencies or those in charge of monitoring social network content. In this paper we present a new deep learning architecture, using an adapted version of DenseNet for three dimensions, a multi-head self-attention layer and a bidirectional convolutional long short-term memory (LSTM) module, that allows encoding relevant spatio-temporal features, to determine whether a video is violent or not. Furthermore, an ablation study of the input frames, comparing dense optical flow and adjacent frames subtraction and the influence of the attention layer is carried out, showing that the combination of optical flow and the attention mechanism improves results up to 4.4%. The conducted experiments using four of the most widely used datasets for this problem, matching or exceeding in some cases the results of the state of the art, reducing the number of network parameters needed (4.5 millions), and increasing its efficiency in test accuracy (from 95.6% on the most complex dataset to 100% on the simplest one) and inference time (less than 0.3 s for the longest clips). Finally, to check if the generated model is able to generalize violence, a cross-dataset analysis is performed, which shows the complexity of this approach: using three datasets to train and testing on the remaining one the accuracy drops in the worst case to 70.08% and in the best case to 81.51%, which points to future work oriented towards anomaly detection in new datasets.

2 February 2023 in Neural Networks
Verified
Journal Article
Open access
FSFernando Rendón Segador
Fernando Rendón Segador
Juan Antonio Alvarez-GarciaJuan Antonio Alvarez-Garcia
Juan Antonio Alvarez-Garcia
JSJose L. Salazar-González
Jose L. Salazar-González
TTTatiana Tommasi
Tatiana Tommasi
The state of the art in violence detection in videos has improved in recent years thanks to deep learning models, but it is still below 90% of average precision in the most complex datasets, which may pose a problem of frequent false alarms in video surveillance environments and may cause security guards to disable the artificial intelligence system. In this study, we propose a new neural network based on Vision Transformer (ViT) and Neural Structured Learning (NSL) with adversarial training. This network, called CrimeNet, outperforms previous works by a large margin and reduces practically to zero the false positives. Our tests on the four most challenging violence-related datasets (binary and multi-class) show the effectiveness of CrimeNet, improving the state of the art from 9.4 to 22.17 percentage points in ROC AUC depending on the dataset. In addition, we present a generalisation study on our model by training and testing it on different datasets. The obtained results show that CrimeNet improves over competing methods with a gain of between 12.39 and 25.22 percentage points, showing remarkable robustness.

22 August 2024 in Sensors
Verified
Journal Article
Open access
PDF file
FSFernando Rendón Segador
Fernando Rendón Segador
Juan Antonio Alvarez-GarciaJuan Antonio Alvarez-Garcia
Juan Antonio Alvarez-Garcia
LMLuis Miguel Soria Morillo
Luis Miguel Soria Morillo
This paper presents a comprehensive approach to detect violent events in videos by combining CrimeNet, a Vision Transformer (ViT) model with structured neural learning and adversarial regularization, with an adaptive threshold sliding window model based on the Transformer architecture. CrimeNet demonstrates exceptional performance on all datasets (XD-Violence, UCF-Crime, NTU-CCTV Fights, UBI-Fights, Real Life Violence Situations, MediEval, RWF-2000, Hockey Fights, Violent Flows, Surveillance Camera Fights, and Movies Fight), achieving high AUC ROC and AUC PR values (up to 99% and 100%, respectively). However, the generalization of CrimeNet to cross-dataset experiments posed some problems, resulting in a 20–30% decrease in performance, for instance, training in UCF-Crime and testing in XD-Violence resulted in 70.20% in AUC ROC. The sliding window model with adaptive thresholding effectively solves these problems by automatically adjusting the violence detection threshold, resulting in a substantial improvement in detection accuracy. By applying the sliding window model as post-processing to CrimeNet results, we were able to improve detection accuracy by 10% to 15% in cross-dataset experiments. Future lines of research include improving generalization, addressing data imbalance, exploring multimodal representations, testing in real-world applications, and extending the approach to complex human interactions.

26 August 2023 in Neural Networks
Verified
Journal Article
Closed access
JGJose L. Salazar González
Jose L. Salazar González
Juan Antonio Alvarez-GarciaJuan Antonio Alvarez-Garcia
Juan Antonio Alvarez-Garcia
FSFernando Rendón Segador
Fernando Rendón Segador
FCFabio Carrara
Fabio Carrara