Yan Fu

Yan Fu

Auto-generated profile, based on publicly available information

Yan Fu

College of Artificial Intelligence & Computer Science (College of Software), Xi’an University of Science and Technology, Xi’an 710699, China

Research Focus & Metrics

Academic Career Length

11Years (2016-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
14 January 2024 in Electronics
Verified
Journal Article
Open access
PDF file
YFYan Fu
Yan Fu
BYBao Yang
Bao Yang
OYOu Ye
Ou Ye
Video anomaly detection is a critical component of intelligent video surveillance systems, extensively deployed and researched in industry and academia. However, existing methods have a strong generalization ability for predicting anomaly samples. They cannot utilize high-level semantic and temporal contextual information in videos, resulting in unstable prediction performance. To alleviate this issue, we propose an encoder–decoder model named SMAMS, based on spatiotemporal masked autoencoder and memory modules. First, we represent and mask some of the video events using spatiotemporal cubes. Then, the unmasked patches are inputted into the spatiotemporal masked autoencoder to extract high-level semantic and spatiotemporal features of the video events. Next, we add multiple memory modules to store unmasked video patches of different feature layers. Finally, skip connections are introduced to compensate for crucial information loss caused by the memory modules. Experimental results show that the proposed method outperforms state-of-the-art methods, achieving AUC scores of 99.9%, 94.8%, and 78.9% on the UCSD Ped2, CUHK Avenue, and Shanghai Tech datasets.

16 December 2016 in Algorithms
Verified
Journal Article
Open access
PDF file
YFYan Fu
Yan Fu
SWShengchun Wang
Shengchun Wang
Nowadays, how to evaluate image quality reasonably is a basic and challenging problem. In view of the present no reference evaluation methods, they cannot reflect the human visual perception of image quality accurately. In this paper, we propose an efficient general-purpose no reference image quality assessment (NRIQA) method based on visual perception, and effectively integrates human visual characteristics into the NRIQA fields. First, a novel algorithm for salient region extraction is presented. Two characteristics graphs of texture and edging of the original image are added to the Itti model. Due to the normalized luminance coefficients of natural images obey the generalized Gauss probability distribution, we utilize this characteristic to extract statistical features in the regions of interest (ROI) and regions of non-interest respectively. Then, the extracted features are fused to be an input to establish the support vector regression (SVR) model. Finally, the IQA model obtained by training is used to predict the quality of the image. Experimental results show that this method has good predictive ability, and the evaluation effect is better than existing classical algorithms. Moreover, the predicted results are more consistent with human subjective perception, which can accurately reflect the human visual perception to image quality.

17 April 2024 in Electronics
Verified
Journal Article
Open access
PDF file
YQYi Qin
Yi Qin
OYOu Ye
Ou Ye
YFYan Fu
Yan Fu
In recent decades, with the ever-growing scale of video data, near-duplicate videos continue to emerge. Data quality issues caused by near-duplicate videos are becoming more and more prominent, which has affected the application of normal videos. Although current studies on near-duplicate video detection can help uncover data quality issues for videos, they still lack a process of automatic merging for the video data represented by high-dimensional features, which makes it difficult to automatically clean the near-duplicate videos to improve data quality for video datasets. At present, there are few studies on near-duplicate video data cleaning. The existing studies have the sensitive problems of video data orderliness and initial clustering centers under a condition that prior distribution is unknown, which seriously affects the accuracy of near-duplicate video data cleaning. To address the above issues, an automatic near-duplicate video data cleaning method based on a consistent feature hash ring is proposed in this paper. First, a residual network with convolutional block attention modules, a long short-term memory deep network, and an attention model are integrated to construct an RCLA deep network with the multi-head attention mechanism to extract spatiotemporal features of video data. Then, a consistent feature hash ring is constructed, which can effectively alleviate the sensitivity of video data orderliness while providing a condition of near-duplicate video merging. To reduce the sensitivity of the initial cluster centers to the results of near-duplicate video cleansing, an optimized feature distance-means clustering algorithm is constructed by utilizing a mountain peak function on a consistent feature hash ring, which can implement automatic cleaning of near-duplicate video data. Finally, experiments are conducted based on a commonly used dataset named CC_WEB_VIDEO and a coal mining video dataset. Compared with some existing studies, simulation results demonstrate the performance of the proposed method.

25 February 2025 in Electronics
Verified
Journal Article
Open access
PDF file
YFYan Fu
Yan Fu
YYYing Yang
Ying Yang
OYOu Ye
Ou Ye
To address the issue in encoder–decoder-based video captioning method where semantic topics are overlooked in guiding the video captioning, leading to a semantic mismatch between video content and generated captions, a video captioning method based on semantic topic association is proposed. The core of this method lies in the designed semantic topic module, which is capable of capturing more detailed topic information on objects and actions in videos, and establishing a bridge between video representations and semantic topics, thereby selectively guiding the generation of video descriptions. During the decoding phase, an optimized NGPT kernel sampling decoding strategy is employed, constructing an NGPT model based on Top-P kernel sampling to jointly decode semantic information and generate captions. This model fully leverages the topic information in the video, narrowing the “semantic gap”, mitigating redundancy issues during decoding, and making the generated text descriptions that are more aligned with the topic content of the video. Ultimately, experiments were carried out using two publicly accessible datasets: MSVD and MSR-VTT. The findings reveal that our proposed approach surpasses several leading methods, achieving enhancements of 5.3% in BLEU4, 3.1% in METEOR, 2.4% in ROUGE_L, and 13.1% in CIDEr on the MSVD dataset, as well as improvements of 0.9%, 0.4%, 1.5%, and 3.3%, respectively, on the MSR-VTT dataset. Therefore, the video captioning method based on semantic topic association can extract more topic information, thereby improving the effectiveness of video caption generation.

13 January 2026 in Electronics
Verified
Journal Article
Open access
PDF file
YFYan Fu
Yan Fu
GYGaolin Ye
Gaolin Ye
OYOu Ye
Ou Ye
THTing Hou
Ting Hou
RDRuimin Dai
Ruimin Dai
Recent advancements in large language models (LLMs) have significantly improved text-to-image (T2I) generation, enabling systems to produce visually compelling and semantically meaningful images. However, preserving fine-grained semantic consistency in generated images, particularly in response to complex and region-specific textual prompts, remains a key challenge. In this work, we propose a context-aware hierarchical agent mechanism that integrates a semantic condensation strategy to enhance attention efficiency and maintain critical visual-textual alignment. By dynamically fusing contextual information, the method effectively balances computational efficiency and ensures semantic alignment with textual descriptions. Experimental results demonstrate improved visual coherence and semantic consistency across diverse prompts, validated through quantitative metrics and qualitative analysis. Our contributions include: (i) introducing a novel semantic condensation strategy that enhances attention efficiency while preserving critical feature information; (ii) developing a new hierarchical agent attention mechanism to enhance computation efficiency; (iii) designing an iterative feedback method based on CLIP Score to improve image diversity and overall quality.

26 May 2017 in Algorithms
Verified
Journal Article
Open access
PDF file
YFYan Fu
Yan Fu
SWShengchun Wang
Shengchun Wang
We would like to make the following change to our article [1].