Yuren Feng

Yuren Feng

Auto-generated profile, based on publicly available information

Yuren Feng

School of Information and Communication Engineering, University of Electronic Science and Technology of China, Chengdu, China

Research Focus & Metrics

Academic Career Length

5Years (2022-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
3 July 2023 in IEEE Transactions on Multimedia
Verified
Journal Article
Closed access
JXJie Xu
Jie Xu
XZXiaoqian Zhang
Xiaoqian Zhang
CZChangming Zhao
Changming Zhao
ZGZili Geng
Zili Geng
YFYuren Feng
Yuren Feng
YLYunji Li
Yunji Li
Fine-grained image datasets have small inter-class differences and large intra-class differences, which is a difficulty of the fine-grained image classification. Traditional fine-grained image classification methods only focus on the visual features of images. However, this limitation can be eliminated when these methods are improved with multimodal information. This paper proposes an improved fine-grained image classification method with multimodal information that includes multimodal data preprocessing, multimodal feature extraction, multi-temporal feature fusion and decision correction. The preprocessing method proposed solves the problems of scattered distribution, difficult processing and uneven contribution to prediction of multimodal data through normalization, packing phrases and weighted concatenating methods. When extracting multimodal features, the SAMLP (Self-Attention MLP) module proposed combines self-attention with MLP to capture the internal correlation of multimodal information. The multi-temporal feature fusion proposed is divided into early feature fusion and late feature fusion. The former refers to adding multimodal information markers to the original image, and the latter refers to designing a multi-cascade dynamic MLP structure to fuse visual features and multimodal features. In view of the limitation of feature fusion, a decision strategy is proposed to revise the prediction results of fused features according to the prediction results of multimodal features. Ablation experiment on INAT18-1K and INAT21-1K datasets shows that our method is effective in improving classification with multimodal information. Experiments on the INAT2021_mini large dataset show that the comprehensive method in this paper has higher accuracy and negligible efficiency loss compared with the state-of-the-art method.

4 July 2022
Verified
Book Chapter
Closed access
PDF file
YZYuhang Zhang
Yuhang Zhang
JXJie Xu
Jie Xu
CGChengyi Gao
Chengyi Gao
GSGuanghui Su
Guanghui Su
FYFan Yang
Fan Yang
YFYuren Feng
Yuren Feng