Yujie Zheng

Yujie Zheng

Auto-generated profile, based on publicly available information

Yujie Zheng

Faculty of Electrical Engineering and Computer Science, Ningbo University, Ningbo, China

Research Focus & Metrics

Academic Career Length

4Years (2023-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
24 September 2024 in IEEE Transactions on Image Processing
Verified
Journal Article
Closed access
YZYujie Zheng
Yujie Zheng
CWChong Wang
Chong Wang
CTChenchen Tao
Chenchen Tao
SLSunqi Lin
Sunqi Lin
JQJiangbo Qian
Jiangbo Qian
JWJiafei Wu
Jiafei Wu
Knowledge distillation aims to achieve model compression by transferring knowledge from complex teacher models to lightweight student models. To reduce reliance on pre-trained teacher models, self-distillation methods utilize knowledge from the model itself as additional supervision. However, their performance is limited by the same or similar network architecture between the teacher and student. In order to increase architecture variety, we propose a new self-distillation framework called restructured self-distillation (RSD), which involves restructuring both the teacher and student networks. The self-distilled model is expanded into a multi-branch topology to create a more powerful teacher. During training, diverse student sub-networks are generated by randomly discarding the teacher’s branches. Additionally, the teacher and student models are linked by a randomly inserted feature mixture block, introducing additional knowledge distillation in the mixed feature space. To avoid extra inference costs, the branches of the teacher model are then converted back to its original structure equivalently. Comprehensive experiments have demonstrated the effectiveness of our proposed framework for most architectures on CIFAR-10/100 and ImageNet datasets. Code is available at https://github.com/YujieZheng99/RSD.

12 October 2023 in IEEE Signal Processing Letters
Verified
Journal Article
Closed access
YGYiling Gong
Yiling Gong
SLSihui Luo
Sihui Luo
CWChong Wang
Chong Wang
YZYujie Zheng
Yujie Zheng
Recent research into video anomaly detection under weakly supervised settings has made significant progress in identifying anomalies with only coarse-grained annotations. Mainstream weakly supervised methods improve detection performance by generating high-quality pseudo labels for video segments. However, these pseudo-label-based methods have been ordinarily hindered by manually-set constraint rules as the bottleneck. In this paper, we propose the Feature Differentiation Reconstruction Network (FDR-Net), which no longer relies on pseudo labels and instead uses a differential reconstruction strategy to improve the discriminability of the representation. Concretely, video features are first randomly masked out and then reconstructed with distinct targets for normal and abnormal videos during the differential reconstruction process. Besides, we also introduce a dense transformer-based encoder to refine spatial-temporal relationships among video segments. Comprehensive experiments on ShanghaiTech demonstrate the superior performance of our model.

9 December 2024 in Signal, Image and Video Processing
Verified
Journal Article
Closed access
PDF file
WCWeiwei Chen
Weiwei Chen
JXJiazhen Xu
Jiazhen Xu
YZYujie Zheng
Yujie Zheng
CWChong Wang
Chong Wang