Junjie Huang

Junjie Huang

Auto-generated profile, based on publicly available information

Junjie Huang

Zhejiang University, Zhejiang, China

Research Focus & Metrics

Academic Career Length

4Years (2023-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
26 January 2024
Verified
Conference Paper
Open access
RSRan Shen
Ran Shen
YLYiling Li
Yiling Li
HGHongjie Gu
Hongjie Gu
YWYifan Wang
Yifan Wang
JHJunjie Huang
Junjie Huang
QSQingshun She
Qingshun She
Self-supervised learning representations of speech are successfully employed to language or dialect identification task. It usually adopts a self-supervised pre-trained model as the feature extractor, and adds a classifier to fine-tune on the target datasets. However, training a fine-tuned model from a pre-trained model leads to heavy time and storage cost. In this work, we attempt to build a competent dialect identification system using pre-trained self-supervised speech representations instead of fine-tuned input features. First, we simply fine-tune and compare several pre-trained self-supervised models to select an optimal framework as the speech representations extractor. Then, we introduce Transformers with sparse self-attention mechanism to model both global and local information of those representations. Finally, to further boost the performance, we explore some settings of our proposed method. We conduct experiments on the KeSpeech dataset. Experimental results show that, our method significantly outperforms the best known results, with cost average performance (Cavg) of 0.0911, equal error rate (EER) of 8.53%, and accuracy rate (Acc) of 80.38%. In addition, our proposed method obtains overall relative improvements compared to the fine-tuned one requiring less training time and computation.

12 April 2024
Verified
Conference Paper
Open access
HSHao Shen
Hao Shen
WJWeihao Jiang
Weihao Jiang
JHJunjie Huang
Junjie Huang
Lip reading aims at recognizing what a speaker is saying in a silent video only based on visual information. With the development of deep learning, lip reading has attracted much attention. However, different people have different facial features, which leads to failure when the model is tested on unseen speakers. Most existing methods deal with this problem with fine-tuning or speaker adaptation methods which require the source domain data or the labels of the target domain. However, in real-world applications, due to privacy or storage issues and the difficulty in annotating the data, using these methods is not realistic. To cope with this problem, in this paper, we focus on test-time speaker adaptation for lip reading where the source data and the labels of target data are unavailable during adaptation. We propose a robust entropy minimization strategy to amplify the optimization of high-confident samples and reduce the influence of the low-confident samples. Furthermore, we propose an adaptive pseudo-label strategy to select more confident samples between the outputs from the source model and the augmented-averaged teacher model. Extensive experiments show that our method outperforms all the other baselines consistently, demonstrating its effectiveness and universality.

20 April 2026 in IEEE Access
Verified
Journal Article
Open access
ZWZixiang Wang
Zixiang Wang
XCXin Chen
Xin Chen
JHJiajia Han
Jiajia Han
JCJunyu Cai
Junyu Cai
SWShuangchen Wang
Shuangchen Wang
JHJunjie Huang
Junjie Huang
Image captioning has long been a persistent challenge in the field of vision-language research. With the rise of Large Language Models (LLMs), modern Vision-Language Models (VLMs) can produce effective captions in general-purpose scenarios. However, when confronted with complex power safety violation scenarios, they often omit critical violation details, greatly limiting their reliability in safety supervision. Therefore, we propose CaptionPS, an image-captioning dataset tailored for violation detection. CaptionPS is constructed through a systematic pipeline with multiple rounds of manual annotation. Each sample includes not only the classification of the violation scene and the description of the image content, but also the prediction of the safety of subsequent behaviors, ensuring the safety of workers. Based on CaptionPS, We evaluate a suite of VLMs. Experimental results show that open-source pretrained models generally exhibit low performance. However, after supervised fine-tuning, the overall performance of all models has been significantly improved. Among the evaluated models, InternVL3.5-8B achieves the highest performance on detailed captioning. Meanwhile, InternVL3.5-8B and Llama-3.2-11B achieve the best performance on scene classification and safety prediction tasks, respectively, with accuracy rates reaching 87.32% and 78.51%, which are 48.47% and 45.66% higher than those of the baseline models. The proposed CaptionPS helps MLLMs better learn violation characteristics and improve scene recognition in power scenarios.

1 January 2026 in IEEE Access
Verified
Journal Article
Open access
MYMinsheng Yang
Minsheng Yang
CXCheng Xie
Cheng Xie
SWShuangchen Wang
Shuangchen Wang
JHJunjie Huang
Junjie Huang
XTXu Tan
Xu Tan

1 January 2026 in IEEE Access
Verified
Journal Article
Open access
ZWZixiang Wang
Zixiang Wang
XCXin Chen
Xin Chen
JHJiajia Han
Jiajia Han
JCJunyu Cai
Junyu Cai
SWShuangchen Wang
Shuangchen Wang
JHJunjie Huang
Junjie Huang