Yiqing Huang

Yiqing Huang

Auto-generated profile, based on publicly available information

Yiqing Huang

Faculty of Innovation Engineering, Macau University of Science and Technology, Taipa, China

Research Focus & Metrics

Academic Career Length

3Years (2024-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
19 March 2025 in IEEE Transactions on Circuits and Systems for Video Technology
Verified
Journal Article
Open access
ZCZhigang Chen
Zhigang Chen
BENJIA ZHOUBENJIA ZHOU
BENJIA ZHOU
YHYiqing Huang
Yiqing Huang
JWJun Wan
Jun Wan
YHYibo Hu
Yibo Hu
DZDu Zhang
Du Zhang
Sign Language Representation Learning (SLRL) is crucial for a range of sign language-related downstream tasks such as Sign Language Translation (SLT) and Sign Language Retrieval (SLRet). Recently, many gloss-based and gloss-free SLRL methods have been proposed, showing promising performance. Among them, the gloss-free approach shows promise for strong scalability without relying on gloss annotations. However, it currently faces suboptimal solutions due to challenges in encoding the intricate, context-sensitive characteristics of sign language videos, mainly struggling to discern essential sign features using a non-monotonic video-text alignment strategy. Therefore, we introduce an innovative pretraining paradigm for gloss-free SLRL, called C2RL, in this paper. Specifically, rather than merely incorporating a non-monotonic semantic alignment of video and text to learn language-oriented sign features, we emphasize two pivotal aspects of SLRL: Implicit Content Learning (ICL) and Explicit Context Learning (ECL). ICL delves into the content of communication, capturing the nuances, emphasis, timing, and rhythm of the signs. In contrast, ECL focuses on understanding the contextual meaning of signs and converting them into equivalent sentences. Despite its simplicity, extensive experiments confirm that the joint optimization of ICL and ECL results in robust sign language representation and significant performance gains in gloss-free SLT and SLRet tasks. Notably, C2RL improves the BLEU-4 score by +5.3 on P14T, +10.6 on CSL-daily, +6.2 on OpenASL, and +1.3 on How2Sign. It also boosts the R@1 score by +8.3 on P14T, +14.4 on CSL-daily, and +5.9 on How2Sign. Additionally, we set a new baseline for the OpenASL dataset in the SLRet task.

25 December 2024 in IEEE Transactions on Multimedia
Verified
Journal Article
Closed access
THTianshun Han
Tianshun Han
SGShengnan Gui
Shengnan Gui
YHYiqing Huang
Yiqing Huang
BLBaihui Li
Baihui Li
LLLijian Liu
Lijian Liu
JWJun Wan
Jun Wan
Speech-driven 3D facial animation has improved a lot recently while most related works only utilize acoustic modality and neglect the influence of visual and textual cues, leading to unsatisfactory results in terms of precision and coherence. We argue that visual and textual cues are not trivial information. Therefore, we present a novel framework, namely PMMTalk, using complementary P seudo M ulti- M odal features for improving the accuracy of facial animation. The framework entails three modules: PMMTalk encoder, cross-modal alignment module, and PMMTalk decoder. Specifically, the PMMTalk encoder employs the off-the-shelf talking head generation architecture and speech recognition technology to extract visual and textual information from speech, respectively. Following this, the cross-modal alignment module aligns the audio-image-text features at temporal and semantic levels. Subsequently, the PMMTalk decoder is employed to predict lip-syncing facial blendshape coefficients. Contrary to prior methods, PMMTalk only requires an additional random reference face image but yields more accurate results. Additionally, it is artist-friendly as it seamlessly integrates into standard animation production workflows by introducing facial blendshape coefficients. Finally, given the scarcity of 3D talking face datasets, we introduce a large-scale 3D C hinese A udio- V isual F acial A nimation (3D-CAVFA) dataset. Extensive experiments and user studies show that our approach outperforms the state of the art. Codes and datasets are available at PMMTalk.

19 August 2025 in IEEE Journal of Oceanic Engineering
Verified
Journal Article
Closed access
YHYiqing Huang
Yiqing Huang
THTianshun Han
Tianshun Han
HZHaoru Zhao
Haoru Zhao
YLYanyan Liang
Yanyan Liang
JWJun Wan
Jun Wan
HZHaiyong Zheng
Haiyong Zheng
Marine snow causes light spots and veil-like blurs in underwater images due to scattering and degrades their quality. Therefore, removing this type of noise from underwater images is necessary. However, the lack of valid and diverse marine snow image data sets has impeded the development of machine learning-based algorithms. To tackle this issue, we propose a pipeline named OmniMSI for generating marine snow images. This pipeline takes into account the diverse morphologies of marine snow particles and their natural distribution patterns. Specifically, OmniMSI initiates from collecting large-scale marine snow particle images in natural environments, classifying them by morphology, analyzing their distribution patterns, and thus creating diverse marine snow masks. The pipeline then overlays the masks on real-world underwater images without marine snow and employs the designed post-process to synthesize marine snow images. Leveraging this pipeline, we create a Multi-morphology and Multidistribution Marine Snow image Dataset (MM-MSD), including 6000 pairs of marine snow images and corresponding reference images. We also present a novel marine snow removal method—marine snow-aware diffusion, which can accurately estimate the location of marine snow in images and remove it progressively. Based on MM-MSD, we conduct a comprehensive study of the state-of-the-art algorithms qualitatively and quantitatively, developing a new benchmark for marine snow removal. The benchmark evaluations demonstrate the performance and shortcomings of existing algorithms, paving the way for further research in marine snow removal. The data set and code will be released.