Peng Zhai

Peng Zhai

orcid

Research Focus & Metrics

Academic Career Length

6Years (2021-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
10 March 2021 in Nature
Verified
Journal Article
Closed access
PDF file
XSXiang Shi
Xiang Shi
YZYong Zuo
Yong Zuo
PZPeng Zhai
Peng Zhai
JSJiahao Shen
Jiahao Shen
YYYangyiwei Yang
Yangyiwei Yang
HPHuisheng Peng
Huisheng Peng

1 March 2024 in Nature Protocols
Verified
Journal Article
Closed access
PDF file
KZKailin Zhang
Kailin Zhang
XSXiang Shi
Xiang Shi
HJHaibo Jiang
Haibo Jiang
KZKaiwen Zeng
Kaiwen Zeng
ZZZihao Zhou
Zihao Zhou
HPHuisheng Peng
Huisheng Peng

5 November 2024
Verified
Book Chapter
Closed access
PDF file
DYDingkang Yang
Dingkang Yang
MLMingcheng Li
Mingcheng Li
DXDongling Xiao
Dongling Xiao
YLYang Liu
Yang Liu
KYKun Yang
Kun Yang
LZLihua Zhang
Lihua Zhang

29 July 2024 in IEEE Transactions on Circuits and Systems for Video Technology
Verified
Journal Article
Closed access
DYDingkang Yang
Dingkang Yang
MLMingcheng Li
Mingcheng Li
LQLinhao Qu
Linhao Qu
KYKun Yang
Kun Yang
PZPeng Zhai
Peng Zhai
LZLihua Zhang
Lihua Zhang
Understanding human intentions ( e.g ., emotions) from videos has received considerable attention recently. Video streams generally constitute a blend of temporal data stemming from distinct modalities, including natural language, facial expressions, and auditory clues. Despite the impressive advancements of previous works via attention-based paradigms, the inherent temporal asynchrony and modality heterogeneity challenges remain in multimodal sequence fusion, causing adverse performance bottlenecks. To tackle these issues, we propose a Multimodal fusion approach for learning modality-Exclusive and modality-Agnostic representations (MEA) to refine multimodal features and leverage the complementarity across distinct modalities. On the one hand, MEA introduces a predictive self-attention module to capture reliable context dynamics within modalities and reinforce unique features over the modality-exclusive spaces. On the other hand, a hierarchical cross-modal attention module is designed to explore valuable element correlations among modalities over the modality-agnostic space. Meanwhile, a double-discriminator strategy is presented to ensure the production of distinct representations in an adversarial manner. Eventually, we propose a decoupled graph fusion mechanism to enhance knowledge exchange across heterogeneous modalities and learn robust multimodal representations for downstream tasks. Numerous experiments are implemented on three multimodal datasets with asynchronous sequences. Systematic analyses show the necessity of our approach.

10 May 2023 in Mathematics
Verified
Journal Article
Open access
PDF file
WLWeifan Long
Weifan Long
THTaixian Hou
Taixian Hou
XWXiaoyi Wei
Xiaoyi Wei
SYShichao Yan
Shichao Yan
PZPeng Zhai
Peng Zhai
LZLihua Zhang
Lihua Zhang
Many real-world applications can be described as large-scale games of imperfect information, which require extensive prior domain knowledge, especially in competitive or human–AI cooperation settings. Population-based training methods have become a popular solution to learn robust policies without any prior knowledge, which can generalize to policies of other players or humans. In this survey, we shed light on population-based deep reinforcement learning (PB-DRL) algorithms, their applications, and general frameworks. We introduce several independent subject areas, including naive self-play, fictitious self-play, population-play, evolution-based training methods, and the policy-space response oracle family. These methods provide a variety of approaches to solving multi-agent problems and are useful in designing robust multi-agent reinforcement learning algorithms that can handle complex real-life situations. Finally, we discuss challenges and hot topics in PB-DRL algorithms. We hope that this brief survey can provide guidance and insights for researchers interested in PB-DRL algorithms.

22 December 2023 in IEEE Signal Processing Letters
Verified
Journal Article
Closed access
SWShunli Wang
Shunli Wang
DYDingkang Yang
Dingkang Yang
PZPeng Zhai
Peng Zhai
LZLihua Zhang
Lihua Zhang
The expensive cost of the medical skill training paradigm hinders the development of medical education, which has attracted widespread attention in the intelligent signal processing community. To address the issue of composite error action recognition in Cardiopulmonary Resuscitation (CPR) training, this letter proposes a multimodal pre-training framework named CPR-CLIP based on prompt engineering. Specifically, we design three prompts to fuse multiple errors naturally on the semantic level and then align linguistic and visual features via the contrastive pre-training loss. Extensive experiments verify the effectiveness of the CPR-CLIP. Ultimately, the CPR-CLIP is encapsulated to an electronic assistant, and four doctors are recruited for evaluation. Nearly four times efficiency improvement is observed in comparative experiments, which demonstrates the practicality of the system. We hope this work brings new insights to the intelligent medical skill training and signal processing communities simultaneously. Code is available on https://github.com/Shunli-Wang/CPR-CLIP .