Zanwei Zhou

Zanwei Zhou

Auto-generated profile, based on publicly available information

Zanwei Zhou

MoE Key Lab of Artificial Intelligence, AI Institute, Shanghai Jiao Tong University, Shanghai, China

Research Focus & Metrics

Academic Career Length

5Years (2022-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
9 April 2025 in International Journal of Computer Vision
Verified
Journal Article
Closed access
PDF file
JCJiazhong Cen
Jiazhong Cen
JFJiemin Fang
Jiemin Fang
ZZZanwei Zhou
Zanwei Zhou
CYChen Yang
Chen Yang
LXLingxi Xie
Lingxi Xie
QTQi Tian
Qi Tian

7 August 2024 in Visual Intelligence
Verified
Journal Article
Open access
PDF file
Yichao YanYichao Yan
Yichao Yan
ZZZanwei Zhou
Zanwei Zhou
ZWZi Wang
Zi Wang
JGJingnan Gao
Jingnan Gao
XYXiaokang Yang
Xiaokang Yang
Conversation is an essential component of virtual avatar activities in the metaverse. With the development of natural language processing, significant breakthroughs have been made in text and voice conversation generation. However, face-to-face conversations account for the vast majority of daily conversations, while most existing methods focused on single-person talking head generation. In this work, we take a step further and consider generating realistic face-to-face conversation videos. Conversation generation is more challenging than single-person talking head generation, because it requires not only the generation of photo-realistic individual talking heads, but also the listener’s response to the speaker. In this paper, we propose a novel unified framework based on the neural radiance field (NeRF) to address these challenges. Specifically, we model both the speaker and the listener with a NeRF framework under different conditions to control individual expressions. The speaker is driven by the audio signal, while the response of the listener depends on both visual and acoustic information. In this way, face-to-face conversation videos are generated between human avatars, with all the interlocutors modeled within the same network. Moreover, to facilitate future research on this task, we also collected a new human conversation dataset containing 34 video clips. Quantitative and qualitative experiments evaluate our method in different aspects, e.g., image quality, pose sequence trend, and natural rendering of the scene in the generated videos. Experimental results demonstrate that the avatars in the resulting videos are able to carry on a realistic conversation, and maintain individual styles.

14 July 2022 in IEEE Transactions on Circuits and Systems for Video Technology
Verified
Journal Article
Closed access
CYChen Yang
Chen Yang
SYShun-Yu Yao
Shun-Yu Yao
ZZZan-Wei Zhou
Zan-Wei Zhou
Bin JiBin Ji
Bin Ji
GZGuangtao Zhai
Guangtao Zhai
WSWei Shen
Wei Shen
Human pose imitation, which aims to generate an image with a source character’s appearance, the source character’s shape, and a target character’s posture, has many potential applications in virtual reality, augmented reality, games, movies, etc. It is incredibly challenging due to non-rigid human body motions, significant variations in clothing textures, and self-occluded human bodies in 2D images. In this paper, we propose Poxture, a novel human posture imitation method with neural texture, to address the challenges mentioned above. Concretely, first, we build a dense mapping between a source SMPL human body model (shape and posture) and its corresponding texture (appearance). Then, we apply a neural texture generator to recover the complete texture of the source character. At last, we wrap the source neural texture to the source SMLP model with a target pose to generate the desired image by a GAN model. Poxture does not require any annotations, and our framework can fully disentangle the source character’s appearance, shape, and pose, which enjoys several advantages: 1) It can synthesize high-resolution images with detailed textures, thanks to the learned neural textures containing both visible and invisible parts and high-frequency information; 2) It can imitate complex actions with various appearances and body figures since the complete texture of the source character is acquired. We compare our method with previous methods, showing state-of-the-art results on two challenging benchmarks. Extensive experiments demonstrate that, given any character, our method can manipulate this avatar imitating arbitrary posture.

21 September 2025
Verified
Book Chapter
Closed access
PDF file
ZZZanwei Zhou
Zanwei Zhou
CYChen Yang
Chen Yang
PYPiao Yang
Piao Yang
XYXiaokang Yang
Xiaokang Yang
WSWei Shen
Wei Shen