Zi Wang

Zi Wang

Auto-generated profile, based on publicly available information

Zi Wang

NVIDIA

Research Focus & Metrics

Academic Career Length

3Years (2024-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
1 March 2024 in IEEE Transactions on Intelligent Vehicles
Verified
Journal Article
Closed access
SRShunli Ren
Shunli Ren
ZLZixing Lei
Zixing Lei
ZWZi Wang
Zi Wang
MDMehrdad Dianati
Mehrdad Dianati
Yafei WangYafei Wang
Yafei Wang
WZWenjun Zhang
Wenjun Zhang
Cooperative perception can significantly improve the perception performance of autonomous vehicles beyond the limited perception ability of individual vehicles by exchanging information with neighbor agents through V2X communication. However, most existing work assume ideal communication among agents, ignoring the significant and common interruption issues caused by imperfect V2X communication, where cooperation agents can not receive cooperative messages successfully and thus fail to achieve cooperative perception, leading to safety risks. To fully reap the benefits of cooperative perception in practice, we propose V2X communication INterruption-aware COoperative Perception (V2X-INCOP), a cooperative perception system robust to communication interruption for V2X communication-aided autonomous driving, which leverages historical cooperation information to recover missing information due to the interruptions and alleviate the impact of the interruption issue. To achieve comprehensive recovery, we design a communication-adaptive multi-scale spatial-temporal prediction model to extract multi-scale spatial-temporal features based on V2X communication conditions and capture the most significant information for the prediction of the missing information. To further improve recovery performance, we adopt a knowledge distillation framework to give explicit and direct supervision to the prediction model and a curriculum learning strategy to stabilize the training of the model. Experiments on three public cooperative perception datasets demonstrate that the proposed method is effective in alleviating the impacts of communication interruption on cooperative perception. V2X-INCOP outperforms state-of-the-art cooperative perception methods and has a cooperative perception gain up to 14.06%, 13.9%, and 12.07% over individual perception on average of different packet drop rates on OPV2V, V2X-Sim, and Dair-V2X datasets, respectively.

7 August 2024 in Visual Intelligence
Verified
Journal Article
Open access
PDF file
Yichao YanYichao Yan
Yichao Yan
ZZZanwei Zhou
Zanwei Zhou
ZWZi Wang
Zi Wang
JGJingnan Gao
Jingnan Gao
XYXiaokang Yang
Xiaokang Yang
Conversation is an essential component of virtual avatar activities in the metaverse. With the development of natural language processing, significant breakthroughs have been made in text and voice conversation generation. However, face-to-face conversations account for the vast majority of daily conversations, while most existing methods focused on single-person talking head generation. In this work, we take a step further and consider generating realistic face-to-face conversation videos. Conversation generation is more challenging than single-person talking head generation, because it requires not only the generation of photo-realistic individual talking heads, but also the listener’s response to the speaker. In this paper, we propose a novel unified framework based on the neural radiance field (NeRF) to address these challenges. Specifically, we model both the speaker and the listener with a NeRF framework under different conditions to control individual expressions. The speaker is driven by the audio signal, while the response of the listener depends on both visual and acoustic information. In this way, face-to-face conversation videos are generated between human avatars, with all the interlocutors modeled within the same network. Moreover, to facilitate future research on this task, we also collected a new human conversation dataset containing 34 video clips. Quantitative and qualitative experiments evaluate our method in different aspects, e.g., image quality, pose sequence trend, and natural rendering of the scene in the generated videos. Experimental results demonstrate that the avatars in the resulting videos are able to carry on a realistic conversation, and maintain individual styles.

28 February 2024 in arXiv
Verified
Preprint
Open access
PDF file
SRShunli Ren
Shunli Ren
ZLZixing Lei
Zixing Lei
ZWZi Wang
Zi Wang
MDMehrdad Dianati
Mehrdad Dianati
Yafei WangYafei Wang
Yafei Wang
WZWenjun Zhang
Wenjun Zhang
Cooperative perception can significantly improve the perception performance of autonomous vehicles beyond the limited perception ability of individual vehicles by exchanging information with neighbor agents through V2X communication. However, most existing work assume ideal communication among agents, ignoring the significant and common \textit{interruption issues} caused by imperfect V2X communication, where cooperation agents can not receive cooperative messages successfully and thus fail to achieve cooperative perception, leading to safety risks. To fully reap the benefits of cooperative perception in practice, we propose V2X communication INterruption-aware COoperative Perception (V2X-INCOP), a cooperative perception system robust to communication interruption for V2X communication-aided autonomous driving, which leverages historical cooperation information to recover missing information due to the interruptions and alleviate the impact of the interruption issue. To achieve comprehensive recovery, we design a communication-adaptive multi-scale spatial-temporal prediction model to extract multi-scale spatial-temporal features based on V2X communication conditions and capture the most significant information for the prediction of the missing information. To further improve recovery performance, we adopt a knowledge distillation framework to give explicit and direct supervision to the prediction model and a curriculum learning strategy to stabilize the training of the model. Experiments on three public cooperative perception datasets demonstrate that the proposed method is effective in alleviating the impacts of communication interruption on cooperative perception.

1 October 2026
Verified
Book Chapter
Closed access
PDF file
WYWenhao Yao
Wenhao Yao
XSXinglong Sun
Xinglong Sun
ZLZhenxin Li
Zhenxin Li
SLShiyi Lan
Shiyi Lan
ZWZi Wang
Zi Wang
ZWZuxuan Wu
Zuxuan Wu

10 September 2026
Verified
Book Chapter
Closed access
PDF file
ZLZhenxin Li
Zhenxin Li
NCNadine Chang
Nadine Chang
WYWenhao Yao
Wenhao Yao
XSXinglong Sun
Xinglong Sun
ZWZi Wang
Zi Wang
JAJose M. Alvarez
Jose M. Alvarez