Peng Wu

Peng Wu

Auto-generated profile, based on publicly available information

Peng Wu

Shandong University

Research Focus & Metrics

Academic Career Length

5Years (2022-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
26 October 2023
Verified
Conference Paper
Open access
PWPeng Wu
Peng Wu
Xiankai LuXiankai Lu
Xiankai Lu
JSJianbing Shen
Jianbing Shen
YYYilong Yin
Yilong Yin
Human mesh reconstruction (HMR) from monocular video is the key step to many mixed reality and robotic applications. Although existing methods show promising results by capturing frames' temporal information, these methods predict human mesh with the design of implicit temporal learning modules in a sequence to frame manner. To mine more temporal information from the video, we present a bi-level clip inference network for HMR, which leverages both local motion and global context explicitly for dense 3D reconstruction. Specifically, we propose a novel bi-level temporal fusion strategy that takes both neighboring and long-range relations into consideration. In addition, different from traditional frame-wise operation, we investigate an alternative perspective by treating video-based HMR as clip-wise inference. We evaluate the proposed method on multiple datasets (3DPW, Human3.6M, and MPI-INF-3DHP) quantitatively and qualitatively, demonstrating a significant improvement over existing methods (in terms of PA-MPJPE, ACC-Error etc). Furthermore, we extend the proposed method on more challenging Multiple Shots HMR task to demonstrate its generalizability. Some visual demos can be seen https://github.com/bicf0/bicf_demo.

2 December 2024
Verified
Book Chapter
Closed access
PDF file
HFHao Fang
Hao Fang
PWPeng Wu
Peng Wu
YLYawei Li
Yawei Li
XZXinxin Zhang
Xinxin Zhang
Xiankai LuXiankai Lu
Xiankai Lu

27 July 2022 in IEEE Transactions on Image Processing
Verified
Journal Article
Closed access
JZJichao Zhang
Jichao Zhang
JCJingjing Chen
Jingjing Chen
HTHao Tang
Hao Tang
ESEnver Sangineto
Enver Sangineto
PWPeng Wu
Peng Wu
WWWei Wang
Wei Wang
This paper proposes a gaze correction and animation method for high-resolution, unconstrained portrait images, which can be trained without the gaze angle and the head pose annotations. Common gaze-correction methods usually require annotating training data with precise gaze, and head pose information. Solving this problem using an unsupervised method remains an open problem, especially for high-resolution face images in the wild, which are not easy to annotate with gaze and head pose labels. To address this issue, we first create two new portrait datasets: CelebGaze ( $256 \times 256$ ) and high-resolution CelebHQGaze ( $512 \times 512$ ). Second, we formulate the gaze correction task as an image inpainting problem, addressed using a Gaze Correction Module (GCM) and a Gaze Animation Module (GAM). Moreover, we propose an unsupervised training strategy, i.e., Synthesis-As-Training, to learn the correlation between the eye region features and the gaze angle. As a result, we can use the learned latent space for gaze animation with semantic interpolation in this space. Moreover, to alleviate both the memory and the computational costs in the training and the inference stage, we propose a Coarse-to-Fine Module (CFM) integrated with GCM and GAM. Extensive experiments validate the effectiveness of our method for both the gaze correction and the gaze animation tasks in both low and high-resolution face datasets in the wild and demonstrate the superiority of our method with respect to the state of the art.

3 April 2022 in Biochemical and Biophysical Research Communications
Verified
Journal Article
Closed access
YWYanfei Wang
Yanfei Wang
WLWei Li
Wei Li
CZCuiqiao Zhang
Cuiqiao Zhang
WPWu Peng
Wu Peng
ZXZhigang Xu
Zhigang Xu

12 July 2024 in arXiv
Verified
Preprint
Open access
PDF file
HFHao Fang
Hao Fang
PWPeng Wu
Peng Wu
YLYawei Li
Yawei Li
XZXinxin Zhang
Xinxin Zhang
Xiankai LuXiankai Lu
Xiankai Lu
Open-Vocabulary Video Instance Segmentation (VIS) is attracting increasing attention due to its ability to segment and track arbitrary objects. However, the recent Open-Vocabulary VIS attempts obtained unsatisfactory results, especially in terms of generalization ability of novel categories. We discover that the domain gap between the VLM features (e.g., CLIP) and the instance queries and the underutilization of temporal consistency are two central causes. To mitigate these issues, we design and train a novel Open-Vocabulary VIS baseline called OVFormer. OVFormer utilizes a lightweight module for unified embedding alignment between query embeddings and CLIP image embeddings to remedy the domain gap. Unlike previous image-based training methods, we conduct video-based model training and deploy a semi-online inference scheme to fully mine the temporal consistency in the video. Without bells and whistles, OVFormer achieves 21.9 mAP with a ResNet-50 backbone on LV-VIS, exceeding the previous state-of-the-art performance by 7.7. Extensive experiments on some Close-Vocabulary VIS datasets also demonstrate the strong zero-shot generalization ability of OVFormer (+ 7.6 mAP on YouTube-VIS 2019, + 3.9 mAP on OVIS). Code is available at https://github.com/fanghaook/OVFormer.

7 February 2025
Verified
Book Chapter
Closed access
PDF file
PWPeng Wu
Peng Wu
ZWZhicheng Wang
Zhicheng Wang
FPFeiyu Pan
Feiyu Pan
FLFangkai Li
Fangkai Li
HHHao Hu
Hao Hu
YGYiyou Guo
Yiyou Guo