Congyi Wang

Congyi Wang


Research Focus & Metrics

Academic Career Length

7Years (2020-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
1 February 2024 in Computational Visual Media
Verified
Journal Article
Open access
PDF file
SHShuaiying Hou
Shuaiying Hou
CWCongyi Wang
Congyi Wang
WZWenlin Zhuang
Wenlin Zhuang
YCYu Chen
Yu Chen
YWYangang Wang
Yangang Wang
WXWeiwei Xu
Weiwei Xu
Inspired by the success of WaveNet in multi-subject speech synthesis, we propose a novel neural network based on causal convolutions for multi-subject motion modeling and generation. The network can capture the intrinsic characteristics of the motion of different subjects, such as the influence of skeleton scale variation on motion style. Moreover, after fine-tuning the network using a small motion dataset for a novel skeleton that is not included in the training dataset, it is able to synthesize high-quality motions with a personalized style for the novel skeleton. The experimental results demonstrate that our network can model the intrinsic characteristics of motions well and can be applied to various motion modeling and synthesis tasks.

10 June 2020 in arXiv
Verified
Preprint
Open access
PDF file
WZWenlin Zhuang
Wenlin Zhuang
YWYangang Wang
Yangang Wang
JRJoseph Robinson
Joseph Robinson
CWCongyi Wang
Congyi Wang
MSMing Shao
Ming Shao
SXSiyu Xia
Siyu Xia
3D human dance motion is a cooperative and elegant social movement. Unlike regular simple locomotion, it is challenging to synthesize artistic dance motions due to the irregularity, kinematic complexity and diversity. It requires the synthesized dance is realistic, diverse and controllable. In this paper, we propose a novel generative motion model based on temporal convolution and LSTM,TC-LSTM, to synthesize realistic and diverse dance motion. We introduce a unique control signal, dance melody line, to heighten controllability. Hence, our model, and its switch for control signals, promote a variety of applications: random dance synthesis, music-to-dance, user control, and more. Our experiments demonstrate that our model can synthesize artistic dance motion in various dance types. Compared with existing methods, our method achieved start-of-the-art results.

10 March 2020 in arXiv
Verified
Preprint
Open access
PDF file
WZWenlin Zhuang
Wenlin Zhuang
CWCongyi Wang
Congyi Wang
SXSiyu Xia
Siyu Xia
JCJinxiang Chai
Jinxiang Chai
YWYangang Wang
Yangang Wang
Synthesize human motions from music, i.e., music to dance, is appealing and attracts lots of research interests in recent years. It is challenging due to not only the requirement of realistic and complex human motions for dance, but more importantly, the synthesized motions should be consistent with the style, rhythm and melody of the music. In this paper, we propose a novel autoregressive generative model, DanceNet, to take the style, rhythm and melody of music as the control signals to generate 3D dance motions with high realism and diversity. To boost the performance of our proposed model, we capture several synchronized music-dance pairs by professional dancers, and build a high-quality music-dance pair dataset. Experiments have demonstrated that the proposed method can achieve the state-of-the-art results.