Jiaji Wang

Mr. Jiaji Wang


Research Focus & Metrics

Academic Career Length

10Years (2017-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
1 August 2018
Verified
Conference Paper
Closed access
JWJiaji Wang
Jiaji Wang
ZMZhenjiang Miao
Zhenjiang Miao
This paper presents a method of automatically generating Labanotation scores from human motion capture data. Up to now the main acquisition of Labanotation is manual recording by the professionals. Our work allows the users converting human motions to Labanotation scores efficiently. The key components of our method are the analysis of motion capture data, the segmentation of motion and the recognition of each motion fragment. In motion segmentation, we make the results aligned with the beat of Labanotation to ensure the generated symbols regular and accurate. In movement recognition, according to the different properties of human motion, we deal with the data in different suitable ways. Therefore, our recognition results are more reliable than previous works. The experiments show that our work is a useful tool for converting human dance motions into Labanotation scores. Further, considering its efficiency the method can be used to record large numbers of ethnic dances that coming to the crisis of being lost.

3 September 2021 in IEEE Transactions on Circuits and Systems for Video Technology
Verified
Journal Article
Closed access
NXNingwei Xie
Ningwei Xie
ZMZhenjiang Miao
Zhenjiang Miao
XZXiao-Ping Zhang
Xiao-Ping Zhang
WXWanru Xu
Wanru Xu
MLMin Li
Min Li
JWJiaji Wang
Jiaji Wang
Labanotation is a symbolic recording system for human movements, and also a powerful tool for protecting and spreading folk dances and other performing arts. State-of-the-art automatic Labanotation uses end-to-end methods with sequence-based skeleton representation, which cannot capture the relationship between joints and bones in the skeleton for accurate descriptions of continuous lower limb movements such as dance steps. In this paper, we propose a novel double-stream fusion method of directed graph neural networks (DGNN), combined with connectionist temporal classification (CTC), namely DFGNN-CTC, for sequential fine-grained motion recognition, such as the Labanotation generation of unsegmented dance movement. First, we extract double-stream directed graph feature, employing an orientation-normalized directed acyclic graph (ON-DAG) and an orientation-normalized temporal directed acyclic graph (ON-TDAG), to jointly model spatiotemporal properties of movement recorded in motion capture data. Then, we design a CTC-based fusion-pooling module to fuse the spatial and temporal streams encoded by two DGNNs. It concatenates and fuses the two streams to generate discriminative descriptions of each time step, and concentrates them to make per-time-step predictions of Laban gesture type, from which the CTC searches the optimal Laban symbol sequence, corresponding to elemental motions composing the movement. In this way, the new method enables much finer discrimination for similar Laban gestures with subtle differences in spatial and temporal properties through joint contextual spatiotemporal modeling so that it achieves much superior performance in continuous Labanotation generation to existing methods, which only have single-stream analysis either spatially or temporally. The experiments on two Labanotation-labelled motion capture datasets demonstrate the effectiveness of the components in the proposed method and its superiority comparing with the state-of-the-art methods, especially for lower limb movements.

4 August 2020 in IEEE Access
Verified
Journal Article
Open access
JWJiaji Wang
Jiaji Wang
ZMZhenjiang Miao
Zhenjiang Miao
NXNingwei Xie
Ningwei Xie
WXWanru Xu
Wanru Xu
ALAng Li
Ang Li
Labanotation is one of the well-known notation systems for the documenting and archiving of human motion. It plays a powerful role in dance protection, choreography analysis, and so on. Recently, researchers are committed to using computer technology to automatically generate Labanotation rather than manually drawing. However, the existing generation methods cannot deal with the various changes in motion data, such as different scales, angles, motion modes and limbs. In this paper, we aim to generate Labanotation from motion capture data acquired through real folk dance performances. The main steps include feature extraction, motion segmentation and unit movement analysis. Firstly, a normalized feature named Lie group feature is extracted, which can cope with the challenges of different scales and angles in motion data. Secondly, in order to divide motion with different modes into unit fragments for further recognizing, we propose a segmentation method that combines the speed threshold and the region partition. Thirdly, to generate Laban symbols of unit movements for different limbs, two kinds of neural networks are used for the analysis. On the one hand, LieNet, a powerful network for analyzing time series data based on Lie group structure, is utilized to recognize the lower limb movements. On the other hand, extreme-learning machine, a single hidden layer feedforward neural network, is used to identify the upper limb postures. Experimental results demonstrate that our method of feature extraction, motion segmentation and unit movement analysis achieves better results than the previous works, which makes the generated Labanotation score more reliable.

5 April 2019 in Journal of Electronic Imaging
Verified
Journal Article
Closed access
PDF file
XZXueyan Zhang
Xueyan Zhang
ZMZhenjiang Miao
Zhenjiang Miao
QZQiang Zhang
Qiang Zhang
JWJiaji Wang
Jiaji Wang
Labanotation is one of the most widely used notation systems and plays a powerful role in recording and archiving traditional folk dance. We propose an end-to-end method for generating Labanotation from motion capture data by identifying the movement of each part of the human body and by assigning corresponding Labanotation symbols. Our method is mainly highlighted in the following aspects: first, we design simple yet highly discriminative skeleton features that can accurately represent human movements; and second, for the recognition of upper limb movements, we adopt fast and efficient extreme-learning neural networks, and for the recognition of lower limb movements, we employ powerful long short-term memory networks. It is worth mentioning that this is the first time that neural networks have been applied to the field of Labanotation generation. Experimental results show that our approach achieves much better recognition accuracy than previous work.

1 January 2017 in Journal of Electronic Imaging
Verified
Journal Article
Closed access
PDF file
JWJiaji Wang
Jiaji Wang
ZMZhenjiang Miao
Zhenjiang Miao
HGHao Guo
Hao Guo
ZZZiming Zhou
Ziming Zhou
HWHao Wu
Hao Wu
Labanotation uses symbols to describe human motion and is an effective means of protecting folk dance. We use motion capture data to automatically generate Labanotation. First, we convert the motion capture data of the biovision hierarchy file into three-dimensional coordinate data. Second, we divide human motion into element movements. Finally, we analyze each movement and find the corresponding notation. Our work has been supervised by an expert in Labanotation to ensure the correctness of the results. At present, the work deals with a subset of symbols in Labanotation that correspond to several basic movements. Labanotation contains many symbols and several new symbols may be introduced for improvement in the future. We will refine our work to handle more symbols. The automatic generation of Labanotation can greatly improve the work efficiency of documenting movements. Thus, our work will significantly contribute to the protection of folk dance and other action arts.

1 February 2019 in SCIENTIA SINICA Informationis
Verified
Journal Article
Closed access
XZXueyan Zhang
Xueyan Zhang
QZQiang Zhang
Qiang Zhang
ZMZhenjiang Miao
Zhenjiang Miao
JWJiaji Wang
Jiaji Wang
Labanotation is a symbol system for recording human motions. It is a powerful tool for protecting, inheriting and disseminating folk dances and other action arts. At present, Labanotation data are mainly recorded manually by professionals, and the working efficiency of the system is low. This paper proposes a method that automatically generates Labanotation from three-dimensional human-motion capture data. The method identifies the elemental movements corresponding to basic Laban symbols. The method contains two components: motion segmentation and unit movement analysis. The motion segmentation divides the motion capture data into segments that are easily identified by the speed threshold method. To standardize the Laban symbols and improve their accuracy, the motion segments are then matched to the Labanotation rhythms. In the unit movement analysis, Labanotation divides the movements into support and non-support ones. As the two movement types have different characteristics, they are identified by different methods. In experiments, the proposed method successfully transformed the movements represented by the motion-capture data into digitized Labanotation. The automatic Labanotation generation is far more efficient than manual recording. Therefore, the method can quickly record ethnic dances on the verge of loss, helping to protect and preserve the intangible cultural heritage of action arts.