Shuhei Tsuchida

Dr. Shuhei Tsuchida

Center for Interdisciplinary AI and Data Science, Ochanomizu University, Tokyo, Japan
orcid

Research Focus & Metrics

Academic Career Length

14Years (2013-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications


29 August 2024 in New Generation Computing
Verified
Journal Article
Closed access
PDF file
STShuhei Tsuchida
Shuhei Tsuchida

30 May 2024
Verified
Conference Paper
Open access
KEKoki Endo
Koki Endo
STShuhei Tsuchida
Shuhei Tsuchida
TFTsukasa Fukusato
Tsukasa Fukusato
TITakeo Igarashi
Takeo Igarashi
Segmenting dance video into short movements is a popular way to easily understand dance choreography. However, it is currently done manually and requires a significant amount of effort by experts. That is, even if many dance videos are available on social media (e.g., TikTok and YouTube), it remains difficult for people, especially novices, to casually watch short video segments to practice dance choreography. In this paper, we propose a method to automatically segment a dance video into each movement. Given a dance video as input, we first extract visual and audio features: the former is computed from the keypoints of the dancer in the video, and the latter is computed from the Mel spectrogram of the music in the video. Next, these features are passed to a Temporal Convolutional Network (TCN), and segmentation points are estimated by picking peaks of the network output. To build our training dataset, we annotate segmentation points to dance videos in the AIST Dance Video Database, which is a shared database containing original street dance videos with copyright-cleared dance music. The evaluation study shows that the proposed method (i.e., combining the visual and audio features) can estimate segmentation points with high accuracy. In addition, we developed an application to help dancers practice choreography using the proposed method.


1 March 2024 in IEICE Transactions on Information and Systems
Verified
Journal Article
Open access
PDF file
STShuhei Tsuchida
Shuhei Tsuchida
SFSatoru Fukayama
Satoru Fukayama
JKJun Kato
Jun Kato
HYHiromu Yakura
Hiromu Yakura
MGMasataka Goto
Masataka Goto
Composing choreography is challenging because it involves numerous iterative refinements. According to our video analysis and interviews, choreographers typically need to imagine dancers' movements to revise drafts on paper since testing new movements and formations with actual dancers takes time. To address this difficulty, we present an interactive group-dance simulation interface, DanceUnisoner, that assists choreographers in composing a group dance in a simulated environment. With DanceUnisoner, choreographers can arrange excerpts from solo-dance videos of dancers throughout a three-dimensional space. They can adjust various parameters related to the dancers in real time, such as each dancer's position and size and each movement's timing. To evaluate the effectiveness of the system's parametric, visual, and interactive interface, we asked seven choreographers to use it and compose group dances. Our observations, interviews, and quantitative analysis revealed their successful usage in iterative refinements and visual checking of choreography, providing insights to facilitate further computational creativity support for choreographers.