Chenshu Xu

Chenshu Xu

Auto-generated profile, based on publicly available information

Chenshu Xu

School of Computing and Information Systems, Singapore Management University, Singapore

Research Focus & Metrics

Academic Career Length

4Years (2023-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
7 May 2024 in IEEE Transactions on Visualization and Computer Graphics
Verified
Journal Article
Closed access
CXChenshu Xu
Chenshu Xu
YXYangyang Xu
Yangyang Xu
Huaidong ZhangHuaidong Zhang
Huaidong Zhang
XXXuemiao Xu
Xuemiao Xu
SHShengfeng He
Shengfeng He
Text-to-image generation models have significantly broadened the horizons of creative expression through the power of natural language. However, navigating these models to generate unique concepts, alter their appearance, or reimagine them in unfamiliar roles presents an intricate challenge. For instance, how can we exploit language-guided models to transpose an anime character into a different art style, or envision a beloved character in a radically different setting or role? This paper unveils a novel approach named DreamAnime, designed to provide this level of creative freedom. Using a minimal set of 2-3 images of a user-specified concept such as an anime character or an art style, we teach our model to encapsulate its essence through novel “words” in the embedding space of a pre-existing text-to-image model. Crucially, we disentangle the concepts of style and identity into two separate “words”, thus providing the ability to manipulate them independently. These distinct “words” can then be pieced together into natural language sentences, promoting an intuitive and personalized creative process. Empirical results suggest that this disentanglement into separate word embeddings successfully captures a broad range of unique and complex concepts, with each word focusing on style or identity as appropriate. Comparisons with existing methods illustrate DreamAnime's superior capacity to accurately interpret and recreate the desired concepts across various applications and tasks. Code is available at https://github.com/chnshx/DreamAnime .

28 April 2023 in IEEE Transactions on Image Processing
Verified
Journal Article
Closed access
CXChenshu Xu
Chenshu Xu
XXXuemiao Xu
Xuemiao Xu
NZNanxuan Zhao
Nanxuan Zhao
Maxwell TsaiMaxwell Tsai
Maxwell Tsai
Huaidong ZhangHuaidong Zhang
Huaidong Zhang
XLXueting Liu
Xueting Liu
Using a sequence of discrete still images to tell a story or introduce a process has become a tradition in the field of digital visual media. With the surge in these media and the requirements in downstream tasks, acquiring their main topic or genre in a very short time is urgently needed. As a representative form of the media, comic enjoys a huge boom as it has gone digital. However, different from natural images, comic images are divided by panels, and the images are not visually consistent from page to page. Therefore, existing works tailored for natural images perform poorly in analyzing comics. Considering the identification of comic genres is tied to the overall story plotting, a long-term understanding that makes full use of the semantic interactions between multi-level comic fragments needs to be fully exploited. In this paper, we propose P²Comic, a Panel-Page-aware Comic genre classification model, which takes page sequences of comics as the input and produces class-wise probabilities. P²Comic utilizes detected panel boxes to extract panel representations and deploys self-attention to construct panel-page understanding, assisted with inter-dependent classifiers to model label correlation. We develop the first comic dataset for the task of comic genre classification with multi-genre labels. Our approach is proved by experiments to outperform state-of-the-art methods on related tasks. We also validate the extensibility of our network to perform on the multi-modal scenario. Finally, we show the practicability of our approach by giving effective genre prediction results for whole comic books.

13 May 2024 in IEEE Transactions on Multimedia
Verified
Journal Article
Closed access
Maxwell TsaiMaxwell Tsai
Maxwell Tsai
Huaidong ZhangHuaidong Zhang
Huaidong Zhang
XXXuemiao Xu
Xuemiao Xu
CXChenshu Xu
Chenshu Xu
KZKun Zhang
Kun Zhang
SHShengfeng He
Shengfeng He
The degradation of printed photographs due to inadequate preservation is a major problem that can be addressed through deep learning-based restoration methods. However, these methods are often limited by their reliance on annotated data, making them less effective for new domains with limited training samples. In this paper, we propose a semi-supervised old photo restoration network that employs a continuous important sample mining strategy. Specifically, we explore the learning potential of limited data from three aspects: correcting imbalanced data distribution, assigning significant pseudo labels, and learning from unlabeled data. First, we coordinate a random mask augmented strategy with the Double-consistency Alignment method to address the unbalanced damaged category (scratched damage is more prevalent than other artifact types). Second, we develop a novel Perceptual-aware Pseudo-label Propagation method that selects initial recovered results as reliable pseudo-labels to continuously expand the sample pool. Lastly, we propose a Damage-augmented Contrastive Learning method that constructs positive, anchor, and negative samples within a semi-supervised framework to mine correlations of unlabeled data more effectively. To evaluate our approach, we introduce the Old Photo Detection Dataset ( OPDD ) and the Old Photo Restoration Dataset ( OPRD ), both of which consist of 563 (6,179 augmented) photo pairs recovered by professional artists. Our extensive experiments show that our approach significantly outperforms existing methods. Furthermore, we demonstrate the effectiveness of our approach by training an external old photographic plate restoration network using the deuterogenic old photographic film dataset and obtaining promising results.

22 September 2025 in IEEE Transactions on Pattern Analysis and Machine Intelligence
Verified
Journal Article
Closed access
YYYifei Yang
Yifei Yang
ZHZikai Huang
Zikai Huang
CXChenshu Xu
Chenshu Xu
SHShengfeng He
Shengfeng He
Long-term motion generation is a challenging task that requires producing coherent and realistic sequences over extended durations. Current methods primarily rely on framewise motion representations, which capture only static spatial details and overlook temporal dynamics. This approach leads to significant redundancy across the temporal dimension, complicating the generation of effective long-term motion. To overcome these limitations, we introduce the novel concept of Lagrangian Motion Fields, specifically designed for long-term motion generation. By treating each joint as a Lagrangian particle with uniform velocity over short intervals, our approach condenses motion representations into a series of “supermotions” (analogous to superpixels). This method seamlessly integrates static spatial information with interpretable temporal dynamics, transcending the limitations of existing network architectures and motion sequence content types. Our solution is versatile and lightweight, eliminating the need for neural network preprocessing. Our approach excels in tasks such as long-term music-to-dance generation and text-to-motion generation, offering enhanced efficiency, superior generation quality, and greater diversity compared to existing methods. Additionally, the adaptability of Lagrangian Motion Fields extends to applications like infinite motion looping and fine-grained controlled motion generation, highlighting its broad utility.