Wenjing Pang

Wenjing Pang

Auto-generated profile, based on publicly available information

Wenjing Pang

School of Artificial Intelligence, South China Normal University, Guangzhou, Guangdong, China

Research Focus & Metrics

Representative Publications

View All Publications

16 November 2026 in ACM Transactions on Intelligent Systems and Technology
Verified
Journal Article
Open access
RWRuihan Wu
Ruihan Wu
RDRuiqi Dong
Ruiqi Dong
WPWenjing Pang
Wenjing Pang
CPChenjie Pan
Chenjie Pan
RZRui Zhang
Rui Zhang
CFChenyou Fan
Chenyou Fan
Open-ended visual storytelling poses a significant challenge for text-to-image models, which often fail to maintain narrative coherence and consistent character appearance across a sequence of images. To address this, we introduce StoryCrafter, a multi-character diffusion model that employs a novel instance-level cross-attention module. This module, trained with supervised fine-tuning, ensures precise alignment between text descriptions and characters, enabling consistent multi-character interactions throughout a story. Furthermore, we propose Direct-Diffusion Group Relative Policy Optimization, a novel reinforcement learning stage that uses story-aligned rewards to select optimal frames from a generated group, mitigating accumulated inconsistencies. We show that this group selection capability can be seamlessly integrated into inference time, effectively ensuring multi-frame style and character consistency, outperforming standard static greedy generation. We evaluate our approach through automated metrics, human assessments and vision-language model (VLM) judgment, measuring text-to-image alignment, style and character consistency, and fine-grained detail quality. Experiments on three benchmarks demonstrate that StoryCrafter outperforms existing methods, achieving 5.2% improvements in storytelling consistency on StorySalon dataset and 3.3%-10.8% in character accuracy on Flintstones-SV and Pororo-SV datasets, and also outperforming baselines in both human and VLM evaluations. The TTRL further brings consistent improvements in human evaluation on story visualization and continuation tasks, improving the average rank from 2.79 to 1.80 and from 1.80 to 1.39, respectively.