Chenyang Si

Chenyang Si

Auto-generated profile, based on publicly available information

Chenyang Si

Nanjing University, Nanjing, China

Research Focus & Metrics

Academic Career Length

9Years (2018-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
1 November 2023 in IEEE Transactions on Pattern Analysis and Machine Intelligence
Verified
Journal Article
Closed access
WYWeihao Yu
Weihao Yu
CSChenyang Si
Chenyang Si
PZPan Zhou
Pan Zhou
MLMi Luo
Mi Luo
YZYichen Zhou
Yichen Zhou
XWXinchao Wang
Xinchao Wang
MetaFormer, the abstracted architecture of Transformer, has been found to play a significant role in achieving competitive performance. In this paper, we further explore the capacity of MetaFormer, again, by migrating our focus away from the token mixer design: we introduce several baseline models under MetaFormer using the most basic or common mixers, and demonstrate their gratifying performance. We summarize our observations as follows: 1)MetaFormer ensures solid lower bound of performance: By merely adopting identity mapping as the token mixer, the MetaFormer model, termed IdentityFormer, achieves $> $>80% accuracy on ImageNet-1 K. 2)MetaFormer works well with arbitrary token mixers: When specifying the token mixer as even a random matrix to mix tokens, the resulting model RandFormer yields an accuracy of $> $>81%, outperforming IdentityFormer. Rest assured of MetaFormer's results when new token mixers are adopted. 3)MetaFormer effortlessly offers state-of-the-art results: With just conventional token mixers dated back five years ago, the models instantiated from MetaFormer already beat state of the art. a)ConvFormer outperforms ConvNeXt: Taking the common depthwise separable convolutions as the token mixer, the model termed ConvFormer, which can be regarded as pure CNNs, outperforms the strong CNN model ConvNeXt. b)CAFormer sets new record on ImageNet-1 K: By simply applying depthwise separable convolutions as token mixer in the bottom stages and vanilla self-attention in the top stages, the resulting model CAFormer sets a new record on ImageNet-1 K: it achieves an accuracy of 85.5% at $224 \times 224$224×224 resolution, under normal supervised training without external data or distillation. In our expedition to probe MetaFormer, we also find that a new activation, StarReLU , reduces 71% FLOPs of activation compared with commonly-used GELU yet achieves better performance. Specifically, StarReLU is a variant of Squared ReLU dedicated to alleviating distribution shift. We expect StarReLU to find great potential in MetaFormer-like models alongside other neural networks.


17 November 2025 in IEEE Transactions on Pattern Analysis and Machine Intelligence
Verified
Journal Article
Closed access
ZHZiqi Huang
Ziqi Huang
FZFan Zhang
Fan Zhang
XXXiaojie Xu
Xiaojie Xu
YHYinan He
Yinan He
JYJiashuo Yu
Jiashuo Yu
ZLZiwei Liu
Ziwei Liu
Video generation has witnessed significant advancements, yet evaluating these models remains a challenge. A comprehensive evaluation benchmark for video generation is indispensable for two reasons: 1) Existing metrics do not fully align with human perceptions; 2) An ideal evaluation system should provide insights to inform future developments of video generation. To this end, we present VBench++, a comprehensive benchmark suite that dissects “video generation quality” into specific, hierarchical, and disentangled dimensions, each with tailored prompts and evaluation methods. VBench++ has several appealing properties: 1) Comprehensive Dimensions: VBench++ comprises 16 dimensions in text-to-video generation (e.g., subject identity inconsistency, motion smoothness, temporal flickering, and spatial relationship, etc). The evaluation metrics with fine-grained levels reveal individual models’ strengths and weaknesses. 2) Human Alignment: We also provide a dataset of human preference annotations to validate our benchmarks’ alignment with human perception, for each evaluation dimension respectively. 3) Valuable Insights: We look into current models’ ability across various evaluation dimensions, and various content types. We also investigate the gaps between video and image generation models. 4) Versatile Benchmarking: VBench++ is designed to evaluate a wide range of video generation tasks, including text-to-video and image-to-video. We introduce a high-quality Image Suite with an adaptive aspect ratio to enable fair evaluations across different image-to-video generation settings. Beyond assessing technical quality, VBench++ evaluates the trustworthiness of video generative models, providing a more holistic view of model performance. 5) Full Open-Sourcing: We fully open-source VBench++, including all prompts, the Image Suite, evaluation methods, generated videos, and human preference annotations.

27 July 2025
Verified
Conference Paper
Open access
ZGZekai GU
Zekai GU
RYRui Yan
Rui Yan
JLJiahao Lu
Jiahao Lu
PLPeng Li
Peng Li
ZDZhiyang Dou
Zhiyang Dou
YLYuan Liu
Yuan Liu

1 November 2020 in Pattern Recognition
Verified
Journal Article
Closed access
CSChenyang Si
Chenyang Si
YJYa Jing
Ya Jing
WWWei Wang
Wei Wang
LWLiang Wang
Liang Wang
TTTieniu Tan
Tieniu Tan

28 October 2024
Verified
Book Chapter
Closed access
PDF file
TWTianxing Wu
Tianxing Wu
CSChenyang Si
Chenyang Si
YJYuming Jiang
Yuming Jiang
ZHZiqi Huang
Ziqi Huang
ZLZiwei Liu
Ziwei Liu