Xiaohong Liu

Xiaohong Liu

Auto-generated profile, based on publicly available information

Xiaohong Liu

Shanghai Jiao Tong University

Research Focus & Metrics

Academic Career Length

29Years (1998-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
7 July 2022 in IEEE Transactions on Circuits and Systems for Video Technology
Verified
Journal Article
Closed access
XLXiaohong Liu
Xiaohong Liu
YLYaojie Liu
Yaojie Liu
Jun ChenJun Chen
Jun Chen
XLXiaoming Liu
Xiaoming Liu
To defend against manipulation of image content, such as splicing, copy-move, and removal, we develop a Progressive Spatio-Channel Correlation Network (PSCC-Net) to detect and localize image manipulations. PSCC-Net processes the image in a two-path procedure: a top-down path that extracts local and global features and a bottom-up path that detects whether the input image is manipulated, and estimates its manipulation masks at multiple scales, where each mask is conditioned on the previous one. Different from the conventional encoder-decoder and no-pooling structures, PSCC-Net leverages features at different scales with dense cross-connections to produce manipulation masks in a coarse-to-fine fashion. Moreover, a Spatio-Channel Correlation Module (SCCM) captures both spatial and channel-wise correlations in the bottom-up path, which endows features with holistic cues, enabling the network to cope with a wide range of manipulation attacks. Thanks to the light-weight backbone and progressive mechanism, PSCC-Net can process 1,080P images at 50+ FPS. Extensive experiments demonstrate the superiority of PSCC-Net over the state-of-the-art methods on both detection and localization. Codes and models are available at https://github.com/proteus1991/PSCC-Net.

25 September 2023 in IEEE Transactions on Circuits and Systems for Video Technology
Verified
Journal Article
Open access
CLChunyi Li
Chunyi Li
ZZZicheng Zhang
Zicheng Zhang
HWHaoning Wu
Haoning Wu
WSWei Sun
Wei Sun
XMXiongkuo Min
Xiongkuo Min
WLWeisi Lin
Weisi Lin
With the rapid advancements of the text-to-image generative model, AI-generated images (AGIs) have been widely applied to entertainment, education, social media, etc. However, considering the large quality variance among different AGIs, there is an urgent need for quality models that are consistent with human subjective ratings. To address this issue, we extensively consider various popular AGI models, generated AGI through different prompts and model parameters, and collected subjective scores at the perceptual quality and text-to-image alignment, thus building the most comprehensive AGI subjective quality database AGIQA-3K so far. Furthermore, we conduct a benchmark experiment on this database to evaluate the consistency between the current Image Quality Assessment (IQA) model and human perception, while proposing StairReward that significantly improves the assessment performance of subjective text-to-image alignment. We believe that the fine-grained subjective scores in AGIQA-3K will inspire subsequent AGI quality models to fit human subjective perception mechanisms at both perception and alignment levels and to optimize the generation result of future AGI models. The database is released on https://github.com/lcysyzxdxc/AGIQA-3k-Database.


18 January 2021 in IEEE Transactions on Multimedia
Verified
Journal Article
Closed access
ZSZhihao Shi
Zhihao Shi
XLXiaohong Liu
Xiaohong Liu
KSKangdi Shi
Kangdi Shi
LDLinhui Dai
Linhui Dai
Jun ChenJun Chen
Jun Chen
Video frame interpolation aims at synthesizing intermediate frames from nearby source frames while maintaining spatial and temporal consistencies. The existing deep-learning-based video frame interpolation methods can be roughly divided into two categories: flow-based methods and kernel-based methods. The performance of flow-based methods is often jeopardized by the inaccuracy of flow map estimation due to oversimplified motion models, while that of kernel-based methods tends to be constrained by the rigidity of kernel shape. To address these performance-limiting issues, a novel mechanism named generalized deformable convolution is proposed, which can effectively learn motion information in a data-driven manner and freely select sampling points in space-time. We further develop a new video frame interpolation method based on this mechanism. Our extensive experiments demonstrate that the new method performs favorably against the state-of-the-art, especially when dealing with complex motions. Code is available at https://github.com/zhshi0816/GDConvNet .

28 October 2024
Verified
Conference Paper
Open access
TKTengchuan Kou
Tengchuan Kou
XLXiaohong Liu
Xiaohong Liu
ZZZicheng Zhang
Zicheng Zhang
CLChunyi Li
Chunyi Li
HWHaoning Wu
Haoning Wu
NLNing Liu
Ning Liu
With the rapid development of generative models, AI-Generated Content (AIGC) has exponentially increased in daily lives. Among them, Text-to-Video (T2V) generation has received widespread attention. Though many T2V models have been released for generating high perceptual quality videos, there is still lack of a method to evaluate the quality of these videos quantitatively. To solve this issue, we establish the largest-scale Text-to-Video Quality Assessment DataBase (T2VQA-DB) to date. The dataset is composed of 10,000 videos generated by 9 different T2V models, along with each video's corresponding mean opinion score. Based on T2VQA-DB, we propose a novel transformer-based model for subjective-aligned Text-to-Video Quality Assessment (T2VQA). The model extracts features from text-video alignment and video fidelity perspectives, then it leverages the ability of a large language model to give the prediction score. Experimental results show that T2VQA outperforms existing T2V metrics and SOTA video quality assessment models. Quantitative analysis indicates that T2VQA is capable of giving subjective-align predictions, validating its effectiveness. The dataset and code are available at https://github.com/QMME/T2VQA.

27 November 2024
Verified
Book Chapter
Closed access
PDF file
HZHan Zhou
Han Zhou
WDWei Dong
Wei Dong
XLXiaohong Liu
Xiaohong Liu
SLShuaicheng Liu
Shuaicheng Liu
XMXiongkuo Min
Xiongkuo Min
Jun ChenJun Chen
Jun Chen