Yapeng Tian

Yapeng Tian

Auto-generated profile, based on publicly available information

Yapeng Tian

Department of Computer Science, The University of Texas at Dallas, Richardson, Texas, USA

Research Focus & Metrics

Academic Career Length

9Years (2018-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
9 October 2018
Verified
Book Chapter
Closed access
PDF file
YTYapeng Tian
Yapeng Tian
JSJing Shi
Jing Shi
BLBochen Li
Bochen Li
ZDZhiyao Duan
Zhiyao Duan
CXChenliang Xu
Chenliang Xu

3 December 2020
Verified
Book Chapter
Closed access
PDF file
YTYapeng Tian
Yapeng Tian
DLDingzeyu Li
Dingzeyu Li
CXChenliang Xu
Chenliang Xu

21 March 2024 in IEEE Transactions on Multimedia
Verified
Journal Article
Closed access
AVAli Vosoughi
Ali Vosoughi
SDShijian Deng
Shijian Deng
SZSongyang Zhang
Songyang Zhang
YTYapeng Tian
Yapeng Tian
CXChenliang Xu
Chenliang Xu
JLJiebo Luo
Jiebo Luo
To increase the generalization capability of VQA systems, many recent studies have tried to de-bias spurious language or vision associations that shortcut the question or image to the answer. Despite these efforts, the literature fails to address the confounding effect of vision and language simultaneously. As a result, when they reduce bias learned from one modality, they usually increase bias from the other. In this paper, we first model a confounding effect that causes language and vision bias simultaneously, then propose a counterfactual inference to remove the influence of this effect. The model trained in this strategy can concurrently and efficiently reduce vision and language bias. To the best of our knowledge, this is the first work to reduce biases resulting from confounding effects of vision and language in VQA, leveraging causal explain-away relations. We accompany our method with an explain-away strategy, pushing the accuracy of the questions with numerical answers results compared to existing methods that have been an open problem. The proposed method outperforms the state-of-the-art methods in VQA-CP v2 datasets.

12 June 2023 in IEEE Transactions on Image Processing
Verified
Journal Article
Closed access
BXBin Xia
Bin Xia
YTYapeng Tian
Yapeng Tian
YZYulun Zhang
Yulun Zhang
YHYucheng Hang
Yucheng Hang
Wenming YangWenming Yang
Wenming Yang
QLQingmin Liao
Qingmin Liao
Blind image super-resolution (blind SR) aims to generate high-resolution (HR) images from low-resolution (LR) input images with unknown degradations. To enhance the performance of SR, the majority of blind SR methods introduce an explicit degradation estimator, which helps the SR model adjust to unknown degradation scenarios. Unfortunately, it is impractical to provide concrete labels for the multiple combinations of degradations (e.g., blurring, noise, or JPEG compression) to guide the training of the degradation estimator. Moreover, the special designs for certain degradations hinder the models from being generalized for dealing with other degradations. Thus, it is imperative to devise an implicit degradation estimator that can extract discriminative degradation representations for all types of degradations without requiring the supervision of degradation ground-truth. To this end, we propose a Meta-Learning based Region Degradation Aware SR Network (MRDA), including Meta-Learning Network (MLN), Degradation Extraction Network (DEN), and Region Degradation Aware SR Network (RDAN). To handle the lack of ground-truth degradation, we use the MLN to rapidly adapt to the specific complex degradation after several iterations and extract implicit degradation information. Subsequently, a teacher network MRDAT is designed to further utilize the degradation information extracted by MLN for SR. However, MLN requires iterating on paired LR and HR images, which is unavailable in the inference phase. Therefore, we adopt knowledge distillation (KD) to make the student network learn to directly extract the same implicit degradation representation (IDR) as the teacher from LR images. Furthermore, we introduce an RDAN module that is capable of discerning regional degradations, allowing IDR to adaptively influence various texture patterns. Extensive experiments under classic and real-world degradation settings show that MRDA achieves SOTA performance and can generalize to various degradation processes.

14 November 2024 in IEEE Transactions on Pattern Analysis and Machine Intelligence
Verified
Journal Article
Closed access
BXBin Xia
Bin Xia
YZYulun Zhang
Yulun Zhang
SWShiyin Wang
Shiyin Wang
YWYitong Wang
Yitong Wang
XWXinglong Wu
Xinglong Wu
LGLuc Van Gool
Luc Van Gool
The Diffusion Model (DM) has emerged as the SOTA approach for image synthesis. However, the existing DM cannot perform well on some image-to-image translation (I2I) tasks. Different from image synthesis, some I2I tasks, such as super-resolution, require generating results in accordance with GT images. Traditional DMs for image synthesis require extensive iterations and large denoising models to estimate entire images, which gives their strong generative ability but also leads to artifacts and inefficiency for I2I. To tackle this challenge, we propose a simple, efficient, and powerful DM framework for I2I, called DiffI2I. Specifically, DiffI2I comprises three key components: a compact I2I prior extraction network (CPEN), a dynamic I2I transformer (DI2Iformer), and a denoising network. We train DiffI2I in two stages: pretraining and DM training. For pretraining, GT and input images are fed into CPEN $_{S1}$ to capture a compact I2I prior representation (IPR) guiding DI2Iformer. In the second stage, the DM is trained to only use the input images to estimate the same IRP as CPEN $_{S1}$ . Compared to traditional DMs, the compact IPR enables DiffI2I to obtain more accurate outcomes and employ a lighter denoising network and fewer iterations. Through extensive experiments on various I2I tasks, we demonstrate that DiffI2I achieves SOTA performance while significantly reducing computational burdens.