Shiyu Zhao

Shiyu Zhao

Auto-generated profile, based on publicly available information

Shiyu Zhao

Rutgers University, Piscataway, New Jersey, USA

Research Focus & Metrics

Academic Career Length

7Years (2020-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
2 March 2021 in IEEE Transactions on Image Processing
Verified
Journal Article
Closed access
SZShiyu Zhao
Shiyu Zhao
LZLin Zhang
Lin Zhang
YSYing Shen
Ying Shen
YZYicong Zhou
Yicong Zhou
Haze-free images are the prerequisites of many vision systems and algorithms, and thus single image dehazing is of paramount importance in computer vision. In this field, prior-based methods have achieved initial success. However, they often introduce annoying artifacts to outputs because their priors can hardly fit all situations. By contrast, learning-based methods can generate more natural results. Nonetheless, due to the lack of paired foggy and clear outdoor images of the same scenes as training samples, their haze removal abilities are limited. In this work, we attempt to merge the merits of prior-based and learning-based approaches by dividing the dehazing task into two sub-tasks, i.e., visibility restoration and realness improvement. Specifically, we propose a two-stage weakly supervised dehazing framework, RefineDNet. In the first stage, RefineDNet adopts the dark channel prior to restore visibility. Then, in the second stage, it refines preliminary dehazing results of the first stage to improve realness via adversarial learning with unpaired foggy and clear images. To get more qualified results, we also propose an effective perceptual fusion strategy to blend different dehazing outputs. Extensive experiments corroborate that RefineDNet with the perceptual fusion has an outstanding haze removal capability and can also produce visually pleasing results. Even implemented with basic backbone networks, RefineDNet can outperform supervised dehazing approaches as well as other state-of-the-art methods on indoor and outdoor datasets. To make our results reproducible, relevant code and data are available at https://github.com/xiaofeng94/RefineDNet-for-dehazing.

22 May 2020 in IEEE Transactions on Image Processing
Verified
Journal Article
Closed access
SZShiyu Zhao
Shiyu Zhao
LZLin Zhang
Lin Zhang
SHShuaiyi Huang
Shuaiyi Huang
YSYing Shen
Ying Shen
Shengjie ZhaoShengjie Zhao
Shengjie Zhao
On benchmark images, modern dehazing methods are able to achieve very comparable results whose differences are too subtle for people to qualitatively judge. Thus, it is imperative to adopt quantitative evaluation on a vast number of hazy images. However, existing quantitative evaluation schemes are not convincing due to a lack of appropriate datasets and poor correlations between metrics and human perceptions. In this work, we attempt to address these issues, and we make two contributions. First, we establish two benchmark datasets, i.e., the BEnchmark Dataset for Dehazing Evaluation (BeDDE) and the EXtension of the BeDDE (exBeDDE), which had been lacking for a long period of time. The BeDDE is used to evaluate dehazing methods via full reference image quality assessment (FR-IQA) metrics. It provides hazy images, clear references, haze level labels, and manually labeled masks that indicate the regions of interest (ROIs) in image pairs. The exBeDDE is used to assess the performance of dehazing evaluation metrics. It provides extra dehazed images and subjective scores from people. To the best of our knowledge, the BeDDE is the first dehazing dataset whose image pairs were collected in natural outdoor scenes without any simulation. Second, we provide a new insight that dehazing involves two separate aspects, i.e., visibility restoration and realness restoration, which should be evaluated independently; thus, to characterize them, we establish two criteria, i.e., the visibility index (VI) and the realness index (RI), respectively. The effectiveness of the criteria is verified through extensive experiments. Furthermore, 14 representative dehazing methods are evaluated as baselines using our criteria on BeDDE. Our datasets and relevant code are available at https://github.com/xiaofeng94/BeDDE-for-defogging.

6 November 2022
Verified
Book Chapter
Closed access
PDF file
SZShiyu Zhao
Shiyu Zhao
ZZZhixing Zhang
Zhixing Zhang
SSSamuel Schulter
Samuel Schulter
LZLong Zhao
Long Zhao
BKB.G Vijay Kumar
B.G Vijay Kumar
DMDimitris N. Metaxas
Dimitris N. Metaxas

8 May 2025
Verified
Conference Paper
Open access
CJCan Jin
Can Jin
HPHongwu Peng
Hongwu Peng
SZShiyu Zhao
Shiyu Zhao
ZWZhenting Wang
Zhenting Wang
WXWujiang Xu
Wujiang Xu
DMDimitris N. Metaxas
Dimitris N. Metaxas

1 January 2021 in IEEE Transactions on Image Processing
Verified
Journal Article
Closed access
LZLin Zhang
Lin Zhang
AZAnqi Zhu
Anqi Zhu
SZShiyu Zhao
Shiyu Zhao
YZYicong Zhou
Yicong Zhou
Changes in aerosol composition and its proportions can cause changes in atmospheric visibility. Vision systems deployed outdoors must take into account the negative effects brought by visibility impairment. In order to develop vision algorithms that can adapt to low atmospheric visibility conditions, a large-scale dataset containing pairs of clear images and their visibility-impaired versions (along with other annotations if necessary) is usually indispensable. However, it is almost impossible to collect large amounts of such image pairs in a real physical environment. A natural and reasonable solution is to use virtual simulation technologies, which is also the focus of this paper. In this paper, we first deeply analyze the limitations and irrationalities of the existing work specializing on simulation of atmospheric visibility impairment. We point out that many simulation schemes actually even violate the assumptions of the Koschmieder’s law. Second, more importantly, based on a thorough investigation of the relevant studies in the field of atmospheric science, we present simulation strategies for five most commonly encountered visibility impairment phenomena, including mist, fog, natural haze, smog, and Asian dust. Our work establishes a direct link between the fields of atmospheric science and computer vision. In addition, as a byproduct, with the proposed simulation schemes, a large-scale synthetic dataset is established, comprising 40,000 clear source images and their 800,000 visibility-impaired versions. To make our work reproducible, source codes and the dataset have been released at https://cslinzhang.github.io/AVID/ .

21 January 2024 in Journal of Energy Storage
Verified
Journal Article
Closed access
XFXiaofan Fu
Xiaofan Fu
DSDing Shen
Ding Shen
YJYanzhen Ji
Yanzhen Ji
SZShiyu Zhao
Shiyu Zhao
HYHaoran Yu
Haoran Yu
WDWei Dong
Wei Dong