Zhongqi Wu

Zhongqi Wu

Auto-generated profile, based on publicly available information

Zhongqi Wu

National Laboratory of Pattern Recognition, Institute of Automation, Chinese Academy of Sciences, Beijing 100190, China; The School of Artificial Intelligence, University of Chinese Academy of Sciences, Beijing, China

Research Focus & Metrics

Academic Career Length

6Years (2021-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
27 August 2021 in IEEE Transactions on Multimedia
Verified
Journal Article
Closed access
ZWZhongqi Wu
Zhongqi Wu
CZChuanqing Zhuang
Chuanqing Zhuang
JSJian Shi
Jian Shi
JGJianwei Guo
Jianwei Guo
JXJun Xiao
Jun Xiao
DYDongming Yan
Dongming Yan
Specular reflections pose great challenges on various multimedia and computer vision tasks, e.g. , image segmentation, detection and matching. In this paper, we build a large-scale Paired Specular-Diffuse (PSD) image dataset, where the images are carefully captured by using real-world objects and the ground-truth specular-free diffuse images are provided. To the best of our knowledge, this is the first real-world benchmark dataset for specular highlight removal task, which is useful for evaluating and encouraging new deep learning-based approaches. Given this dataset, we present a novel Generative Adversarial Network (GAN) for specular highlight removal from a single image by introducing the detection of specular reflection information as a guidance. Our network also makes full use of the attention mechanism and is able to directly model the mapping relation between the diffuse area and the specular highlight area without any explicit estimation of the illumination. Experimental results demonstrate that the proposed network is more effective to remove specular reflection components with the guidance of specular highlight detection than recent state-of-the-art methods.

1 March 2023 in Computational Visual Media
Verified
Journal Article
Open access
PDF file
ZWZhongqi Wu
Zhongqi Wu
JGJianwei Guo
Jianwei Guo
CZChuanqing Zhuang
Chuanqing Zhuang
JXJun Xiao
Jun Xiao
DYDongming Yan
Dongming Yan
XZXiaopeng ZHANG
Xiaopeng ZHANG
Specular highlight detection and removal is a fundamental problem in computer vision and image processing. In this paper, we present an efficient end-to-end deep learning model for automatically detecting and removing specular highlights in a single image. In particular, an encoder—decoder network is utilized to detect specular highlights, and then a novel Unet-Transformer network performs highlight removal; we append transformer modules instead of feature maps in the Unet architecture. We also introduce a highlight detection module as a mask to guide the removal task. Thus, these two networks can be jointly trained in an effective manner. Thanks to the hierarchical and global properties of the transformer mechanism, our framework is able to establish relationships between continuous self-attention layers, making it possible to directly model the mapping between the diffuse area and the specular highlight area, and reduce indeterminacy within areas containing strong specular highlight reflection. Experiments on public benchmark and real-world images demonstrate that our approach outperforms state-of-the-art methods for both highlight detection and removal tasks.

27 December 2022
Verified
Conference Paper
Open access
CWChenlong Wang
Chenlong Wang
ZWZhongqi Wu
Zhongqi Wu
JGJianwei Guo
Jianwei Guo
XZXiaopeng ZHANG
Xiaopeng ZHANG
Specular highlight detection is a fundamental research topic in computer graphics and computer vision. In this paper, we present a new full-scale deep supervision model to detect specular highlights from single real-world images. The core of our approach is a novel self-attention module to improve the detection accuracy of the network. We also introduce a refinement strategy with a new loss function for highlight detection task by generating contour maps from the highlight detection masks. Experiments on a public dataset demonstrate that our approach outperforms state-of-the-art methods for highlight detection.