Lingbo Yang

Lingbo Yang

Auto-generated profile, based on publicly available information

Lingbo Yang

National Engineering Research Center of Visual Technology, School of Computer Science, Peking University, Beijing, China

Research Focus & Metrics

Academic Career Length

8Years (2019-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
12 October 2020
Verified
Conference Paper
Open access
LYLingbo Yang
Lingbo Yang
SWShanshe Wang
Shanshe Wang
SMSiwei Ma
Siwei Ma
WGWen Gao
Wen Gao
CLChang Liu
Chang Liu
PRPeiran Ren
Peiran Ren
Existing face restoration researches typically rely on either the image degradation prior or explicit guidance labels for training, which often lead to limited generalization ability over real-world images with heterogeneous degradation and rich background contents. In this paper, we investigate a more challenging and practical "dual-blind" version of the problem by lifting the requirements on both types of prior, termed as "Face Renovation"(FR). Specifically, we formulate FR as a semantic-guided generation problem and tackle it with a collaborative suppression and replenishment (CSR) approach. This leads to HiFaceGAN, a multi-stage framework containing several nested CSR units that progressively replenish facial details based on the hierarchical semantic guidance extracted from the front-end content-adaptive suppression modules. Extensive experiments on both synthetic and real face images have verified the superior performance of our HiFaceGAN over a wide range of challenging restoration subtasks, demonstrating its versatility, robustness and generalization ability towards real-world face processing applications. Code is available at https://github.com/Lotayou/Face-Renovation.

21 March 2022 in IEEE Transactions on Image Processing
Verified
Journal Article
Closed access
JCJianhui Chang
Jianhui Chang
ZZZhenghui Zhao
Zhenghui Zhao
CJChuanmin Jia
Chuanmin Jia
SWShiqi Wang
Shiqi Wang
LYLingbo Yang
Lingbo Yang
SMSiwei Ma
Siwei Ma
Existing compression methods typically focus on the removal of signal-level redundancies, while the potential and versatility of decomposing visual data into compact conceptual components still lack further study. To this end, we propose a novel conceptual compression framework that encodes visual data into compact structure and texture representations, then decodes in a deep synthesis fashion, aiming to achieve better visual reconstruction quality, flexible content manipulation, and potential support for various vision tasks. In particular, we propose to compress images by a dual-layered model consisting of two complementary visual features: 1) structure layer represented by structural maps and 2) texture layer characterized by low-dimensional deep representations. At the encoder side, the structural maps and texture representations are individually extracted and compressed, generating the compact, interpretable, inter-operable bitstreams. During the decoding stage, a hierarchical fusion GAN (HF-GAN) is proposed to learn the synthesis paradigm where the textures are rendered into the decoded structural maps, leading to high-quality reconstruction with remarkable visual realism. Extensive experiments on diverse images have demonstrated the superiority of our framework with lower bitrates, higher reconstruction quality, and increased versatility towards visual analysis and content manipulation tasks.

25 January 2021 in IEEE Transactions on Image Processing
Verified
Journal Article
Closed access
LYLingbo Yang
Lingbo Yang
PWPan Wang
Pan Wang
CLChang Liu
Chang Liu
ZGZhanning Gao
Zhanning Gao
PRPeiran Ren
Peiran Ren
WGWen Gao
Wen Gao
Human pose transfer (HPT) is an emerging research topic with huge potential in fashion design, media production, online advertising and virtual reality. For these applications, the visual realism of fine-grained appearance details is crucial for production quality and user engagement. However, existing HPT methods often suffer from three fundamental issues: detail deficiency, content ambiguity and style inconsistency, which severely degrade the visual quality and realism of generated images. Aiming towards real-world applications, we develop a more challenging yet practical HPT setting, termed as Fine-grained Human Pose Transfer (FHPT), with a higher focus on semantic fidelity and detail replenishment. Concretely, we analyze the potential design flaws of existing methods via an illustrative example, and establish the core FHPT methodology by combing the idea of content synthesis and feature transfer together in a mutually-guided fashion. Thereafter, we substantiate the proposed methodology with a Detail Replenishing Network (DRN) and a corresponding coarse-to-fine model training scheme. Moreover, we build up a complete suite of fine-grained evaluation protocols to address the challenges of FHPT in a comprehensive manner, including semantic analysis, structural detection and perceptual quality assessment. Extensive experiments on the DeepFashion benchmark dataset have verified the power of proposed benchmark against start-of-the-art works, with 12%–14% gain on top-10 retrieval recall, 5% higher joint localization accuracy, and near 40% gain on face identity preservation. Our codes, models and evaluation tools will be released at https://github.com/Lotayou/RATE

1 July 2020
Verified
Conference Paper
Closed access
LYLingbo Yang
Lingbo Yang
PWPan Wang
Pan Wang
XZXinfeng Zhang
Xinfeng Zhang
SWShanshe Wang
Shanshe Wang
ZGZhanning Gao
Zhanning Gao
WGWen Gao
Wen Gao
The ability to produce convincing textural details is essential for the fidelity of synthesized person images. Existing methods typically follow a “warping-based” strategy that propagates appearance features through the same pathway used for pose transfer. However, most fine-grained features would be lost during down-sampling, leading to over-smoothed clothes and missing details in the output images. In this paper we presents RATE-Net, a novel framework for synthesizing person images with sharp texture details. The proposed framework leverages an additional texture enhancing module to extract appearance information from the source image and estimate a fine-grained residual texture map, which helps to refine the coarse estimation from the pose transfer module. In addition, we design an effective alternate updating strategy to promote mutual guidance between two modules for better shape and appearance consistency. Experiments conducted on DeepFashion benchmark dataset have demonstrated the superiority of our framework compared with existing networks.

1 July 2019
Verified
Conference Paper
Closed access
LYLingbo Yang
Lingbo Yang
ZZZhenghui Zhao
Zhenghui Zhao
SWShiqi Wang
Shiqi Wang
SWShanshe Wang
Shanshe Wang
SMSiwei Ma
Siwei Ma
WGWen Gao
Wen Gao

16 March 2021 in arXiv
Verified
Preprint
Open access
PDF file
JCJianhui Chang
Jianhui Chang
ZZZhenghui Zhao
Zhenghui Zhao
LYLingbo Yang
Lingbo Yang
CJChuanmin Jia
Chuanmin Jia
JZJian Zhang
Jian Zhang
SMSiwei Ma
Siwei Ma
Conceptual coding has been an emerging research topic recently, which encodes natural images into disentangled conceptual representations for compression. However, the compression performance of the existing methods is still sub-optimal due to the lack of comprehensive consideration of rate constraint and reconstruction quality. To this end, we propose a novel end-to-end semantic prior modeling-based conceptual coding scheme towards extremely low bitrate image compression, which leverages semantic-wise deep representations as a unified prior for entropy estimation and texture synthesis. Specifically, we employ semantic segmentation maps as structural guidance for extracting deep semantic prior, which provides fine-grained texture distribution modeling for better detail construction and higher flexibility in subsequent high-level vision tasks. Moreover, a cross-channel entropy model is proposed to further exploit the inter-channel correlation of the spatially independent semantic prior, leading to more accurate entropy estimation for rate-constrained training. The proposed scheme achieves an ultra-high 1000x compression ratio, while still enjoying high visual reconstruction quality and versatility towards visual processing and analysis tasks.