Bo Jiang

Bo Jiang

Auto-generated profile, based on publicly available information

Bo Jiang

Department of Computer Science and Technology, Harbin Institute of Technology at Shenzhen, Shenzhen, China

Research Focus & Metrics

Academic Career Length

8Years (2019-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
7 February 2022 in IEEE Transactions on Circuits and Systems for Video Technology
Verified
Journal Article
Closed access
BJBo Jiang
Bo Jiang
YLYao Lu
Yao Lu
JWJiahuan Wang
Jiahuan Wang
GLGuangming Lu
Guangming Lu
DZDavid Zhang
David Zhang
Image denoising methods using deep neural networks have achieved a great progress in the image restoration. However, the recovered images restored by these deep denoising methods usually suffer from severe over-smoothness, artifacts, and detail loss. To improve the quality of restored images, we first propose Supplemental Priors (SP) method to adaptively predict depth-directed and sample-directed prior information for the reconstruction (decoder) networks. Furthermore, the over-parameterized deep neural networks and too precise supplemental prior information may cause an over-fitting, restricting the performance promotion. To improve the generalization of denoising networks, we further propose Regularization Priors (RP) method to flexibly learn depth-directed and dataset-directed regularization noise for the retrieving (encoder) networks. By respectively integrating the encoder and decoder with these plug-and-play RP block and SP block, we propose the final Adaptive Prior Denoising Networks, called APD-Nets. APD-Nets is the first attempt to simultaneously regularize and supplement denoising networks from the adaptive priors’ view with drawing learning-based mechanism into producing adaptive regularization noise and supplemental information. Extensive experiment results demonstrate our method significantly improves the generalization of denoising networks and the quality of restored images with greatly outperforming the traditional deep denoising methods both quantitatively and visually. The code will be released at https://github.com/JiangBoCS/APD-Nets .

21 July 2023 in IEEE Transactions on Systems, Man, and Cybernetics: Systems
Verified
Journal Article
Closed access
BJBo Jiang
Bo Jiang
YLYao Lu
Yao Lu
XCXiaosheng Chen
Xiaosheng Chen
XLXinhai Lu
Xinhai Lu
GLGuangming Lu
Guangming Lu
Image denoising aims to remove the noise from noisy images. With the increasing complexity of the noise within the noisy images, current denoising methods cannot satisfactorily address this issue. This article proposes a graph attention in attention network (GAiA-Net) for image denoising. First, we introduce a novel approach to graph construction for the GAiA-Net. In the process of such graph construction, the noisy images are divided into patches to formulate the nodes in a graph. The edges are initialized using $ k $ -nearest neighbors. Hence, through iterative transformation and learning, both the pixel-level and structure-level features can be captured by different information exchanges and aggregation within (pixel-level) and outside (structure-level) of the nodes, respectively. Second, we propose the graph attention in attention (GAiA) in the GAiA-Net. The proposed GAiA produces the pixel-level attention within nodes to be further induced to the nodes with various distances to generate the final attention. Therefore, our GAiA-Net can capture the long dependencies on both the pixel-level and structure-level features, which can effectively reduce the complex noise in the denoising process. Comprehensive experiments demonstrate that the proposed GAiA-Net produces state-of-the-art performances on both synthetic noise image and real noise image datasets. Especially, when experimenting on complex noisy Nam datasets, our GAiA-Net achieves a PSNR of 40.40 dB and SSIM of 0.989. These results prove the satisfactory potential and effectiveness of our GAiA-Net.

24 February 2023 in IEEE Transactions on Circuits and Systems for Video Technology
Verified
Journal Article
Closed access
BJBo Jiang
Bo Jiang
YLYao Lu
Yao Lu
Bob ZhangBob Zhang
Bob Zhang
GLGuangming Lu
Guangming Lu
Deep Neural Networks (DNNs) have achieved impressive results on the task of image denoising, but there are two serious problems. First, the denoising ability of DNNs-based image denoising models using traditional training strategies heavily relies on extensive training on clean-noise image pairs. Second, image denoising models based on DNNs usually have large parameters and high computational complexity. To address these issues, this paper proposes a two-stage Few-Shot Learning for Image Denoising (FSLID). Our FSLID is a two-stage denoising strategy integrating Basic Feature Learner (BFL), Denoising Feature Inducer (DFI), and Shared Image Reconstructor (SIR). BFL and SIR are first jointly unsupervised to train on the base image dataset Dbase consisting of easily collected high-quality clean images. Following this, the trained BFL extracts the guided features and constraint features for the noisy and corresponding clean images in the novel image dataset Dnovel , respectively. Furthermore, DFI encodes the noisy features of the noisy images in Dnovel . Then, inducing both the guided features and noisy features, DFI can generate the denoising prior features for the SIR with frozen weights to adaptively denoise the noisy images. Furthermore, we propose refined, low-channel-count, recursive multi-branch Multi-Scale Feature Recursive (MSFR) to modularly formulate an efficient DFI to capture more diverse contextual features information under a limited number of feature channels. Thus, compared with the baseline models, the FSLID composed of the proposed MSFR can significantly reduce the number of model parameters and computational complexity. Extensive experimental results demonstrate our FSLID significantly outperforms well-established baselines on multiple datasets and settings. We hope that our work will encourage further research to explore the field of few-shot image denoising.

9 August 2022 in IEEE Transactions on Instrumentation and Measurement
Verified
Journal Article
Closed access
BJBo Jiang
Bo Jiang
JWJiahuan Wang
Jiahuan Wang
YLYao Lu
Yao Lu
GLGuangming Lu
Guangming Lu
DZDavid Zhang
David Zhang
In recent years, most denoising methods based on deep convolutional neural networks heavily rely on massive noisy–clean image pairs. Collecting massive noisy–clean image pairs is expensive and not practical in real scenes. Currently, few-shot learning has been applied to many areas to cope with the absence of data. The few-shot learning, however, in image denoising severely suffers from domain gap problems, including dataset domain gap and feature domain gap, especially for the real noisy images. Therefore, this article proposes a multilevel noise contrastive network (MNC-Net) performing few-shot image denoising. MNC-Net consists of two training stages: 1) using contrastive learning to self-supervise the training of multilevel noise contrastive learner (MNCL) on the pure synthetic noisy images with multiple Gaussian noise levels to ease the acute dataset domain gap and 2) features generated by the MNCL on limited data are fused to the second stage and alleviate the feature domain gap using our proposed denoising network. Specifically, the MNCL consists of a contrastive feature extractor (CFE) and a contrastive feature projector (CFP). MNCL learns the rich and complex content-invariant degradations and general multiple-level noise representations. The denoising network in the second stage is composed of guided feature encoder (GFE) and adaptive denoising decoder (ADD). The GFE uses contrast features from CFE to guide the produced representations on the specific input noisy images. Then, such output features are fed into the ADD to adaptively denoise the noisy images on the corresponding noise distribution. To the best of our knowledge, this work is the first attempt to jointly use the few-shot learning and contrastive learning in the deep denoising field. Extensive experiments on CBSD68, Kodak24, Set12, SIDD, and DND show that our method achieves promising denoising performances in the absence of data.

23 December 2019 in IEEE Access
Verified
Journal Article
Open access
TLTong Li
Tong Li
BJBo Jiang
Bo Jiang
DWDihua Wu
Dihua Wu
XYXuqiang Yin
Xuqiang Yin
HSHuaibo Song
Huaibo Song
A Cow’s ruminant behavior can provide information about a cow’s health. Monitoring a cow’s ruminant behavior could therefore be of use when assessing its health. However, it is difficult to simultaneously monitor multiple target cows’ ruminations simultaneously without any contact-type equipment. A method for monitoring multiple target cows’ ruminant behavior based on an optical flow method and an inter-frame difference method is proposed here in. The optical flow method is used to obtain the optical flow fields of the ruminant cows’ mouth areas in the first 60 frames of a video. The optical flow values with large changes are selected from the first 60 frames of the test video and these values are superimposed to obtain the candidate ruminant cows’ mouth areas. The candidate ruminant cows’ mouth areas are magnified 1.5 times, and the interframe difference method is used to track the real cows’ mouth areas in the new magnified areas. According to the “center error„ and “overlap rate„ indexes, the tracking result for the 15 videos is evaluated. The results show that the average successful tracking rate reaches 89.12%, demonstrating that the algorithm could be applied for the automatic monitoring of multiple target ruminant cows’ mouth areas.

9 November 2023 in IEEE Transactions on Industrial Informatics
Verified
Journal Article
Closed access
BJBo Jiang
Bo Jiang
YLYao Lu
Yao Lu
Bob ZhangBob Zhang
Bob Zhang
GLGuangming Lu
Guangming Lu
Image denoising is a critical problem in industrial information applications since noisy images can have adverse effects on the performance of many industrial tasks. Currently, Transformer structures and graph convolutional networks (GCNs) have been widely employed in image denoising to capture long-range dependencies for the performance promotion. These methods, however, severely suffer from three major problems. Initially, the long-range dependencies captured by Transformers and GCNs are only focused on the pixel level and patch level, respectively. This leads to the coarse retrieved feature, hindering further performance promotion. In addition, due to the limited training data, especially for the noisy images with highly diverse and complex noise, the denoising process may lack sufficient feature for reconstructing denoised images. Eventually, the limited training data may also results in over-fitting, leading to poor generalization in the denoising process. This article first proposes adaptive graph prior network (AGP-Net) using a novel graph construction method to capture the long-range dependencies on both the pixel and patch levels. Then, we propose graph supplementary prior and graph noise prior in AGP-Net to adaptively generate supplementary feature and regularization noise for improving the performance and generalization of image denoising. Extensive ablation and benchmark tests show our AGP-Net achieve the most advanced image denoising performance.