14 May 2021 in IEEE Access
Tone-mapping operator (TMO) is intended to convert high dynamic range (HDR) content into a lower dynamic range so that it can be displayed on a standard dynamic range (SDR) device. The tone-mapped result of HDR content is usually stored as SDR image. For different HDR scenes, traditional TMOs are able to obtain a satisfying SDR image only under manually fine-tuned parameters. In this paper, we address this problem by proposing a learning-based TMO using deep convolutional neural network (CNN). We explore different CNN structure and adopt multi-scale and multi-branch fully convolutional design. When training deep CNN, we introduce image quality assessments (IQA), specifically, tone-mapped image quality assessment, and implement it as semi-supervised loss terms. We discuss and prove the effectiveness of semi-supervised loss terms, CNN structure, data pre-processing, etc. by several experiments. Finally, we demonstrate that our approach can produce appealing results under diversified HDR scenes.
21 December 2020 in IEEE Transactions on Computational Imaging
Whole slide imaging (WSI) is an emerging technology for digital pathology. The accuracy and speed of autofocusing are critical for the performance of the WSI system. This paper introduces a novel technique of deep autofocusing for WSI. Instead of mechanically adjusting the focal distance on a tile-by-tile basis, we develop a deep convolutional neural network for tile-wise autofocusing to generate in-focus images from tentative possibly defocused images. This deep autofocusing network (DAFNet) works with only two images taken at different focal distances; in contrast, traditional methods need to take, for each tile of the target ultra high-resolution pathology image, a stack of as many as 21 shots with varying focal distances. The novel architecture design of DAFNet facilitates the fusion of complementary information of the two input images of different focal distances. The proposed off-line reconstruction strategy allows high throughput scanning of sample slides done without compromising image quality, because DAFNet can rectify errors in focal distance and bring the scanned tiles back into focus by learnt non-linear dual-input blur-to-sharp mapping. Experimental results demonstrate the refocusing capability of the DAFNet method.
30 September 2023 in Expert Systems with Applications
5 January 2024 in Journal of the Optical Society of America A
An untrained neural network (UNN) paves a new way to realize lensless imaging from single-frame intensity data. Based on the physics engine, such methods utilize the smoothness property of a convolutional kernel and provide an iterative self-supervised learning framework to release the needs of an end-to-end training scheme with a large dataset. However, the intrinsic overfitting problem of UNN is a challenging issue for stable and robust reconstruction. To address it, we model the phase retrieval problem into a dual-constrained untrained network, in which a phase-amplitude alternating optimization framework is designed to split the intensity-to-phase problem into two tasks: phase and amplitude optimization. In the process of phase optimization, we combine a deep image prior with a total variation prior to retrain the loss function for the phase update. In the process of amplitude optimization, a total variation denoising-based Wirtinger gradient descent method is constructed to form an amplitude constraint. Alternative iterations of the two tasks result in high-performance wavefield reconstruction. Experimental results demonstrate the superiority of our method.
12 June 2023 in Optics Letters
Lensless imaging with a mask is an attractive topic as it enables a compact configuration to acquire wavefront information of a sample with computational approaches. Most existing methods choose a customized phase mask for wavefront modulation and then decode the sample’s wave field from modulated diffraction patterns. Different from phase masks, lensless imaging with a binary amplitude mask facilitates a cheaper fabrication cost, but high-quality mask calibration and image reconstruction have not been well resolved. Here we propose a self-calibrated phase retrieval (SCPR) method to realize a joint recovery of a binary mask and sample's wave field for a lensless masked imaging system. Compared with conventional methods, our method shows a high-performance and flexible image recovery without the help of an extra calibration device. Experimental results of different samples demonstrate the superiority of our method.