Infrared small target detection (IRSTD) is a challenging task, due to the scarce target feature, complex background interferences, and poor image quality. The existing studies handle the IRSTD problem by making specific distribution assumptions of target and background, which incurs two issues. First, the specific assumptions of background cannot always hold. Second, the distorted target distributions contaminated by heavy clutters and noise are difficult to model statically. This article handles the problems from the discriminative and dynamic perspectives and proposes an original mechanism named dynamic image structure evolution (DISE) and a DISE-derived single-frame IRSTD framework. First, we resolve IRSTD by a discriminative model without assuming specific background distributions, which is based on a mathematical definition of structure singularity modeling the ideal target structure. Second, to decouple the target distributions from interferences, DISE guides the distorted target to reveal potential structure singularity, while suppressing the interference signal through iterative procedures of structure collapse, intensity settlement, and collapse convergence. The three functional procedures of DISE perform their own duties regarding target enhancement and background suppression. Moreover, an innovative chain mechanism is introduced to propagate the structure field. Experiments on real datasets demonstrate the superiority of DISE against the state-of-the-art IRSTD methods.
3 February 2021 in IEEE Journal of Selected Topics in Signal Processing
Light field image (LFI) collects radiance from rays in different directions, offers powerful capabilities for immersive media and computer vision. As the high-dimensional data, LFI suffers from spatial as well as angular information distortions in its processing, which brings new challenges to image quality assessment (IQA). Based on the strong ability of tensor about representing high-dimensional data and distortion characteristics of LFI, this paper proposes a method of combining tensor slice and singular value for blind light field image quality assessment (TSSV-LFIQA) to effectively evaluate the quality of LFI content. Specifically, five-order tensor representation of LFI is firstly defined which contains light ray intensity, angular information and color information of the LFI. Secondly, the first slice sharpness measurement and the other slice information distribution are used to describe the tensor slice spatial feature (TSSF) of the LFI. Moreover, singular value angular feature (SVAF) is also proposed to measure the angular consistency of LFI by further unfolding the five-order tensor of LFI and analyzing the percentage of singular values. The experimental results show that benefiting from the combination of TSSF and SVAF, the proposed TSSV-LFIQA method is statistically superior to the existing IQA methods, and matches well with human subjective opinions.
In order to overcome the poor robustness of traditional image registration algorithms in illuminating and solving the problem of low accuracy of a learning-based image homography matrix estimation algorithm, an image registration algorithm based on convolutional neural network (CNN) and local homography transformation is proposed. Firstly, to ensure the diversity of samples, a sample and label generation method based on moving direct linear transformation (MDLT) is designed. The generated samples and labels can effectively reflect the local characteristics of images and are suitable for training the CNN model with which multiple pairs of local matching points between two images to be registered can be calculated. Then, the local homography matrices between the two images are estimated by using the MDLT and finally the image registration can be realized. The experimental results show that the proposed image registration algorithm achieves higher accuracy than other commonly used algorithms such as the SIFT, ORB, ECC, and APAP algorithms, as well as another two learning-based algorithms, and it has good robustness for different types of illumination imaging.
13 July 2021 in IEEE Transactions on Instrumentation and Measurement
Light field image (LFI) records the radiation intensity and direction information of light in scene, offering powerful capabilities for computer vision. It is found that the distortion caused by LFI processing is obviously reflected in the two representations of LFI, that is, subaperture images (SAIs) and microlens images (MLI). Specifically, on the one hand, pseudoreference SAI (PSAI) of a distorted SAI, which is rendered with the adjacent distorted SAIs, can be used to measure the distortion of the involved SAIs. On the other hand, macropixel blocks (MPBs) of MLI can be adopted to measure LFI global angular distortion. Therefore, a PSAIs- and MLI-based blind LFI quality measurement (PM-BLFIQM) method is proposed in this article. First, the local light field (LLF) is defined to generate PSAI of the central distorted SAI in each LLF of LFI, and then a pseudo-full-reference quality measurement metric based on PSAIs is presented. Second, to measure the angular consistency of the distorted LFI, an MLI-based feature extraction scheme is proposed for MPBs and their mean removal version by using discrete cosine transform and singular value decomposition. Finally, the quality of the distorted LFI is predicted with the features extracted from LLFs and MLI. Experimental results demonstrate that both PSAI and MPB are effective for measuring the quality of distorted LFI. In addition, the results on three LFI databases show that the proposed method achieves higher Spearman rank-order correlation coefficient (SROCC) and Pearson linear correlation coefficient (PLCC) values, so it outperforms the state-of-the-art methods in terms of consistency with human visual perception.
Super-resolution (SR) plays an important role in the processing and display of mixed-resolution (MR) stereoscopic images. Therefore, a stereoscopic image SR method based on view incorporation and convolutional neural networks (CNN) is proposed. For a given MR stereoscopic image, the left view of which is observed in full resolution, while the right view is viewed in low resolution, the SR method is implemented in two stages. In the first stage, a view difference image is defined to represent the correlation between views. It is estimated by using the full-resolution left view and the interpolated right view as input to the modified CNN. Accordingly, a high-precision view difference image is obtained. In the second stage, to incorporate the estimated right view in the first stage, a global reconstruction constraint is presented to make the estimated right view consistent with the low-resolution right view in terms of the MR stereoscopic image observation model. Experimental results demonstrated that, compared with the SR convolutional neural network (SRCNN) method and depth map based SR method, the proposed method improved the reconstructed right view quality by 0.54 dB and 1.14 dB, respectively, in the Peak Signal to Noise Ratio (PSNR), and subjective evaluation also implied that the proposed method produced better reconstructed stereoscopic images.
1 February 2021 in Journal of Visual Communication and Image Representation