Due to the absorption and scattering of light in water, captured underwater images often suffer from some degradation, such as color cast, blur, and low contrast. These types of degradation usually affect and degrade the performance of computer vision methods and tasks under water. In order to solve these problems, in this paper, we propose a multi-stage and gradually optimized underwater image enhancement deep network, named DLRNet, based on dual layers regression. Our network emphasizes important information by aggregating different depth features in the channel attention module, and the dual-layer regression module is designed with regression to obtain the ambient light and scene light transmission for an underwater image. Then, with the underwater imaging model, the enhanced underwater image for a degraded image can be obtained with normal color, higher clarity, and contrast. The experiments on some different datasets with qualitative analysis and quantitative evaluations validate our network, and show that it outperforms some state-of-the-art approaches.
Hyperspectral anomaly detection is an important unsupervised binary classification problem that aims to effectively distinguish between background and anomalies in hyperspectral images (HSIs). In recent years, methods based on low-rank tensor representations have been proposed to decompose HSIs into low-rank background and sparse anomaly tensors. However, current methods neglect the low-rank information in the spatial dimension and rely heavily on the background information contained in the dictionary. Furthermore, these algorithms show limited robustness when the dictionary information is missing or corrupted by high level noise. To address these problems, we propose a novel method called multi-dimensional low-rank (MDLR) for HSI anomaly detection. It first reconstructs three background tensors separately from three directional slices of the background tensor. Then, weighted schatten p-norm minimization is employed to enforce the low-rank constraint on the background tensor, and -norm regularization is used to describe the sparsity in the anomaly tensor. Finally, a well-designed alternating direction method of multipliers (ADMM) is employed to effectively solve the optimization problem. Extensive experiments on four real-world datasets show that our approach outperforms existing anomaly detection methods in terms of accuracy.
14 November 2023 in International Journal of Computer Vision
Hyperspectral images (HSIs) have high spectral resolution and low spatial resolution. HSI super-resolution (SR) can enhance the spatial information of the scene. Current SR methods have generally focused on the direct utilization of image structure priors, which are often modeled in global or local lower-order image space. The spatial and spectral hidden priors, which are accessible from higher-order space, cannot be taken advantage of when using these methods. To solve this problem, we propose a higher-order Hankel space-based hyperspectral image-multispectral image (HSI-MSI) fusion method in this paper. In this method, the higher-order tensor represented in the Hankel space increases the HSI data redundancy, and the hidden relationships are revealed by the nonconvex penalized Kronecker-basis-representation-based tensor sparsity measure (KBR). Weighted 3D total variation (W3DTV) is further applied to maintain the local smoothness in the image structure, and an efficient algorithm is derived under the alternating direction method of multipliers (ADMM) framework. Extensive experiments on three commonly used public HSI datasets validate the superiority of the proposed method compared with current state-of-the-art SR approaches in image detail reconstruction and spectral information restoration.
In this paper, we apply kernel methods to deep convolutional neural network (DCNN) to improve its nonlinear ability. DCNNs have achieved significant improvement in many computer vision tasks. For an image classification task, the accuracy comes to saturation when the depth and width of network are enough and appropriate. The saturation accuracy will not rise even by increasing the depth and width. We find that improving nonlinear ability of DCNNs can break through the saturation accuracy. In a DCNN, the former layer is more inclined to extract features and the latter layer is more inclined to classify features. Therefore, we apply kernel methods at the last fully connected layer to implicitly map features to a higher-dimensional space to improve nonlinear ability so that the network achieves better linear separability. Also, we name the network as fully kernected neural networks (fully connected neural networks with kernel methods). Our experiment result shows that fully kernected neural networks achieve higher classification accuracy and faster convergence rate than baseline networks.
Light scattering and attenuation in water degrade underwater images with low visibility and color distortion, which often interfere with the high-level visual tasks of underwater autonomous robots. Most existing deep learning methods for underwater image enhancement only supervise the final output of network and ignore the promotion effect of the intermediate results on the final feature representation. These supervision methods affect the feature representation ability, network efficiency, and ability. In this paper, we present a novel idea of multiple-stage supervision to guide the network to learn useful features correctly and progressively. With this idea, we propose a pixel-wise Progressive Guided Network (PGN) for underwater image enhancement to take advantage of the network’s intermediate results and promote the final enhancement effect. The Pixel-Wise Attention Module is designed by introducing supervision in each stage to progressively promote the representation ability of the features and the recovered image quality. The experimental results on several datasets demonstrate that our method outperforms recent state-of-the-art underwater image enhancement methods.