Recent weakly supervised image dehazing (WSID) works have succeeded to improve models’ generalization ability to real scene dehazing by using generative adversarial network (GAN) for unpaired image training. However, it is still difficult for current WSID methods to train one effective dehazing model for various scenes since 1) they always result in residual haze due to insufficient generalization to the feature distribution of real scenes, and 2) they are prone to cause distortions like color shifts, artifacts or halos etc, owing to embedding manual prior or threshold hypothesis for image reconstruction. To solve above problems, in this paper, we propose a novel WSID model via physics-based decomposition (PBD), which estimates atmospheric light, scattering coefficient and scene depth of real haze input to effectively capture the illumination information and haze distribution to recover a preliminary dehazed image by minimizing reconstruction loss. With this constraint, we subtly design a discrete wavelet discriminator (DWD) to effectively improve the generalization to real scene from both spatial and frequency aspect under the supervision of unpaired real clear image. Our PBD is a purely data-driven model freeing from any manual setting or partially correct prior, thus simultaneously ensuring the realness and visibility of dehazed images. Experiments on seven benchmarks verified the strong generalization ability of our PBD, which achieves SOTA dehazing performance with realistic details. Code will be published at https://github.com/NianWang-HJJGCDX/PBD.
Hyperspectral image (HSI) clustering has drawn more and more attention in recent years as it frees us from labor-intensive manual annotation. However, current works cannot fully enjoy the rich spatial and spectral information due to redundant spectral signatures and fixed anchor learning. Moreover, the learned graph always obtains suboptimal results due to the separate affinity estimation and graph symmetry. To address the above challenges, in this paper, we propose large-scale hyperspectral image-projected clustering via doubly stochastic graph learning (HPCDL). Our HPCDL is a unified framework that learns a projected space to capture useful spectral information, simultaneously learning a pixel–anchor graph and an anchor–anchor graph. The doubly stochastic constraints are conducted to learn an anchor–anchor graph with strict probabilistic affinity, directly providing anchor cluster indicators via connectivity. Meanwhile, when using label propagation, pixel-level clustering results are obtained. An efficient optimization strategy is proposed to solve our HPCDL model, requiring monomial linear complexity concerning the number of pixels. Therefore, our HPCDL has the ability to deal with large-scale HSI datasets. Experiments on three datasets demonstrate the superiority of our HPCDL for both clustering performance and the time burden.
26 September 2023 in Journal of Food Measurement and Characterization
Effective feature extraction is a key issue in hyperspectral image (HSI) classification task. Recent works have studied hyperspectral classification models based on various deep architectures. However, the specific architecture cannot fully exploit the complementary diversity of global and local features in HSIs, resulting in suboptimal results. To address these issues, we fully utilize the advantages of GNN and CNN in global and local feature extraction and design a new end-to-end global–local feature fusion enhancement network (GLFFEN). Specifically, we first construct a GNN with dynamically weighted neighbor contributions using superpixel-segmented patches as nodes, named the Graph Attention (GA) branch. Additionally, we design a spatial–spectral feature attention module (SSFAM) to enhance the ability of the CNN to extract spatial and spectral features in local neighborhoods, termed the spatial–spectral feature attention (SSFA) branch. Moreover, a multi-feature adaptive fusion (MAF) module is proposed to solve the problem of weight distribution during global–local feature fusion. Experiments on three well-known HSI datasets have shown that our GLFFEN surpasses state-of-the-art (SOTA) methods on three widely used metrics.