Shawn Dong

Mr. Shawn Dong


Research Focus & Metrics

Academic Career Length

4Years (2023-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
6 June 2024 in IEEE Transactions on Geoscience and Remote Sensing
Verified
Journal Article
Closed access
SDShawn Dong
Shawn Dong
DGDahua Gao
Dahua Gao
YLYuyan Li
Yuyan Li
GSGuangming Shi
Guangming Shi
DLDanhua Liu
Danhua Liu
In the Coded Aperture Snapshot Spectral Imaging (CASSI) system, deep unfolding networks (DUNs) have demonstrated excellent performance in recovering 3D hyperspectral images (HSIs) from 2D measurements. However, some noticeable gaps exist between the imaging model used in DUNs and the real CASSI imaging process, such as the sensing error as well as photon and dark current noise, compromising the accuracy of solving the data subproblem and the prior subproblem in DUNs. To address this issue, we propose a Degradation Estimation Network (DEN) to correct the imaging model used in DUNs by simultaneously estimating the sensing error and the noise level, thereby improving the performance of DUNs. Additionally, we propose an efficient Local and Non-local Transformer (LNLT) to solve the prior subproblem, which not only effectively models local and non-local similarities but also reduces the computational cost of the window-based global Multi-head Self-attention (MSA). Furthermore, we transform the DUN into a Recurrent Neural Network (RNN) by sharing parameters of DNNs across stages, which not only allows DNN to be trained more adequately but also significantly reduces the number of parameters. The proposed DERNN-LNLT achieves state-of-the-art (SOTA) performance with fewer parameters on both simulation and real datasets. Code: https://github.com/ShawnDong98/DERNN-LNLT.

3 May 2024 in IEEE Transactions on Vehicular Technology
Verified
Journal Article
Closed access
GSGuangming Shi
Guangming Shi
HLHaixiong Li
Haixiong Li
DGDahua Gao
Dahua Gao
MYMinxi Yang
Minxi Yang
SDShawn Dong
Shawn Dong
Despite deep learning's progress in semantic communication, traditional fixed-length encoding does not adequately address the variable complexity of semantic content, often leading to loss of critical nuances and reduced communication accuracy. Current methods also introduce unnecessary redundancy, compromising transmission efficiency. Addressing these challenges, our work introduces an innovative adaptive rate encoding mechanism that captures the intrinsic semantics of images and fine-tunes the coding rate based on semantic interconnection probability. We employ a cross-attention model to construct a layered semantic probability graph parsed into a hierarchical semantic tree, which represents the probabilistic relationships of image semantics and unravels the latent semantic structure. This not only delineates the image's semantic architecture but also enables our adaptive encoding to dynamically allocate resources, minimizing redundancy and enhancing efficiency. Our experiments confirm that our approach provides a more judicious bit allocation to complex image features and allocates more bits to semantically rich features while achieving superior compression of simpler content. The proposed method not only improves upon existing semantic fidelity metrics but also reduces the bit demand for transmitting complex images. Our adaptive encoding strategy represents a significant stride in leveraging the endogenous semantic information of images for more accurate and efficient communication.

8 May 2024 in Remote Sensing
Verified
Journal Article
Open access
PDF file
YLYuyan Li
Yuyan Li
SDShawn Dong
Shawn Dong
HLHaoyong Li
Haoyong Li
DLDanhua Liu
Danhua Liu
XFXue Fang
Xue Fang
DGDahua Gao
Dahua Gao
In hyperspectral image (HSI) reconstruction tasks, due to the lack of ground truth in real imaging processes, models are usually trained and validated on simulation datasets and then tested on real measurements captured by real HSI imaging systems. However, due to the gap between the simulation imaging process and the real imaging process, the best model validated on the simulation dataset may fail on real measurements. To obtain the best model for the real-world task, it is crucial to design a suitable no-reference HSI quality assessment metric to reflect the reconstruction performance of different models. In this paper, we propose a novel no-reference HSI quality assessment metric via ranking feature learning (R-NHSIQA), which calculates the Wasserstein distance between the distribution of the deep features of the reconstructed HSIs and the benchmark distribution. Additionally, by introducing the spectral self-attention mechanism, we propose a Spectral Transformer (S-Transformer) to extract the spatial-spectral representative deep features of HSIs. Furthermore, to extract quality-sensitive deep features, we use quality ranking as a pre-training task to enhance the representation capability of the S-Transformer. Finally, we introduce the Wasserstein distance to measure the distance between the distribution of the deep features and the benchmark distribution, improving the assessment capacity of our method, even with non-overlapping distributions. The experimental results demonstrate that the proposed metric yields consistent results with multiple full-reference image quality assessment (FR-IQA) metrics, validating the idea that the proposed metric can serve as a substitute for FR-IQA metrics in real-world tasks.

18 August 2025 in IEEE Transactions on Image Processing
Verified
Journal Article
Closed access
SDShawn Dong
Shawn Dong
DGDahua Gao
Dahua Gao
DLDanhua Liu
Danhua Liu
YLYanli Liu
Yanli Liu
GSGuangming Shi
Guangming Shi
Coded Aperture Snapshot Spectral Imaging (CASSI) multiplexes 3D Hyperspectral Images (HSIs) into a 2D sensor to capture dynamic spectral scenes, which, however, sacrifices the spatial information. Dual-Camera Compressive Hyperspectral Imaging (DCCHI) enhances CASSI by incorporating a Panchromatic (PAN) camera to compensate for the loss of spatial information in CASSI. However, the dual-camera structure of DCCHI disrupts the diagonal property of the product of the sensing matrix and its transpose, making it difficult to efficiently and accurately solve the data subproblem in closed-form and thereby hindering the application of model-based methods and Deep Unfolding Networks (DUNs) that rely on such a closed-form solution. To address this issue, we propose an Alternating Direction DUN, named ADRNN, which decouples the imaging model of DCCHI into a CASSI subproblem and a PAN subproblem. The ADRNN alternately solves data terms analytically and a joint prior term in these subproblems. Additionally, we propose a Cross Spectral Transformer (XST) to exploit the joint prior. The XST utilizes cross spectral attention to exploit the correlation between the compressed HSI and the PAN image, and incorporates Grouped-Query Attention (GQA) to alleviate the burden of parameters and computational cost brought by impartially treating the compressed HSI and the PAN image. Furthermore, we built a real DCCHI system and captured large-scale indoor and outdoor scenes for future academic research. Extensive experiments on both simulation and real datasets demonstrate that the proposed method achieves state-of-the-art (SOTA) performance. The code and datasets have been open-sourced at: https://github.com/ShawnDong98/ADRNN-XST.

30 April 2025 in Remote Sensing
Verified
Journal Article
Open access
PDF file
AGAng Gao
Ang Gao
SDShawn Dong
Shawn Dong
DLDanhua Liu
Danhua Liu
ALAnqi Li
Anqi Li
ZLZhenyuan Lin
Zhenyuan Lin
YLYuyan Li
Yuyan Li
Reconstructing hyperspectral images (HSIs) from RGB images is an effective technique to overcome the high cost of spectrometers. Recently, Transformers have shown potential in capturing long-range dependencies for spectral reconstruction. However, few Transformer models attempt to simultaneously capture both spatial and spectral correlations in HSIs. Within this study, we introduce an integrated spatial–spectral hybrid Transformer (SSHFormer) framework designed to capture the interplay between spatial and spectral features in HSIs, with the aim of incrementally enhancing the fidelity of the reconstructed HSIs. In SSHFormer, we propose a spatial–spectral multi-head self-attention (SSMA) mechanism, which utilizes dilated convolution to extract non-local spatial features while maintaining parameter efficiency and applies the attention mechanism to the channel dimension to model inter-spectral correlations. Additionally, a 3D feedforward network (3DFFN) is proposed for SSHFormer, which leverages 3D convolution to fuse the spatial and spectral information, enabling more comprehensive feature extraction. Experimental results demonstrate that our SSHFormer achieves state-of-the-art (SOTA) performance on public datasets.

15 November 2023 in arXiv
Verified
Preprint
Open access
PDF file
SDShawn Dong
Shawn Dong
DGDahua Gao
Dahua Gao
TQTian Qiu
Tian Qiu
YLYuyan Li
Yuyan Li
MYMinxi Yang
Minxi Yang
GSGuangming Shi
Guangming Shi
To acquire a snapshot spectral image, coded aperture snapshot spectral imaging (CASSI) is proposed. A core problem of the CASSI system is to recover the reliable and fine underlying 3D spectral cube from the 2D measurement. By alternately solving a data subproblem and a prior subproblem, deep unfolding methods achieve good performance. However, in the data subproblem, the used sensing matrix is ill-suited for the real degradation process due to the device errors caused by phase aberration, distortion; in the prior subproblem, it is important to design a suitable model to jointly exploit both spatial and spectral priors. In this paper, we propose a Residual Degradation Learning Unfolding Framework (RDLUF), which bridges the gap between the sensing matrix and the degradation process. Moreover, a Mix$S^2$ Transformer is designed via mixing priors across spectral and spatial to strengthen the spectral-spatial representation capability. Finally, plugging the Mix$S^2$ Transformer into the RDLUF leads to an end-to-end trainable neural network RDLUF-Mix$S^2$. Experimental results establish the superior performance of the proposed method over existing ones.