Optical neural network can process information in parallel by using the technology based on free-space and integrated platform. Over the last half century, the development of integrated circuits has been limited by Moore’s law. We know that neural network is based on the digital computer for successive calculation, most of which cannot be made into real-time processing system. Therefore, it is necessary to develop ONN for real-time processing and device miniaturization. In this paper, we review the progress of optical neural networks. Firstly, based on the principle of artificial neural networks, we elaborate the essence of optical matrix multiplier for linear operation. Then we introduce the optical neural network achieved by free-space optical interconnection and waveguide optical interconnection. Finally we talk about the nonlinearity in optical neural networks. With the gradual maturity of nanotechnology and the rapid advancement of silicon photonic integrated circuits, the progress of integrated photonic neural network has been promoted. Therefore, the construction of optical neural network on the future integrated photonic platform has potential application value.
With the advent of the era of big data, artificial intelligence has attracted continuous attention from all walks of life, and has been widely used in medical image analysis, molecular and material science, language recognition and other fields. As the basis of artificial intelligence, the research results of neural network are remarkable. However, due to the inherent defect that electrical signal is easily interfered and the processing speed is proportional to the energy loss, researchers have turned their attention to light, trying to build neural networks in the field of optics, making full use of the parallel processing ability of light to solve the problems of electronic neural networks. After continuous research and development, optical neural network has become the forefront of the world. Here, we mainly introduce the development of this field, summarize and compare some classical researches and algorithm theories, and look forward to the future of optical neural network.
30 September 2024 in IEEE Transactions on Geoscience and Remote Sensing
The field of remote sensing change detection (RSCD) has seen significant advancements recently, focusing on the precise identification and analysis of temporal changes in remote sensing images. Existing deep learning-based RSCD methods primarily rely on concatenation or subtraction to integrate features of bi-temporal images and reconstruct change features through a feature pyramid network decoding architecture. However, these methods face challenges related to inadequate spatio-temporal change representation and insufficient aggregation of multilevel semantic information, resulting in pseudo-changes and poor completeness of detected change objects. In this paper, we propose an innovative RSCD framework via spatio-temporal feature fusion and guide aggregation (STFF-GA) to address the aforementioned challenges. The architecture of this network comprises two key components: the STFF module and the GA module. The STFF module is designed as a low-parameter and low-computation structure, effectively enhancing the representation of spatio-temporal change information through split, interaction, and fusion strategies. The GA module uses deep feature guidance (DFG) mapping as prior information to guide the aggregation of multi-level semantic information, thereby correcting the positional information of change objects and filtering out pseudo-changes and other noise interference. Additionally, it utilizes convolution kernels of various scales to extract fine-grained features, facilitating the complete reconstruction of change objects. Extensive experiments conducted on three benchmark change detection datasets demonstrate that the proposed STFF-GA consistently outperforms other state-of-the-art detectors. The code is available at https://github.com/NjustHGWei/STFF-GA.
In this paper, we propose a deep learning method for single infrared image optical noise removal. With a fully convolutional neural network, it is able to eliminate the optical noise in a single infrared image. Our architecture consists of two networks: a denoising network and a conditional discriminator. The denoising network takes a noise image as input and outputs a denoising result, while the discriminator tries to make the output look more like the target. Actually, only in the testing phase, this method is feed-forward. Significant image quality in experiments is achieved compared with the existing method. Code is available at https://github.com/Kuangxd/ONR.
26 February 2024 in IEEE Transactions on Geoscience and Remote Sensing
Hyperspectral images (HSIs) with high spatial resolution are challenging to obtain directly due to sensor limitations. Deep learning is able to provide an end-to-end reconstruction solution from low to high spatial resolution. Nevertheless, existing deep learning-based methods have two main drawbacks. First, deep networks with self-attention mechanisms often require a trade-off between internal resolution, model performance and complexity, leading to the loss of fine-grained, high-resolution features. Second, there are visual discrepancies between the reconstructed hyperspectral image (HSI) and the ground truth because they focus on spatial-spectral domain learning. In this paper, a novel super-resolution algorithm for HSIs, named SRDNet, is proposed by using a dual-domain network with hybrid convolution and progressive upsampling to exploit both spatial-spectral and frequency information of the hyperspectral data. In this approach, we design a self-attentive pyramid structure (HSL) to capture interspectral self-similarity in the spatial domain, thereby increasing the receptive range of attention and improving the feature representation of the network. Additionally, we introduce a hyperspectral frequency loss (HFL) with dynamic weighting to optimize the model in the frequency domain and improve the perceptual quality of the HSI. Experimental results on three benchmark datasets show that SRDNet effectively improves the texture information of the HSI and outperforms state-of-the-art methods. The code is available at https://github.com/LTTdouble/SRDNet.