The range resolution of high-resolution wideband radar is much smaller than the target size. Its echo signals tend to be diverse and sensitive to small changes of targets. Therefore, it is difficult to capture and distinguish the features in radar signals. In this article, we propose a radar target recognition pipeline based on a deep nested neural network. The framework consists of three parts: The translation sensitivity of the training data is first addressed in the preprocessing section. The second step is to obtain an embedded representation of the radar echo signals by the combination of the adjustment layer, convolutional neural network (CNN), and the squeeze and excitation (SE) block. Finally, the target is recognized through inputting embedded representation as a time sequence into the stacked bidirectional recurrent neural network (bi-RNN) based on an attention mechanism. Compared with the traditional methods, the proposed deep nested neural network extracts and takes advantage of the features of radar echo signals more effectively, including the envelope features and local physical structural features. The experimental results based on the test data indicate that the proposed method has a great advantage over other methods in the case of large data sets as well as small training data sets and is robust to the small translation of test samples and noises, exhibiting high engineering practical value.

In radar high-resolution range profile (HRRP)-based target recognition, one of the most challenging tasks is the noncooperative target recognition with imbalanced training data set. This letter presents a novel recognition framework to deal with this problem. The framework is composed of two steps: first, the t-distributed stochastic neighbor embedding (t-SNE) and synthetic sampling are utilized for data preprocessing to provide a well segmented and balanced HRRP data set; second, a discriminant deep belief network (DDBN) is proposed to recognize HRRP data. Compared with the conventional recognition models, the proposed framework not only makes better use of data set inherent structure among HRRP samples for segmentation, but also utilizes high-level features for recognition. Moreover, the DDBN shares latent information of HRRP data globally, which can enhance the ability of modeling the aspect sectors with few HRRP data. The experiments illustrate the meaning of the t-SNE, and validate the effectiveness of the proposed recognition framework with imbalanced HRRP data.

Underwater vision-based detection plays an increasingly important role in underwater security, ocean exploration and other fields. Due to the absorption and scattering effects of water on light, as well as the movement of the carrier, underwater images generally have problems such as noise pollution, color cast and motion blur, which seriously affect the performance of underwater vision-based detection. To address these problems, this study proposes an end-to-end marine organism detection framework that can jointly optimize the image enhancement and object detection. The framework uses a two-stage detection network with dynamic intersection over union (IoU) threshold as the backbone and adds an underwater image enhancement module (UIEM) composed of denoising, color correction and deblurring sub-modules to greatly improve the framework’s ability to deal with severely degraded underwater images. Meanwhile, a self-built dataset is introduced to pre-train the UIEM, so that the training of the entire framework can be performed end-to-end. The experimental results show that compared with the existing end-to-end models applied to marine organism detection, the detection precision of the proposed framework can improve by at least 6%, and the detection speed has not been significantly reduced, so that it can complete the high-precision real-time detection of marine organisms.

To improve the catastrophic forgetting that existed in the high-resolution range profile (HRRP) target recognition model of offline training, this paper proposed a continuous learning method of radar HRRP based on conditional variational auto-encoding and generative adversarial network (CVAE-GAN). Firstly, this method generates data through CVAE to simulate the real training data, and replays it in the series of subsequent tasks. By using generators, the proposed method does not need to save the original HRRP data and can ensure the privacy of the training dataset. Secondly, the proposed method takes the categorical data label as a generating condition, solves the unbalanced categories of the generated data samples, and improves the accuracy of the radar HRRP target recognition. Finally, by combining the attention mechanism and GAN network of the transformer, the generative capacity of the CVAE generator is enhanced effectively. In this paper, the continuous learning method is verified by a validation framework with three task settings. The experimental results show that the proposed method has a better continuous learning ability and better engineering practicality in various tasks compared with the previous regularization methods which can guarantee the privacy of the training dataset.

This paper presents an efficient underwater image enhancement method, named ECO-GAN, to address the challenges of color distortion, low contrast, and motion blur in underwater robot photography. The proposed method is built upon a preprocessing framework using a generative adversarial network. ECO-GAN incorporates a convolutional neural network that specifically targets three underwater issues: motion blur, low brightness, and color deviation. To optimize computation and inference speed, an encoder is employed to extract features, whereas different enhancement tasks are handled by dedicated decoders. Moreover, ECO-GAN employs cross-stage fusion modules between the decoders to strengthen the connection and enhance the quality of output images. The model is trained using supervised learning with paired datasets, enabling blind image enhancement without additional physical knowledge or prior information. Experimental results demonstrate that ECO-GAN effectively achieves denoising, deblurring, and color deviation removal simultaneously. Compared with methods relying on individual modules or simple combinations of multiple modules, our proposed method achieves superior underwater image enhancement and offers the flexibility for expansion into multiple underwater image enhancement functions.

Recently, egocentric activity recognition has attracted considerable attention in the pattern recognition and artificial intelligence communities because of its wide applicability in medical care, smart homes, and security monitoring. In this study, we developed and implemented a deep-learning-based hierarchical fusion framework for the recognition of egocentric activities of daily living (ADLs) in a wearable hybrid sensor system comprising motion sensors and cameras. Long short-term memory (LSTM) and a convolutional neural network are used to perform egocentric ADL recognition based on motion sensor data and photo streaming in different layers, respectively. The motion sensor data are used solely for activity classification according to motion state, while the photo stream is used for further specific activity recognition in the motion state groups. Thus, both motion sensor data and photo stream work in their most suitable classification mode to significantly reduce the negative influence of sensor differences on the fusion results. Experimental results show that the proposed method not only is more accurate than the existing direct fusion method (by up to 6%) but also avoids the time-consuming computation of optical flow in the existing method, which makes the proposed algorithm less complex and more suitable for practical application.