Under the framework of a supervised learning-based automatic target recognition (ATR) approach, recognition performance is primarily dependent on the amount of training samples. However, shortage in training samples is a consistent issue for ATR. In this article, we propose a new image to image generation method, called label-directed generative adversarial networks (LDGANs), which will provide labeled samples to be used for recognition model training. We define an entirely new loss function for the LDGAN, which utilizes the Wasserstein distance to replace the original distance measurement of the conventional generative adversarial networks (GANs), thus efficiently avoiding the collapse mode problem. The label information is also added to the loss function of the LDGAN to avoid generating a large number of unlabeled target images. More importantly, the proposed method also makes corresponding changes to the network architecture regarding the new GANs. At the same time, the detailed algorithm about the LDGAN is also introduced in this article to deal with the issue that characteristically GANs are not easy to train. Based on comparisons with other directed generation methods, the experimental results show comparative results of several types of generated images in statistical features, gradient features, classic features of synthetic aperture radar (SAR) targets and the independence from the real image. While demonstrating that the images generated by the LDGAN produced better results using the assumptions of independent and identical distribution, the experiment also explores the performance of the generated image in the ATR. A comparison of these experimental results demonstrates a better way to use the generated image for ATR. The experimental results also prove that the proposed method does have the ability to supplement information for ATR when the training sample information is insufficient.

In recent years, deep convolutional neural networks (DCNNs) have been widely used in the task of ship target detection in synthetic aperture radar (SAR) imagery. However, the vast storage and computational cost of DCNN limits its application to spaceborne or airborne onboard devices with limited resources. In this paper, a set of lightweight detection networks for SAR ship target detection are proposed. To obtain these lightweight networks, this paper designs a network structure optimization algorithm based on the multi-objective firefly algorithm (termed NOFA). In our design, the NOFA algorithm encodes the filters of a well-performing ship target detection network into a list of probabilities, which will determine whether the lightweight network will inherit the corresponding filter structure and parameters. After that, the multi-objective firefly optimization algorithm (MFA) continuously optimizes the probability list and finally outputs a set of lightweight network encodings that can meet the different needs of the trade-off between detection network precision and size. Finally, the network pruning technology transforms the encoding that meets the task requirements into a lightweight ship target detection network. The experiments on SSDD and SDCD datasets prove that the method proposed in this paper can provide more flexible and lighter detection networks than traditional detection networks.

Since there are differences in the natural frequency of various synthetic aperture radar (SAR) target samples in reality, the problem of imbalanced data on the automatic target recognition (ATR) model gradually appears in recent years. The problem makes the classification boundary learned by the ATR model often fuzzy or even wrong. In this paper, a SAR target sample generation method was proposed, called demand-driven generative adversarial nets (DDGAN), which provided an effective way to implement imbalanced data learning. When the imbalanced data exacerbated the deterioration of the minority category target samples distribution, the proposed method generated samples to alleviate this negative impact. The proposed method innovatively used two convolutional neural networks to form the discriminator of DDGAN. Among them, a convolutional neural network was used to determine whether the generated sample is real or fake. Moreover, another convolutional neural network can simultaneously dig out the generation demands of different categories of target samples when recognizing the generated samples. The generation demands enabled DDGAN to allocate different generation capabilities to different target samples on demand, thereby alleviating the negative impact of data imbalance. At the same time, DDGAN can autonomously learn the generation demands from imbalanced training sets. Several experimental results based on the Moving and Stationary Target Acquisition and Recognition (MSTAR) data set showed the advantages of DDGAN. Compared with existing imbalanced learning algorithms, the proposed method had obvious superiority in recognition performance and data generation efficiency.

Noncontact gesture recognition is gradually being applied to emerging applications, such as smart cars and smart phones. Negative latency gesture recognition (recognition before a gesture is finished) is desirable due to the instantaneous feedback. However, it is difficult for existing methods to achieve a high precision and negative latency gesture recognition. A fragment can provide too few features to directly identify all gestures well. By observing a large number of existing gesture sets and people's daily operating habits, we found that some high frequency used gestures are similar. To the best of our knowledge, it is the first time to redivide the gestures into two subsets according to their movement physical states. We divided the gestures with different shapes or motion states into a parent-class subset, and further divided each pair of parent-class gestures to obtain a child-class subset. In order to achieve a better tradeoff between the high-precision and negative latency, an approach of motion pattern and behavior intention (MPBI) is proposed. Taking full advantage of the characteristics of each subset, MPBI includes two models. First, pattern model coarsely classify the parent-class gestures by a convolutional network, and then intention model further classifies child-class gestures according to their opposite motion direction. MPBI is evaluated on a 340-GHz terahertz radar. With the advantage of its accurate ranging, intention model can recognize child-class gestures directly without training. MPBI is evaluated on 12 gestures and achieves a recognition accuracy of 94.13%, which only needs a 0.033-s gesture fragment as an input sample.

With the maturity of synthetic aperture radar (SAR) technology, the problem of imbalanced data has gradually emerged. This problem makes it difficult for the automatic target recognition (ATR) model to properly learn the classification boundaries of majority and minority category target samples. In this article, we propose an ATR model with new architecture, called the cost-sensitive awareness-based automatic target recognition (CA-ATR) model, which provides an effective way of solving the problem of imbalanced data. Aimed at the two issues caused by imbalanced data on ATR models, the proposed method solves the problems from both the data and algorithm levels. At the data level, CA-ATR avoids adverse correlations among the target samples through different oversampling methods. By making the ATR model cost-sensitive, the proposed method also avoids the empirical risk preference of the ATR model for majority category target samples at the algorithm-level. At the same time, CA-ATR can autonomously learn different cost-sensitive awareness from different imbalanced data sets. The awareness enables the ATR model to more accurately learn the classification boundaries between target samples that belong in different categories. Several experimental results show the superiority of the proposed approach based on the Moving and Stationary Target Acquisition and Recognition (MSTAR) data set. Compared with other imbalanced learning methods, the proposed method is able to solve different types of imbalanced data problems.

Although automatic target recognition (ATR) models based on data-driven algorithms have achieved excellent performance in recent years, the synthetic aperture radar (SAR) ATR model often suffered from performance degradation when it encountered a small sample set. In this paper, an integrated counterfactual sample generation and filtering approach is proposed to alleviate the negative influence of a small sample set. The proposed method consists of a generation component and a filtering component. First, the proposed generation component utilizes the overfitting characteristics of generative adversarial networks (GANs), which ensures the generation of counterfactual target samples. Second, the proposed filtering component is built by learning different recognition functions. In the proposed filtering component, multiple SVMs trained by different SAR target sample sets provide pseudo-labels to the other SVMs to improve the recognition rate. Then, the proposed approach improves the performance of the recognition model dynamically while it continuously generates counterfactual target samples. At the same time, counterfactual target samples that are beneficial to the ATR model are also filtered. Moreover, ablation experiments demonstrate the effectiveness of the various components of the proposed method. Experimental results based on the Moving and Stationary Target Acquisition and Recognition (MSTAR) and OpenSARship dataset also show the advantages of the proposed approach. Even though the size of the constructed training set was $14.5\%$ of the original training set, the recognition performance of the ATR model reached $91.27\%$ with the proposed approach.