In recent years, deep convolutional neural networks (DCNNs) have been widely used in the task of ship target detection in synthetic aperture radar (SAR) imagery. However, the vast storage and computational cost of DCNN limits its application to spaceborne or airborne onboard devices with limited resources. In this paper, a set of lightweight detection networks for SAR ship target detection are proposed. To obtain these lightweight networks, this paper designs a network structure optimization algorithm based on the multi-objective firefly algorithm (termed NOFA). In our design, the NOFA algorithm encodes the filters of a well-performing ship target detection network into a list of probabilities, which will determine whether the lightweight network will inherit the corresponding filter structure and parameters. After that, the multi-objective firefly optimization algorithm (MFA) continuously optimizes the probability list and finally outputs a set of lightweight network encodings that can meet the different needs of the trade-off between detection network precision and size. Finally, the network pruning technology transforms the encoding that meets the task requirements into a lightweight ship target detection network. The experiments on SSDD and SDCD datasets prove that the method proposed in this paper can provide more flexible and lighter detection networks than traditional detection networks.
29 March 2024 in IEEE Transactions on Mobile Computing
Recently, computation offloading methods have greatly improved the Quality of Experience (QoE) in Multi-access Edge Computing (MEC) by offloading tasks to the edge servers. Since well-coordinated actions of Terminal Devices (TDs) are critical to improving the performance of the entire individual system, many practical MEC-based applications, i.e., firefighting robots and unmanned aerial vehicles, require great teamwork among TDs. However, real-world scenarios are usually bound by resource conditions. For instance, network connectivity may weaken or experience interruptions during emergency situations. In cases where the communication medium is utilized by multiple TDs, achieving effective coordination poses a significant challenge. In this paper, we propose a computation offloading scheme based on Scheduled Multi-agent Deep Reinforcement Learning (SMDRL) to make the most efficient decision in a resource-constrained scenario. First, we design a virtual energy queue based on the MEC system and maximize the QoE (related to service delay and energy consumption) in a real-time manner. Subsequently, we propose a scheduled multi-agent deep reinforcement learning algorithm to support each TD in learning how to encode messages, select actions, and schedule itself based on the received messages. Furthermore, a TopK mechanism is introduced. This mechanism chooses the most crucial TDs to broadcast their messages, and then the computation offloading problem in a communication-constrained MEC environment can be solved in a low-communication manner. Also, we prove that even under limited communication conditions, our proposed methods can still lead to the close-to-optimal performance. The final performance analysis shows that the developed scheme has significant advantages over other representative schemes.
10 December 2021 in IEEE Transactions on Geoscience and Remote Sensing
Since there are differences in the natural frequency of various synthetic aperture radar (SAR) target samples in reality, the problem of imbalanced data on the automatic target recognition (ATR) model gradually appears in recent years. The problem makes the classification boundary learned by the ATR model often fuzzy or even wrong. In this paper, a SAR target sample generation method was proposed, called demand-driven generative adversarial nets (DDGAN), which provided an effective way to implement imbalanced data learning. When the imbalanced data exacerbated the deterioration of the minority category target samples distribution, the proposed method generated samples to alleviate this negative impact. The proposed method innovatively used two convolutional neural networks to form the discriminator of DDGAN. Among them, a convolutional neural network was used to determine whether the generated sample is real or fake. Moreover, another convolutional neural network can simultaneously dig out the generation demands of different categories of target samples when recognizing the generated samples. The generation demands enabled DDGAN to allocate different generation capabilities to different target samples on demand, thereby alleviating the negative impact of data imbalance. At the same time, DDGAN can autonomously learn the generation demands from imbalanced training sets. Several experimental results based on the Moving and Stationary Target Acquisition and Recognition (MSTAR) data set showed the advantages of DDGAN. Compared with existing imbalanced learning algorithms, the proposed method had obvious superiority in recognition performance and data generation efficiency.
2 April 2021 in IEEE Transactions on Geoscience and Remote Sensing
With the maturity of synthetic aperture radar (SAR) technology, the problem of imbalanced data has gradually emerged. This problem makes it difficult for the automatic target recognition (ATR) model to properly learn the classification boundaries of majority and minority category target samples. In this article, we propose an ATR model with new architecture, called the cost-sensitive awareness-based automatic target recognition (CA-ATR) model, which provides an effective way of solving the problem of imbalanced data. Aimed at the two issues caused by imbalanced data on ATR models, the proposed method solves the problems from both the data and algorithm levels. At the data level, CA-ATR avoids adverse correlations among the target samples through different oversampling methods. By making the ATR model cost-sensitive, the proposed method also avoids the empirical risk preference of the ATR model for majority category target samples at the algorithm-level. At the same time, CA-ATR can autonomously learn different cost-sensitive awareness from different imbalanced data sets. The awareness enables the ATR model to more accurately learn the classification boundaries between target samples that belong in different categories. Several experimental results show the superiority of the proposed approach based on the Moving and Stationary Target Acquisition and Recognition (MSTAR) data set. Compared with other imbalanced learning methods, the proposed method is able to solve different types of imbalanced data problems.
In recent years, deep convolutional neural networks (DCNNs) have been widely used for object detection tasks in remote sensing images. However, the over-parametrization problem of DCNNs hinders their application in resource-constrained remote sensing devices. In order to solve this problem, we propose a network pruning method (named absorption pruning) to compress the remote sensing object detection network. Unlike the classical iterative three-stage pruning pipeline used in existing methods, absorption pruning is designed as a four-stage pruning pipeline that only needs to be executed once, which differentiates it from existing methods. Furthermore, the absorption pruning no longer identifies unimportant filters, as in existing pruning methods, but instead selects filters that are easy to learn. In addition, we design a method for pruning ratio adjustment based on the object characteristics in remote sensing images, which can help absorption pruning to better compress deep neural networks for remote sensing image processing. The experimental results on two typical remote sensing data sets—SSDD and RSOD—demonstrate that the absorption pruning method not only can remove 60% of the filter parameters from CenterNet101 harmlessly but also eliminate the over-fitting problem of the pre-trained network.
17 February 2025 in IEEE Transactions on Consumer Electronics
With the rapid proliferation of smartphones and various terminal devices, edge computing has gained increasing importance in overcoming computational limitations and enhancing service quality through task offloading. However, most existing approaches handle tasks on a first-come, first-served basis, neglecting task prioritization, which is critical in real-world scenarios where tasks have different levels of urgency and resource requirements. This paper addresses the challenge of effective task prioritization in multi-agent task offloading by proposing a Nash Q-learning-based strategy. Our methodology involves optimizing task allocation decisions using Nash Q-learning to integrate Nash equilibrium principles, thereby enhancing adaptability and dynamic decision-making capabilities within a multi-agent environment. The proposed algorithm is evaluated through extensive simulations, comparing total delay, resource utilization, and task success rates across various task offloading strategies. The results demonstrate that our Nash Q-learning approach outperforms conventional techniques by dramatically lowering overall latency, optimizing resource allocation, and maintaining high task success rates. This work demonstrates the efficacy of Nash Q-learning for dynamically setting priorities for tasks in multi-agent edge computing environments, providing a robust framework for effective resource management and collaborative task completion. And also highlight the potential of Nash Q-learning in advancing intelligent task management in edge computing, suggesting its applicability in real-world, resource-constrained environments.