The cooperative positioning problem of hypersonic vehicles regarding LEO constellations is the focus of this research study on space-based early warning systems. A hypersonic vehicle is highly maneuverable, and its trajectory is uncertain. New challenges are posed for the cooperative positioning capability of the constellation. In recent years, breakthroughs in artificial intelligence technology have provided new avenues for collaborative multi-satellite intelligent autonomous decision-making technology. This paper addresses the problem of multi-satellite cooperative geometric positioning for hypersonic glide vehicles (HGVs) by the LEO-constellation-tracking system. To exploit the inherent advantages of hierarchical reinforcement learning in intelligent decision making while satisfying the constraints of cooperative observations, an autonomous intelligent decision-making algorithm for satellites that incorporates a hierarchical proximal policy optimization with random hill climbing (MAPPO-RHC) is designed. On the one hand, hierarchical decision making is used to reduce the solution space; on the other hand, it is used to maximize the global reward and to uniformly distribute satellite resources. The single-satellite local search method improves the capability of the decision-making algorithm to search the solution space based on the decision-making results of the hierarchical proximal policy-optimization algorithm, combining both random hill climbing and heuristic methods. Finally, the MAPPO-RHC algorithm’s coverage and positioning accuracy performance is simulated and analyzed in two different scenarios and compared with four intelligent satellite decision-making algorithms that have been studied in recent years. From the simulation results, the decision-making results of the MAPPO-RHC algorithm can obtain more balanced resource allocations and higher geometric positioning accuracy. Thus, it is concluded that the MAPPO-RHC algorithm provides a feasible solution for the real-time decision-making problem of the LEO constellation early warning system.
Tracking of hypersonic glide vehicles (HGVs) by a constellation tracking and observation system is an important part of the space-based early warning system. The uncertainty in the maneuver intentions of HGVs has a non-negligible impact on the tracking and observation process. The cooperative scheduling of multiple satellites in an environment of uncertainty in the maneuver intentions of HGVs is the main problem researched in this paper. For this problem, a satellite constellation tracking decision method that considers the HGVs’ maneuver intentions is proposed. This method is based on building an HGV maneuver intention model, developing a maneuver intention recognition and prediction algorithm, and designing a sensor-switching strategy to improve the local consensus-based bundle algorithm (LCBBA). Firstly, a recognizable maneuver intention model that can describe the maneuver types and directions of the HGVs in both the longitudinal and lateral directions was designed. Secondly, a maneuver intention recognition and prediction algorithm based on parallel, stacked long short-term memory neural networks (PSLSTM) was developed to obtain maneuver directions of the HGV. On the basis of that, a satellite constellation tracking decision method (referred to as SS-LCBBA in the following) considering the HGVs’ maneuver intentions was designed. Finally, the maneuver intention prediction capability of the PSLSTM network and two currently popular network structures: the multilayer LSTM (M-LSTM) and the dual-channel and bidirectional neural network (DCBNN) were tested for comparison. The simulation results show that the PSLSTM can recognize and predict the maneuver directions of HGVs with high accuracy. In the simulation of a satellite constellation tracking HGVs, the SS-LCBBA improved the cumulative tracking score compared to the LCBBA, the blackboard algorithm (BM), and the variable-center contract network algorithm (ICNP). Thus, it is concluded that SS-LCBBA has better adaptability to environments with uncertain intentions in solving multi-satellite collaborative scheduling problems.