Semantic segmentation technology based on Inverse Synthetic Aperture Radar (ISAR) images can provide crucial perception and analytical capabilities for intelligent safety maintenance of on-orbit spacecraft. However, conventional semantic segmentation methods suffer from three main limitations: firstly, the lack of modeling for radar physical characteristics in the “image first, segment later” pipeline leads to loss of scattering information and phase details; secondly, reliance on extensive pixel-level manual annotation increases application costs; thirdly, ineffective utilization of spacecraft structural priors fails to guide networks to focus on the main body and edges of spacecraft segmentation. To address these issues, this paper proposes a complex-domain semantic segmentation framework named One-Stop Segmentation (OSS) based on ISAR echoes. The framework incorporates two innovative modules: an Automatic ISAR Labeling (AIL) method designed based on ISAR scattering characteristics to generate labels corresponding to ISAR echoes, and a complex-domain semantic segmentation network named One-Stop Segmentation Network (OSSNet) that performs semantic segmentation directly on echoes, avoiding information loss from imaging while shortening the data processing chain. Core contributions of OSSNet include: (1) a Domain Alignment Module (DAM) to effectively mitigate domain mismatch caused by data distribution differences between raw echo signals and labels; (2) a Multi-Perspective Attention (MPA) framework incorporating a Sliding Correlation Attention (SCA) module and a Subdomain Balanced Attention (SBA) module, lever-aging spacecraft structural priors to guide the network’s focus on main structures and edge details from complementary perspectives, significantly improving segmentation ac-curacy. Experimental results on a simulated ground-based radar dataset demonstrate that the proposed OSS framework achieves a mean Intersection over Union (mIoU) of 92.13% and a mean F1-score of 95.75% in ISAR spacecraft semantic segmentation tasks, outperforming existing methods.
In ground-based space surveillance, space target attitude estimation is critical for space situational awareness, yet existing methods based on inverse synthetic aperture radar (ISAR) images suffer from three core limitations: phase information is discarded in amplitude-only processing, convolutional neural networks have a restricted global receptive field, and the physical topology of satellite components is not explicitly modeled. To address these issues, we propose a complex-domain Transformer–graph neural network (CD-TrGNN) that unifies global context modeling and adaptive topological reasoning in an end-to-end framework. Specifically, a complex-domain Transformer module (CD-Transformer) with tailored attention captures long-range dependencies among image patches while preserving both amplitude and phase information; a complex-domain graph convolution module (CD-GC) with learnable adjacency matrices and a dual-path update mechanism explicitly encodes the structural relationships among satellite parts. On a self-built ISAR complex image dataset, CD-TrGNN achieves a three-axis mean absolute error of only 1.70°, substantially outperforming six representative baselines. Ablation experiments confirm the effectiveness of complex-domain processing, global attention, and topological reasoning. At a 5 dB signal-to-noise ratio, the error remains at 2.81°, and the accuracy stays below 2° for two different satellite structures. These results demonstrate that CD-TrGNN can fully exploit the information in ISAR complex images, enabling high-accuracy and highly robust attitude estimation.
Segmenting key components of space targets using Inverse Synthetic Aperture Radar (ISAR) images is an important interpretation task in space situational awareness. However, the scarcity of pixel-level annotated data, inter-class confusion caused by morphological differences among multiple target classes, and the absence of structural priors for components restrict the performance improvement in existing deep models on this task. Therefore, this paper proposes a Semi-Supervised Structural Prior-Guided Network (SSPNet). First, a Gated Manifold-Constrained Hyper-Connections Vision Transformer (GMHC-ViT) encoder is proposed to broaden the feature representation space via parallel multi-feature streams with adaptive gating, thereby alleviating inter-class confusion and enhancing cross-category generalization. Second, a Prior-Guided Module (PGM) is proposed to extract shape and edge priors of components, and it adaptively enhances the weakly activated channels of encoder features through cross-attention, thereby injecting structural knowledge independent of image quality into the segmentation process. Furthermore, to effectively leverage large amounts of unlabeled data, a strong perturbation strategy tailored to the characteristics of ISAR images is designed for consistency regularization. Experimental results on a simulated ISAR dataset containing 38 classes of space targets demonstrate that SSPNet outperforms existing methods and exhibits strong segmentation capability even under low signal-to-noise ratio (SNR) conditions.
Inverse Synthetic Aperture Radar (ISAR) imagery plays a crucial role in space situational awareness, yet its interpretation remains largely confined to tasks such as classification and segmentation, lacking the ability to generate detailed natural language captions. To address this limitation, this paper proposes ISARCap 1.0, the first dataset specifically designed for ISAR image captioning, covering 38 classes of space targets and comprising 102,965 simulated images and 514,825 image–text pairs. On this basis, this paper proposes ISAR-Mamba, a dual-stream gated state space model for ISAR image captioning. The model introduces a Dual-Stream Asymmetric Encoder (DSAE), which performs complementary patch partitioning and scanning along the range and azimuth dimensions, respectively, to accommodate the physical dimensional differences of ISAR images. Meanwhile, a Sparsity-Aware Gating Mechanism (SAGM) is introduced, which jointly suppresses the interference of empty patches on state updates by leveraging scattering energy priors and a learnable scoring module. Furthermore, a Hierarchical Spatial Summarization (HSS) strategy is proposed to extract structured summary tokens from different depths and spatial regions of the encoder, thereby enhancing visual information perception during text sequence generation. Experimental results on the ISARCap 1.0 dataset indicate that ISAR-Mamba outperforms existing image captioning methods on multiple metrics, suggesting the effectiveness of the proposed method and the usability of the dataset.