Efficient and high-fidelity polarization demosaicking is critical for the industrial applications of division of focal plane (DoFP) polarization imaging systems. However, existing methods often struggle to balance speed, accuracy, and complexity. This study introduces a novel polarization demosaicking algorithm that interpolates DoFP images within a three-stage basic demosaicking framework. Our method incorporates a DoFP low-cost edge-aware technique (DLE) to guide the interpolation process. Furthermore, inter-channel correlation is used to calibrate the initial estimate in the polarization difference domain. The proposed algorithm is available in both lightweight and full versions, designed for different application requirements. Experiments on simulated and real DoFP images demonstrated that both versions achieve the highestt interpolation accuracy and speed, respectively, among existing interpolation-based algorithms and significantly enhanced visuals. The lightweight and full versions efficiently processed a 1024 × 1024 image on an AMD Ryzen 5600X CPU in 0.1402s and 0.2693s, respectively. Additionally, as our methods operate within a 5 × 5 window, parallel acceleration on graphics processing units (GPUs) or field-programmable gate arrays (FPGAs) is highly feasible.
The presence of numerous space objects poses significant challenges to spacecraft launch, operation, and space security. To address this issue, a novel algorithm based on improved YOLOv5 joint Fuzzy C-Means (FCM) has been proposed for discerning and localizing closely-spaced objects (CSOs) in space. The algorithm employs the lightweight neural network YOLOv5 to estimate the quantity of the targets and employs the improved FCM localizing. In the first stage, it enhances the precision of CSOs quantity estimation by integrating small target layers and the Convolutional Block Attention Module (CBAM) into the YOLOv5 network. In the second stage, leveraging the estimated target quantity as input, the FCM algorithm based on Lanczos3 interpolation and particle distribution was used for the sub-pixel localization of each target cluster. The experimental results show that the algorithm's quantity estimation accuracy is more than 90%, and the average localization error is within 0.32 pixels. Moreover, the average running time of the algorithm is less than 0.034 s. Compared with other methods, the algorithm shows excellent performance, and its effectiveness is important for target tracking, 3D localization, and detailed analysis.
27 December 2024 in IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing
The advent of Industry 4.0 has highlighted the requirements for the digitization and intelligent evolution of space-based payloads. To address challenges like limited data samples and simulate infrared images in various scenarios, this study proposes a hybrid data-driven and fractal-driven cloud-sea scenario simulation (HCSS) approach for high-precision infrared images at space-based detection scales. Static cloud-sea scenes are generated using Qilu-2 and New Technology satellite images, while dynamic scenarios are simulated with our iterative fractal dimension (FD) optimization algorithm. Next, we propose a high-precision infrared cloud-sea simulation method based on these simulate scenarios. Finally, we validate the confidence of the simulated images through morphological assessment using a two-dimensional histogram and radiative accuracy evaluation based on MODTRAN results. Experimental results confirm the method's accuracy, showing close alignment with on-orbit images. In the 2.7–3.0 ${\mu }$ m band, our average radiance is consistent with MODTRAN. Specifically, for reflection angles below 60 $^\circ$ , the root mean square error (RMSE) between our results and MODTRAN results is about 12.3% in the 3.0–5.0 ${\mu }$ m band, and around 3.7% in the 8.0–14.0 ${\mu }$ m band. Morphological assessment shows an average error of about 8.3% when compared to on-orbit images. This method allows for generating multi-band, multi-species, and multi-scale complex cloud-sea scenario images for digital infrared payloads with high flexibility and confidence.
Accurate optical axis pointing of optical payloads in low orbits is essential for sustained indication and high-precision positioning of motion targets. Owing to the short orbital period in low orbits and the influence of the sun, the incident light on the optical payloads and the space thermal environment undergo drastic and irregular changes over a short period. These changes cause optical distortions within the camera and variations in the installation matrix referenced for the satellite. Ultimately, these changes affect the imaging process of the camera and the line-of-sight (LOS) accuracy, greatly disadvantaging the high-precision pointing and positioning of space targets. In this paper, a correction method based on stellar observation data is proposed to address the LOS deviation issue of low-orbit optical payloads caused by space thermal deformation (STD). The proposed method innovatively utilizes the angle relationship between the solar vector, the satellite position vector, and the camera LOS vector as the correction parameters to characterize the thermal environment in which the payload operates. This method overcomes the irregularity and frequent correction requirements of LOS errors in low-orbit payloads. Experimental results showed that the mean absolute error of the camera LOS after the correction was 0.001096 rad, representing an 80.28% improvement over previous measurements, even reaching 99% improvement in the final mission. At a 95% confidence level, the correction errors for the final mission were consistently below (2σ) rad in the right ascension and declination directions.
In infrared detectors, the readout circuits usually cause horizontal or vertical streak noise, whereas the infrared focal plane arrays experience triangular nonuniform fixed-pattern noise. In addition, imaging devices suffer from optically relevant fixed-pattern noise owing to the temperature. When the infrared camera is in orbit, it is affected by the photon effect, temperature change, and time drift. This makes the nonuniformity correction coefficients pertaining to the ground no longer applicable, resulting in the degradation of the nonuniformity correction effect. The existing methods are not fully applicable to triangular fixed-pattern noise or the fixed-pattern noise caused by detector optics. To address this situation, this paper proposes a nonuniformity correction method, namely infrared image sequences based on the optimization of group sparsity in the spatiotemporal domain. We established a nonuniformity correction model of differential operators in the spatiotemporal domain for infrared image sequences by applying the time-domain differential operator constraints to the images to denoise the image. This enables the adaptive correction of the nonuniformity of the above types of noise. We demonstrate that the proposed method is effective for triangular nonuniform and optically induced fixed-pattern noises. The proposed method was extensively evaluated using publicly available datasets and datasets containing image sequences of different scenes captured by a high-resolution infrared camera of the Qilu-2 satellite. The method has high robustness and good processing results with effective ghost suppression and significant reduction of nonuniform noise.
As a signature phenomenon of massive hypervelocity impacts (HVIs) in space, debris clouds provide critical optical information for satellite remote sensing and the assessment of large-scale impacts. However, studies of the optical scattering properties of debris clouds remain limited, and existing vector radiative transfer (VRT) methods struggle to accurately simulate the optical characteristics of these complex scatterers. To address this gap, this paper presents an improved Monte Carlo VRT program (PGS–MC) for multicomponent polydisperse scatterers to precisely evaluate the radiation and polarization characteristics of complex scatterers. Based on the Monte Carlo ray tracing (MCRT) method, our program introduces a particle grouping strategy (PGS) to further emphasize the importance of accounting for optical property discrepancies between different materials and particle sizes, thus significantly improving the fidelity of VRT simulations. Moreover, our program, developed using the compute unified device architecture (CUDA), can be run parallelly on graphics processing units (GPUs), which effectively reduces the computational time. The validation results indicated that the developed PGS–MC program can accurately and efficiently simulate the polarization of complex 3D scatterers. A further investigation showed that the polarization characteristics of debris clouds are highly sensitive to parameters such as the angle between the incident and detection directions, number density, particle size distribution, debris material, and wavelength. In addition, the polarization imaging of debris clouds offers distinct advantages over intensity imaging. This study offers guidance for analyzing the VRT properties of massive HVI debris clouds. Additionally, it provides a practical tool and concrete ideas for modeling the polarization characteristics of various complex scatterers, such as aircraft contrails and clouds, etc.