4 November 2021 in IEEE Transactions on Geoscience and Remote Sensing
Artificial intelligence (AI) is paving the way for a new era of algorithms focusing directly on the information contained in the data, autonomously extracting relevant features for a given application. While the initial paradigm was to have these applications run by a server hosted processor, recent advances in microelectronics provide hardware accelerators with an efficient ratio between computation and energy consumption, enabling the implementation of AI algorithms “at the edge.” In this way only the meaningful and useful data are transmitted to the end-user, minimizing the required data bandwidth, and reducing the latency with respect to the cloud computing model. In recent years, European Space Agency (ESA) is promoting the development of disruptive innovative technologies on-board earth observation (EO) missions. In this field, the most advanced experiment to date is the $\Phi $ -sat-1, which has demonstrated the potential of artificial intelligence (AI) as a reliable and accurate tool for cloud detection on-board a hyperspectral imaging mission. The activities involved included demonstrating the robustness of the Intel Movidius Myriad 2 hardware accelerator against ionizing radiation, developing a Cloudscout segmentation neural network (NN), run on Myriad 2, to identify, classify, and eventually discard on-board the cloudy images, and assessing the innovative Hyperscout-2 hyperspectral sensor. This mission represents the first official attempt to successfully run an AI deep convolutional NN (CNN) directly inferencing on a dedicated accelerator on-board a satellite, opening the way for a new era of discovery and commercial applications driven by the deployment of on-board AI.
1 April 2018 in Journal of Aerospace Information Systems
Vision-based navigation has become increasingly important in a variety of space applications for enhancing autonomy and dependability. Future missions, such as active debris removal for remediating the low Earth orbit environment, will rely on novel high-performance avionics to support advanced image processing algorithms with substantial workloads. However, when designing new avionics architectures, constraints relating to the use of electronics in space present great challenges, further exacerbated by the need for significantly faster processing compared to conventional space-grade central processing units. With the long-term goal of designing high-performance embedded computers for space, in this paper, an extended study and tradeoff analysis of a diverse set of computing platforms and architectures (i.e., central processing units, multicore digital signal processors, graphics processing units, and field-programmable gate arrays) are performed with radiation-hardened and commercial off-the-shelf technology. Overall, the study involves more than 30 devices and 10 benchmarks, which are selected after exploring the algorithms and specifications required for vision-based navigation. The present analysis combines literature survey and in-house development/testing to derive a sizable consistent picture of all possible solutions. Among others, the results show that certain 28 nm system-on-chip devices perform faster than space-grade and embedded central processing units by 1–3 orders of magnitude, while consuming less than 10 W. Field-programmable gate array platforms provide the highest performance per watt ratio.
3 June 2024 in IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing
Satellite-borne Synthetic Aperture Radar (SAR) technology has revolutionized remote sensing applications by providing high-resolution and all-weather imaging capabilities. With the increasing availability of SAR data, the need for efficient data processing has become crucial. On-board processing has emerged as a promising solution to address the challenges associated with limited downlink capacity and final data products latency. Performing data processing and compression directly on the airborne platform reduces the raw data transmitted to ground stations, which offers several key benefits. Firstly, it significantly reduces the data volume to be downlinked, optimizing the usage of limited bandwidth and minimizing transmission delays. Secondly, on-board processing enables faster access to processed data products, allowing for quicker decision-making and timely response to dynamic events, enhancing the real-time capabilities of the system that are particularly valuable in time-critical applications. This article discusses various on-board processing techniques employed in SAR systems and explores their challenges, like computational constraints, architectural impacts, power consumption, and algorithm optimization. Furthermore, it examines the potential future developments in on-board processing, such as the integration of artificial intelligence and machine learning techniques to enhance data analysis and decision-making capabilities. The advancements in on-board processing have the potential to revolutionize the way SAR missions are conducted. By leveraging these techniques, SAR systems can achieve improved operational efficiency, reduced data latency, and enhanced real-time capabilities. This article emphasizes the significance of on-board processing in meeting the growing demands of SAR applications and underscores its role in advancing remote sensing capabilities for various sectors, including environmental monitoring, disaster response, and surveillance.