The consistent and long-term spaceborne Synthetic Aperture Radar (SAR) missions such as Sentinel-1 (S-1) provide high quality dual-polarized C-band images particularly suited to sea ice monitoring. SAR data is currently the primary source of information for sea ice charting made by human ice experts as a result of its integration with multiple information sources at different scales (mainly radiometers). The rise of deep learning now opens the prospect of automatic sea ice mapping. In this study, we investigate the potential of a Fully Convolutional Network (FCN) for the automatic estimation of Sea Ice Concentration (SIC).With input data down-sampled at 200 meters and an FCN architecture (depth and receptive field) duly parameterized, our approach is to mimic the work of an analyst who considers general context and does not necessarily use the highest possible resolution but speckle-noise polluted data. A comprehensive database is generated with 1320 dual-polarized S-1 scenes collocated with ice charts produced by MET Norway. A dedicated attention is paid to seasonal representativeness to ensure adequate performance for all sea ice types. Even if the FCN output is modeled as a categorical problem, the proposed architecture accounts for the semantic distances between SIC classes by introducing an auxiliary loss. A comparative benchmark with Ocean and Sea Ice Satellite Application Facility (OSISAF) and MET Norway SIC products is carried out, showing an Overall Accuracy of 78.2% for our 6-class classification approach. The FCN model is shown to be evenly robust to sea ice seasonal variability and incidence angle.
The Copernicus Sentinel-2 mission operated by the European Space Agency (ESA) provides comprehensive and continuous multi-spectral observations of all the Earth’s land surface since mid-2015. Clouds and cloud shadows significantly decrease the usability of optical satellite data, especially in agricultural applications; therefore, an accurate and reliable cloud mask is mandatory for effective EO optical data exploitation. During the last few years, image segmentation techniques have developed rapidly with the exploitation of neural network capabilities. With this perspective, the KappaMask processor using U-Net architecture was developed with the ability to generate a classification mask over northern latitudes into the following classes: clear, cloud shadow, semi-transparent cloud (thin clouds), cloud and invalid. For training, a Sentinel-2 dataset covering the Northern European terrestrial area was labelled. KappaMask provides a 10 m classification mask for Sentinel-2 Level-2A (L2A) and Level-1C (L1C) products. The total dice coefficient on the test dataset, which was not seen by the model at any stage, was 80% for KappaMask L2A and 76% for KappaMask L1C for clear, cloud shadow, semi-transparent and cloud classes. A comparison with rule-based cloud mask methods was then performed on the same test dataset, where Sen2Cor reached 59% dice coefficient for clear, cloud shadow, semi-transparent and cloud classes, Fmask reached 61% for clear, cloud shadow and cloud classes and Maja reached 51% for clear and cloud classes. The closest machine learning open-source cloud classification mask, S2cloudless, had a 63% dice coefficient providing only cloud and clear classes, while KappaMask L2A, with a more complex classification schema, outperformed S2cloudless by 17%.
Through the Synthetic Aperture Radar (SAR) embarked on the satellites Sentinel-1A and Sentinel-1B of the Copernicus program, a large quantity of observations is routinely acquired over the oceans. A wide range of features from both oceanic (e.g., biological slicks, icebergs, etc.) and meteorologic origin (e.g., rain cells, wind streaks, etc.) are distinguishable on these acquisitions. This paper studies the semantic segmentation of ten metoceanic processes either in the context of a large quantity of image-level groundtruths (i.e., weakly-supervised framework) or of scarce pixel-level groundtruths (i.e., fully-supervised framework). Our main result is that a fully-supervised model outperforms any tested weakly-supervised algorithm. Adding more segmentation examples in the training set would further increase the precision of the predictions. Trained on 20 × 20 km imagettes acquired from the WV acquisition mode of the Sentinel-1 mission, the model is shown to generalize, under some assumptions, to wide-swath SAR data, which further extents its application domain to coastal areas.
Recent developments in Distributed Satellite Systems (DSS) have undoubtedly increased mission value due to the ability to reconfigure the spacecraft cluster/formation and incrementally add new or update older satellites in the formation. These features provide inherent benefits, such as increased mission effectiveness, multi-mission capabilities, design flexibility, and so on. Trusted Autonomous Satellite Operation (TASO) are possible owing to the predictive and reactive integrity features offered by Artificial Intelligence (AI), including both on-board satellites and in the ground control segments. To effectively monitor and manage time-critical events such as disaster relief missions, the DSS must be able to reconfigure autonomously. To achieve TASO, the DSS should have reconfiguration capability within the architecture and spacecraft should communicate with each other through an Inter-Satellite Link (ISL). Recent advances in AI, sensing, and computing technologies have resulted in the development of new promising concepts for the safe and efficient operation of the DSS. The combination of these technologies enables trusted autonomy in intelligent DSS (iDSS) operations, allowing for a more responsive and resilient approach to Space Mission Management (SMM) in terms of data collection and processing, especially when using state-of-the-art optical sensors. This research looks into the potential applications of iDSS by proposing a constellation of satellites in Low Earth Orbit (LEO) for near-real-time wildfire management. For spacecraft to continuously monitor Areas of Interest (AOI) in a dynamically changing environment, satellite missions must have extensive coverage, revisit intervals, and reconfiguration capability that iDSS can offer. Our recent work demonstrated the feasibility of AI-based data processing using state-of-the-art on-board astrionics hardware accelerators. Based on these initial results, AI-based software has been successively developed for wildfire detection on-board iDSS satellites. To demonstrate the applicability of the proposed iDSS architecture, simulation case studies are performed considering different geographic locations.
25 January 2019 in IEEE Transactions on Geoscience and Remote Sensing
Nowadays, there is growing interest in applying Artificial Intelligence (AI) on board Earth Observation (EO) satellites for time-critical applications, such as natural disaster response. However, the unavailability of raw satellite data currently hinders research of lightweight pre-processing techniques and limits the exploration of end-to-end pipelines, which extract insights directly from the source data. To fill this gap, this work presents a novel methodology to automate the creation of datasets for the detection of target events (e.g., warm thermal hotspots) or objects (e.g., vessels) from Sentinel-2 raw data and other multispectral EO pushbroom raw imagery. The presented approach first processes the raw data by applying a pipeline consisting of a spatial band registration and georeferencing of the raw data pixels. Then, it detects the target events by leveraging event-specific state-of-the-art algorithms on the Level-1C products, which are mosaicked and cropped on the georeferenced correspondent raw granule area. The detected events are, finally, re-projected back on the corresponding raw images. We apply the proposed methodology to realize THRawS (Thermal Hotspots in Raw Sentinel-2 data), the first dataset of Sentinel-2 raw data containing warm thermal hotspots. THRawS includes 1090 samples containing wildfires, volcanic eruptions, and 33335 eventfree acquisitions to enable thermal hotspot detection and general classification applications. This dataset and associated toolkits provide the community with both an immediately useful resource to speed up future research on energy-efficient pre-processing algorithms and AI-based end-to-end processing systems on board EO satellites.