The latest satellite infrastructure for data processing, transmission and reception can certainly be improved by upgrading tools used to deal with very large amounts of data from every different sensor incorporated within the space missions. In order to develop a better technique to process data, in this paper we will take an insight into multimodal data fusion using machine learning algorithms. This paper discusses how machine learning models are used to recreate environments from heterogeneous, multi-modal data sets. In particular, for those models based on neural networks, the most important difficulty is the vast number of training objects of the connected neural network based on Convolutional Neural Networks (CNN) to avoid overfitting and underfitting of the models.

Intelligent signal processing holds great importance for the future of resilient, adaptable communications networks. The unique qualities of deep space require an interplanetary Internet to be highly autonomous, efficient, and adaptable to varying Quality of Service (QoS). Deep learning has shown great promise in the field of signal processing for being computationally efficient, capable of handling errors from nonlinear effects (e.g., hardware impairments), and handling low signal-to-noise ratios. A recent survey by Pham, Q.V., et al. notes that none of the papers studied the improvements in classification in the high-order modulation regime. Additionally, these papers did not explore performance of their models in resource limited environments. A hierarchical interplanetary Internet that imposes a variety of constraints on its nodes offers a unique opportunity to explore realistic tradeoffs in model performance. This paper seeks to leverage the processing, storage, and data transmission capabilities of each level of the interplanetary Internet through federated learning. This will reduce data redundancy between nodes and minimize overhead transmission costs on the network. The goals of this project are the following: (i) Detail possible insights into future channel estimation techniques applied to noisy, nonlinear models. (ii) Explore application of deep learning models for high-order modulation schemes. (iii) Quantify the resource-demand reduction resulting from the use of a deep neural network for intelligent signal processing. (iv) Analyze the adaptability of an interdependent system of deep neural networks in the context of a centralized/decentralized federated learning network.