Foundation models (e.g., ChatGPT, DALL-E, PengCheng Mind, PanGu-Σ) have demonstrated extraordinary performance in key technological areas, such as natural language processing and visual recognition, and have become the mainstream trend of artificial general intelligence. This has led more and more major technology giants to dedicate significant human and financial resources to actively develop their foundation model systems, which drives continuous growth of these models' parameters. As a result, the training and serving of these models have posed significant challenges, including substantial computing power, memory consumption, bandwidth demands, etc. Therefore, employing efficient training and serving strategies becomes particularly crucial. Many researchers have actively explored and proposed effective methods. So, a comprehensive survey of them is essential for system developers and researchers. This paper extensively explores the methods employed in training and serving foundation models from various perspectives. It provides a detailed categorization of these state-of-the-art methods, including finer aspects such as network, computing, and storage. Additionally, the paper summarizes the challenges and presents a perspective on the future development direction of foundation model systems. Through comprehensive discussion and analysis, it hopes to provide a solid theoretical basis and practical guidance for future research and applications, promoting continuous innovation and development in foundation model systems.
19 February 2025 in Expert Systems with Applications
The resilience of UAV swarms mainly revolves around ensuring stable and uninterrupted operations. Malicious attacks can implement the adverse impacts of potential threats through swarm communication links. In this context, the SIS (Susceptible → Infected → Susceptible) method is suitable for describing the information transmission within UAV swarms. An enhanced resilience model of the UAV swarm is proposed in this study, which incorporates the factors of self-dynamics, dynamics of topology, dynamics of information transmission, and SIS into the complex network model. The model proposed in this paper has the capability to effectively capture changes in the network topology as well as the dynamics of the system. The average number of susceptible drones is utilized as the metric to evaluate the resilience of the swarm. Furthermore, an experiment is conducted where a UAV swarm successfully carries out a surveillance mission. The proposed model not only enables the support of mission planning but also facilitates the design enhancements of UAV swarms.