Edge computing has become a prominent solution when it comes to mobile applications and data management, due to its ability to considerably reduce data transmission costs, and to analyze data requiring fewer computing resources, since the analysis occurs at lower data volumes, without having to relocate data to centralized infrastructures. One major challenge, indicates the optimal data placement regarding data-intensive applications and, in general, applications requiring vast transmission of large amount of data. In this paper, we propose a novel user mobility-based data placement strategy, considering a trade-off between latency and data migration, which has not been investigated before. We classify the users into three mobility classes; namely static, local or mobile, via the use of a causal-aware Deep Learning network. This information is then exploited in order to optimize the data placement through specific data placement and retrieval algorithms for each mobility class. We evaluate the performance of the proposed solution using simulations, and prove that our solution manages to reduce the average data accessing cost by 60% for static or local users and 10% for mobile users, while the average path length is reduced by 50% for static and local users, and by 12% for mobile users.

As institutions increasingly shift to distributed and containerized application deployments on remote heterogeneous cloud/cluster infrastructures, the cost and difficulty of efficiently managing and maintaining data-intensive applications have risen. A new emerging solution to this issue is Data-Driven Infrastructure Management (DDIM), where the decisions regarding the management of resources are taken based on data aspects and operations (both on the infrastructure and on the application levels). This chapter will introduce readers to the core concepts underpinning DDIM, based on experience gained from development of the Kubernetes-based BigDataStack DDIM platform (https://bigdatastack.eu/). This chapter involves multiple important BDV topics, including development, deployment, and operations for cluster/cloud-based big data applications, as well as data-driven analytics and artificial intelligence for smart automated infrastructure self-management. Readers will gain important insights into how next-generation DDIM platforms function, as well as how they can be used in practical deployments to improve quality of service for Big Data Applications.This chapter relates to the technical priority Data Processing Architectures of the European Big Data Value Strategic Research & Innovation Agenda [33], as well as the Data Processing Architectures horizontal and Engineering and DevOps for building Big Data Value vertical concerns. The chapter relates to the Reasoning and Decision Making cross-sectorial technology enablers of the AI, Data and Robotics Strategic Research, Innovation & Deployment Agenda [34].