For effective management of cloud data center resources there is a need to develop and implement simple and robust methods that take into account the data center power consumption, user Service Level Agreement compliance, and different conditions of resource utilization. In this paper, the authors analyze the possibility of application of the reinforcement learning method to cloud data center resource management. Due to the intensive changes of the workloads and different conditions of resource utilization the data center resource management problem should be solved dynamically in an online manner. To address such problem, the authors propose the method of dynamic virtual machine placement based on the reinforcement learning. The proposed method takes into account the power consumption and the number of SLA violations while producing control impacts. Besides, the method considers the changes in the resource utilizations to make a decision on whether to switch underloaded physical servers to the sleep mode in order to reduce the power consumption. The proposed reinforcement learning agent is based on the Q-learning approach which allows to determine the optimal policy for managing the physical servers without creating an environment model and preliminary information about the workload.
A widespread use of the cloud computing paradigm has increased the necessity and significance of improving the management efficiency of cloud data centers. Special attention is paid to solving cloud resource management problems. Due to the intensive changes of virtual machine (VM) workloads and different conditions of resource utilization the VM placement and migration problems should be solved and optimized continuously in an online manner. To address such problems the authors present an approach to continuous new VM allocation and VM migration. The authors also evaluate a particular policy of the VM allocation in a data center using an adaptive genetic algorithm. The proposed Adaptive Software Defined approach to the cloud data centers management is implemented by using the policy selector, that allows to select different algorithms or policies for resources and virtual machines management in order to adapt to the impact of disturbing influences.
The Internet of Things (IoT) is an emerging technology that is considered by industry and academy as a global infrastructure for the information society in today's digital world. IoT is implemented now in several ecosystems to improve economic indicators and productivity of enterprises, and also to improve the quality of consumer's lives. Thus a development of new architectures and approaches for IoT infrastructure management is needed. In this article the authors propose an approach to develop the Microcloud-based IoT infrastructure architecture based on decomposition-compensation approach [1] to provide the desired quality of IT services with rational use of IT resources. Efficiency of IT infrastructure management can be estimated by the quality of services and the management costs. The main goal of this article is to develop an architecture of management system for IoT infrastructures.