Department of Computer Science, Modeling, Electronics and Systems Engineering (DIMES), Università della Calabria, Via Pietro Bucci, 87036 Arcavacata, Rende CS, Italy
Dr. Claudio Savaglio
Department of Computer Science, Modeling, Electronics and Systems Engineering (DIMES), Università della Calabria, Via Pietro Bucci, 87036 Arcavacata, Rende CS, Italy
In recent years, computation offloading has become an effective way to overcome the constraints of mobile devices (MDs) by offloading delay-sensitive and computation-intensive mobile application tasks to remote cloud-based data centers. Smart cities can benefit from offloading to edge points in the framework of the so-called cyber–physical–social systems (CPSS), as for example in traffic violation tracking cameras. We assume that there are mobile edge computing networks (MECNs) in more than one region, and they consist of multiple access points, multi-edge servers, and N MDs, where each MD has M independent real-time massive tasks. The MDs can connect to a MECN through the access points or the mobile network. Each task be can processed locally by the MD itself or remotely. There are three offloading options: nearest edge server, adjacent edge server, and remote cloud. We propose a reinforcement-learning-based state-action-reward-state-action (RL-SARSA) algorithm to resolve the resource management problem in the edge server, and make the optimal offloading decision for minimizing system cost, including energy consumption and computing time delay. We call this method OD-SARSA (offloading decision-based SARSA). We compared our proposed method with reinforcement learning based Q learning (RL-QL), and it is concluded that the performance of the former is superior to that of the latter.
24 December 2020 in IEEE Transactions on Systems, Man, and Cybernetics: Systems
The Internet of Things (IoT) is the latest example of the System of Systems (SoS), demanding for both innovative and evolutionary approaches to tame its multifaceted aspects. Over the years, different IoT methodologies, frameworks, platforms, and tools have been proposed by industry and academia, but the jumbled abundance of such development products have resulted into a high (and disheartening) entry-barrier to IoT system engineering. In this survey, we steer IoT developers by: 1) providing baseline definitions to identify the most suitable class of development products—methodologies, frameworks, platforms, and tools–for their purposes and 2) reviewing seventy relevant products through a comparative and practical approach, based on general SoS engineering features revised in the light of main IoT systems desiderata (i.e., interoperability, scalability, smartness, and autonomy). Indeed, we aim to lessen the confusion related to IoT methodologies, frameworks, platforms, and tools as well as to freeze their current state, for eventually easing the approach towards IoT system engineering.
1 March 2017 in Journal of Network and Computer Applications
The future Internet of Things (IoT) is expected to enable a new and wide range of decentralized systems (from small-scale smart homes to large-scale smart cities) in which “things” are able to sense/actuate, compute, and communicate, and thus play a central and crucial role. The growing importance of such novel networked cyber-physical context demands suitable and effective computing paradigms to fulfill the various requirements of IoT systems engineering. In this paper, we propose to explore an agent-based computing paradigm to support IoT systems analysis, design, and implementation. The synergic meeting of agents with IoT makes it possible to develop smart and dynamic IoT systems of diverse scales. Our agent-oriented approach is specifically based on the agent-based cooperating smart object (ACOSO) methodology and on the related ACOSO middleware: they provide effective agent design and programming models along with efficient tools for the actual construction of an IoT system in terms of a multiagent system. A case study concerning the development of a complex IoT system, namely a Smart University Campus , is described to show the effectiveness and efficiency of the proposed approach.
In the future Internet of Things (IoT), smart objects will be the fundamental building blocks for the creation of cyber-physical smart pervasive systems in a great variety of application domains ranging from health-care to transportation, from logistics to smart grid and cities. The implementation of a smart objects-oriented IoT is a complex challenge as distributed, autonomous, and heterogeneous IoT components at different levels of abstractions and granularity need to cooperate among themselves, with conventional networked IT infrastructures, and also with human users. In this paper, we propose the integration of two complementary mainstream paradigms for large-scale distributed computing: Agents and Cloud. Agent-based computing can support the development of decentralized, dynamic, cooperating and open IoT systems in terms of multi-agent systems. Cloud computing can enhance the IoT objects with high performance computing capabilities and huge storage resources. In particular, we introduce a cloud-assisted and agent-oriented IoT architecture that will be realized through ACOSO, an agent-oriented middleware for cooperating smart objects, and BodyCloud, a sensor-cloud infrastructure for large-scale sensor-based systems.