Current advances in the Internet of Things (IoT) and Cloud involve the presence of an additional layer between them acting as mediator for data transfer and processing in close distance to end users. This mediator is the edge computing (EC) infrastructure. In EC, we can identify an ecosystem of heterogeneous nodes capable of interacting with IoT devices, collecting and locally processing the data they report. The ultimate goal is to eliminate the latency we face when relying on Cloud to perform the desired processing activities. In EC, any processing is performed over a number of geo-distributed datasets formulated by the collected data that exhibit specific statistical characteristics. Processing can have the form of tasks requested by end users or applications. It becomes obvious that in the EC ecosystem, we have to carefully decide the EC nodes that will host and execute any requested task. In this paper, we extend our previous research efforts on the conclusion of efficient task allocations into the available EC nodes. We go a step forward and propose a batch processing model executed over multiple tasks and study two allocation models: a scheme based on an unsupervised machine learning technique and a bio-inspired optimization algorithm. Our models enhance the autonomous behavior of entities performing the envisioned task allocations. We provide the analytical description of the problem, our solution and the advances over the state of the art. We present and evaluate the proposed algorithms and compare them with other efforts in the domain. The pros and cons of our models are revealed through the provided extensive experimental evaluation adopting real and synthetic data.
Copernicus is the European program for monitoring the Earth. It consists of a set of complex systems that collect data from satellites and in-situ sensors, process it, and provide users with reliable and up-to-date information on a range of environmental and security issues. Information extracted from Copernicus data is made available to users through Copernicus services addressing six thematic areas: land, marine, atmosphere, climate, emergency and security. The data processed and disseminated puts Copernicus at the forefront of the big data paradigm and gives rise to all relevant challenges: volume, velocity, variety, veracity and value. In this paper we discuss the challenges of big Copernicus data and how the Copernicus program handled them. We also present lessons learned from our project Copernicus App Lab, which takes Copernicus services information and makes it available on the Web using semantic technologies to aid its take up by mobile developers.
17 October 2017 in International Journal of Computer Applications