Nektarios Georgalas

Mr. Nektarios Georgalas

Innovation Principal, AI

Research Focus & Metrics

Academic Career Length

16Years (2011-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
6 August 2020 in IEEE Transactions on Parallel and Distributed Systems
Verified
Journal Article
Closed access
JWJin Wang
Jin Wang
Jia HuJia Hu
Jia Hu
Geyong  MinGeyong Min
Geyong Min
Albert ZomayaAlbert Zomaya
Albert Zomaya
NGNektarios Georgalas
Nektarios Georgalas
Multi-access edge computing (MEC) aims to extend cloud service to the network edge to reduce network traffic and service latency. A fundamental problem in MEC is how to efficiently offload heterogeneous tasks of mobile applications from user equipment (UE) to MEC hosts. Recently, many deep reinforcement learning (DRL) based methods have been proposed to learn offloading policies through interacting with the MEC environment that consists of UE, wireless channels, and MEC hosts. However, these methods have weak adaptability to new environments because they have low sample efficiency and need full retraining to learn updated policies for new environments. To overcome this weakness, we propose a task offloading method based on meta reinforcement learning, which can adapt fast to new environments with a small number of gradient updates and samples. We model mobile applications as Directed Acyclic Graphs (DAGs) and the offloading policy by a custom sequence-to-sequence (seq2seq) neural network. To efficiently train the seq2seq network, we propose a method that synergizes the first order approximation and clipped surrogate objective. The experimental results demonstrate that this new offloading method can reduce the latency by up to 25% compared to three baselines while being able to adapt fast to new environments.

26 November 2021 in IEEE Transactions on Computers
Verified
Journal Article
Closed access
JWJin Wang
Jin Wang
Jia HuJia Hu
Jia Hu
Geyong  MinGeyong Min
Geyong Min
WZWenhan Zhan
Wenhan Zhan
Albert ZomayaAlbert Zomaya
Albert Zomaya
NGNektarios Georgalas
Nektarios Georgalas
Edge computing is an emerging promising computing paradigm that brings computation and storage resources to the network edge, hence significantly reducing the service latency and network traffic. In edge computing, many applications are composed of dependent tasks where the outputs of some are the inputs of others. How to offload these tasks to the network edge is a vital and challenging problem which aims to determine the placement of each running task in order to maximize the Quality-of-Service (QoS). Most of the existing studies either design heuristic algorithms that lack strong adaptivity or learning-based methods but without considering the intrinsic task dependency. Different from the existing work, we propose an intelligent task offloading scheme leveraging off-policy reinforcement learning empowered by a Sequence-to-Sequence (S2S) neural network, where the dependent tasks are represented by a Directed Acyclic Graph (DAG). To improve the training efficiency, we combine a specific off-policy policy gradient algorithm with a clipped surrogate objective. We then conduct extensive simulation experiments using heterogeneous applications modelled by synthetic DAGs. The results demonstrate that: 1) our method converges fast and steadily in training; 2) it outperforms the existing methods and approximates the optimal solution in latency and energy consumption under various scenarios.

5 April 2023 in IEEE Transactions on Parallel and Distributed Systems
Verified
Journal Article
Closed access
JWJin Wang
Jin Wang
Jia HuJia Hu
Jia Hu
JMJed Mills
Jed Mills
Geyong  MinGeyong Min
Geyong Min
MXMing Xia
Ming Xia
NGNektarios Georgalas
Nektarios Georgalas
Federated learning (FL) is a privacy-preserving distributed machine learning paradigm that enables collaborative training among geographically distributed and heterogeneous devices without gathering their data. Extending FL beyond the supervised learning models, federated reinforcement learning (FRL) was proposed to handle sequential decision-making problems in edge computing systems. However, the existing FRL algorithms directly combine model-free RL with FL, thus often leading to high sample complexity and lacking theoretical guarantees. To address the challenges, we propose a novel FRL algorithm that effectively incorporates model-based RL and ensemble knowledge distillation into FL for the first time. Specifically, we utilise FL and knowledge distillation to create an ensemble of dynamics models for clients, and then train the policy by solely using the ensemble model without interacting with the environment. Furthermore, we theoretically prove that the monotonic improvement of the proposed algorithm is guaranteed. The extensive experimental results demonstrate that our algorithm obtains much higher sample efficiency compared to classic model-free FRL algorithms in the challenging continuous control benchmark environments under edge computing settings. The results also highlight the significant impact of heterogeneous client data and local model update steps on the performance of FRL, validating the insights obtained from our theoretical analysis.

18 March 2024 in Computer Networks
Verified
Journal Article
Open access
ZZZixu Zhang
Zixu Zhang
Guangsheng YuGuangsheng Yu
Guangsheng Yu
CSCaijun Sun
Caijun Sun
XWXu Wang
Xu Wang
YWYing Wang
Ying Wang
NGNektarios Georgalas
Nektarios Georgalas

19 January 2024 in IEEE Transactions on Mobile Computing
Verified
Journal Article
Closed access
YZYongchao Zhang
Yongchao Zhang
Jia HuJia Hu
Jia Hu
Geyong  MinGeyong Min
Geyong Min
XCXin Chen
Xin Chen
NGNektarios Georgalas
Nektarios Georgalas
Electric Vehicle-assisted Multi-access Edge Computing (EV-MEC) is a promising paradigm where EVs share their computation resources at the network edge to perform intensive computing tasks while charging. In EV-MEC, a fundamental problem is to jointly decide the charging power of EVs and computation task allocation to EVs, for meeting both the diverse charging demands of EVs and stringent performance requirements of heterogeneous tasks. To address this challenge, we propose a new joint charging scheduling and computation offloading scheme (OCEAN) for EV-MEC. Specifically, we formulate a cooperative two-timescale optimization problem to minimize the charging load and its variance subject to the performance requirements of computation tasks. We then decompose this sophisticated optimization problem into two sub-problems: charging scheduling and computation offloading. For the former, we develop a novel safe deep reinforcement learning (DRL) algorithm, and theoretically prove the feasibility of learned charging scheduling policy. For the latter, we reformulate it as an integer non-linear programming problem to derive the optimal offloading decisions. Extensive experimental results demonstrate that OCEAN can achieve similar performances as the optimal strategy and realize up to 24% improvement in charging load variance over three state-of-the-art algorithms while satisfying the charging demands of all EVs.

19 April 2024 in IEEE Transactions on Computational Social Systems
Verified
Journal Article
Closed access
Guangsheng YuGuangsheng Yu
Guangsheng Yu
Xu WangXu Wang
Xu Wang
QWQin Wang
Qin Wang
TBTingting Bi
Tingting Bi
YDYiFei Dong
YiFei Dong
ARAndrew Reeves
Andrew Reeves
Web3 is leading a wave of the next generation of web services that even many Web2 applications are keen to ride. However, the lack of Web3 background for Web2 developers hinders easy and effective access and transition. On the other hand, Web3 applications desire encouragement and advertisement from conventional Web2 companies and projects due to their low market shares. In this article, we propose a seamless transition framework that transits Web2 to Web3, named WEBTTCOM [WEBTTCOM stands for Web2 (two)–Web3 (three) Communicator], after exploring the connotation of Web3 and the key differences betweenWeb2 andWeb3 applications.We also provide a full-stack implementation as a use case to support the proposed framework, followed by performance evaluation and surveys with ~1000 participants that show ~80% positive and ~20% neutral responses. We confirm that the proposed framework WEBTTCOM addresses the defined research question, and the implementation well satisfies the framework WEBTTCOM in terms of strong necessity, usability , and completeness based on the survey results.