Faizan Rasheed

Faizan Rasheed

Auto-generated profile, based on publicly available information

Faizan Rasheed

School of Physics, Engineering, and Computer Science, University of Hertfordshire,Adaptive Systems Research Group,Hatfield,UK,AL10 9AB

Research Focus & Metrics

Academic Career Length

7Years (2020-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
27 October 2020 in IEEE Access
Verified
Journal Article
Open access
FRFaizan Rasheed
Faizan Rasheed
YAYau Kok-Lim Alvin
Yau Kok-Lim Alvin
RNRafidah Md Noor
Rafidah Md Noor
Celimuge WuCelimuge Wu
Celimuge Wu
YLYeh-Ching Low
Yeh-Ching Low
Traffic congestion is a complex, vexing, and growing issue day by day in most urban areas worldwide. The integration of the newly emerging deep learning approach and the traditional reinforcement learning approach has created an advanced approach called deep reinforcement learning (DRL) that has shown promising results in solving high-dimensional and complex problems, including traffic congestion. This article presents a review of the attributes of traffic signal control (TSC), as well as DRL architectures and methods applied to TSC, which helps to understand how DRL has been applied to address traffic congestion and achieve performance enhancement. The review also covers simulation platforms, a complexity analysis, as well as guidelines and design considerations for the application of DRL to TSC. Finally, this article presents open issues and new research areas with the objective to spark new interest in this research field. To the best of our knowledge, this is the first review article that focuses on the application of DRL to TSC.

1 August 2020 in Future Generation Computer Systems
Verified
Journal Article
Closed access
FRFaizan Rasheed
Faizan Rasheed
KYKok-Lim Alvin Yau
Kok-Lim Alvin Yau
YLYeh-Ching Low
Yeh-Ching Low

9 November 2023
Verified
Conference Paper
Open access
FRFaizan Rasheed
Faizan Rasheed
DPDaniel Polani
Daniel Polani
NVNicola Catenacci Volpi
Nicola Catenacci Volpi
Intrinsic motivation plays a key role in learning how to use tools, a fundamental aspect of human cultural evolution and child development that remains largely unexplored within the context of Reinforcement Learning (RL). This paper introduces “object empowerment” as a novel concept within this realm, showing its role as information-theoretic intrinsic motivation that underpins tool discovery and usage. Using empowerment, we propose a new general framework to model the utilization of tools within RL. We explore how maximizing empowerment can expedite the RL of tasks involving tools, highlighting its capacity to solve the challenge posed by sparse reward signals. By employing object empowerment as an intrinsically motivated regulariser, we guide the RL agent in simple grid-worlds towards states beneficial for learning how to master tools for efficient task completion. We will show how object empowerment can be used to measure and compare the effectiveness of different tools in handling an object. Our findings indicate efficient strategies to learn tool use and insights into the integration and modeling of tool control in the context of RL.