Moiz Ahmad

Mr. Moiz Ahmad

orcid

Research Focus & Metrics

Academic Career Length

3Years (2024-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
18 January 2025 in Engineering Applications of Artificial Intelligence
Verified
Journal Article
Closed access
Moiz AhmadMoiz Ahmad
Moiz Ahmad
MTMuhammad Tayyab
Muhammad Tayyab
Muhammad Salman HabibMuhammad Salman Habib
Muhammad Salman Habib

24 June 2024 in Mathematics
Verified
Journal Article
Open access
PDF file
Moiz AhmadMoiz Ahmad
Moiz Ahmad
Muhammad Babar RamzanMuhammad Babar Ramzan
Muhammad Babar Ramzan
Muhammad OmairMuhammad Omair
Muhammad Omair
Muhammad Salman HabibMuhammad Salman Habib
Muhammad Salman Habib
This paper considers a risk-averse Markov decision process (MDP) with non-risk constraints as a dynamic optimization framework to ensure robustness against unfavorable outcomes in high-stakes sequential decision-making situations such as disaster response. In this regard, strong duality is proved while making no assumptions on the problem’s convexity. This is necessary for some real-world issues, e.g., in the case of deprivation costs in the context of disaster relief, where convexity cannot be ensured. Our theoretical results imply that the problem can be exactly solved in a dual domain where it becomes convex. Based on our duality results, an augmented Lagrangian-based constraint handling mechanism is also developed for risk-averse reinforcement learning algorithms. The mechanism is proved to be theoretically convergent. Finally, we have also empirically established the convergence of the mechanism using a multi-stage disaster response relief allocation problem while using a fixed negative reward scheme as a benchmark.