Khalil Al Sayed

Khalil Al Sayed

Auto-generated profile, based on publicly available information

Khalil Al Sayed

ENSAM, Paris,CESI LINEACT (UR 7527), CESI Brest Campus,Brest,France

Research Focus & Metrics

Academic Career Length

4Years (2023-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
3 July 2024 in Journal of Building Engineering
Verified
Journal Article
Open access
KSKhalil Al Sayed
Khalil Al Sayed
ABAbhinandana Boodi
Abhinandana Boodi
RBRoozbeh Sadeghian Broujeny
Roozbeh Sadeghian Broujeny
KBKarim Beddiar
Karim Beddiar

16 October 2023
Verified
Conference Paper
Closed access
KSKhalil Al Sayed
Khalil Al Sayed
ABAbhinandana Boodi
Abhinandana Boodi
RBRoozbeh Sadeghian Broujeny
Roozbeh Sadeghian Broujeny
KBKarim Beddiar
Karim Beddiar
The HVAC system accounted for a significant portion of the building's energy consumption, resulting in enormous CO 2 emissions. Among the numerous HVAC control methods, reinforcement learning (RL) gives the ability to control complex systems without requiring an explicit model of the building's thermal dynamics. This study conducted a concise review of previous research on the application of RL to HVAC systems in buildings, it offered a thorough explanation of the theoretical foundations of RL and a summary of several recent RL studies that employ a particular variant of each main component of the RL: environment, state-space, action-space, rewards function, number of time steps and training episodes. Most studies construct the training environment as a stationary MDP due to the use of a predefined single sequence of transitions for non-action-controllable state vector components (e.g., outdoor temperature and occupancy schedule). This type of MDP is solved using tabular RL and DRL algorithms. Future research should focus on using the Meta-RL approach for HVAC systems, which solves the problem of non-stationarity in the environment (non-stationarity-MDP) where the sequence of transitions for (outdoor temperature and occupancy schedule) are changeable, as is the case during the real-world implementation of the RL controller in buildings.

22 October 2025
Verified
Conference Paper
Closed access
KSKhalil Al Sayed
Khalil Al Sayed
ABAbhinandana Boodi
Abhinandana Boodi
RBRoozbeh Sadeghian Broujeny
Roozbeh Sadeghian Broujeny
KBKarim Beddiar
Karim Beddiar
We compare two reinforcement learning methods for HVAC control in a university amphitheater simulated in EnergyPlus: Proximal Policy Optimization (PPO, on-policy) and SAC-Gumbel (off-policy). We run two experiments. First, a weekly adaptation test trains each agent for 50 episodes using the first week of January in Luxembourg. Second, a year-long generalization test trains on a full year of data (about $3.5 \times$ passes) and then evaluates on two other climates (San Diego and Brest) with realistic occupancy. We assess learning speed, daily average cumulative score, comfort violations during occupied periods (15-minute counts), and energy use (AHU electricity plus district heating). In the weekly test, SAC-Gumbel achieved a better cumulative score (-449.17 vs. -501.33) and used less energy (7.16 GJ vs. 9.05 GJ) than PPO. In the year-long tests, SAC-Gumbel lowered cumulative penalty scores by 31.85 % and reduced occupiedperiod comfort violations by 30.12 % relative to PPO, but consumed 83.04 % more energy. Overall, the off-policy method learned faster and provided stronger comfort control, at the cost of higher energy in cross-climate deployment.

27 January 2026 in TechRxiv
Verified
Preprint
Open access
KSKhalil Al Sayed
Khalil Al Sayed
ABAbhinandana Boodi
Abhinandana Boodi
RBRoozbeh Sadeghian Broujeny
Roozbeh Sadeghian Broujeny
KBKarim Beddiar
Karim Beddiar
Heating, ventilation, and airconditioning (HVAC) systems account for around 16.4% of global final energy consumption and about 14% of global operational CO2 emissions. Controlling them is a partially observable, sequential decision problem: relying solely on instantaneous sensor readings as inputs overlooks the full sequence of past conditions that shape future dynamics. To tackle this challenge and fully exploit the available temporal context, this study integrates a transformer encoder-decoder architecture into a Double Deep Q-Network (DDQN), forming a "Q-Transformer" capable of processing 24hour sequences of observations. This approach is benchmarked against a conventional DDQN using a multilayer perceptron (MLP) and a sequence-aware Bi-LSTM within an EnergyPlus model of a 400 m 2 university amphitheater. In a weekly adaptation test, the Q-Transformer demonstrated rapid learning convergence, reducing energy consumption by up to 48% and 66% (occupied and unoccupied periods) compared to Bi-LSTM and MLP, respectively, while maintaining thermal and air quality comfort. After one year of simulated training on weather and occupancy data from a reference site (Luxembourg), the agent was evaluated across 4 different climatic locations, resulting energy reductions of 40% and 74%, and comfort violation reductions of 11% and 29%, compared to Bi-LSTM and MLP, respectively. These results signifies the ability of generalization and control capabilities of transformer-based reinforcement learning for adaptive HVAC management. . Source Code (GitHub)

3 August 2026 in Energy and AI
Verified
Journal Article
Open access
KSKhalil Al Sayed
Khalil Al Sayed
ABAbhinandana Boodi
Abhinandana Boodi
RBRoozbeh Sadeghian Broujeny
Roozbeh Sadeghian Broujeny
KBKarim Beddiar
Karim Beddiar