Marco Biemann

Marco Biemann

Auto-generated profile, based on publicly available information

Marco Biemann

Department of Technology, Management and Economics, Section of Energy Economics and Modelling, Technical University of Denmark, Lyngby, Denmark

Research Focus & Metrics

Academic Career Length

6Years (2021-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
1 September 2021 in Applied Energy
Verified
Journal Article
Open access
MBMarco Biemann
Marco Biemann
FSFabian Scheller
Fabian Scheller
Xiufeng LiuXiufeng Liu
Xiufeng Liu
LHLizhen Huang
Lizhen Huang

30 March 2023 in IEEE Internet of Things Journal
Verified
Journal Article
Closed access
MBMarco Biemann
Marco Biemann
PGPhilipp Andreas Gunkel
Philipp Andreas Gunkel
FSFabian Scheller
Fabian Scheller
LHLizhen Huang
Lizhen Huang
Xiufeng LiuXiufeng Liu
Xiufeng Liu
With increasing electricity prices, cost savings through load shifting are becoming increasingly important for energy end users. While dynamic pricing encourages customers to shift demand to low price periods, the non-stationary and highly volatile nature of electricity prices poses a significant challenge to energy management systems. In this paper, we investigate the flexibility potential of data centres by optimising heating, ventilation, and air conditioning systems with a general model-free reinforcement learning approach. Since the soft actor-critic algorithm with feed-forward networks did not work satisfactorily in this scenario, we propose instead a parameterisation with a recurrent neural network architecture to successfully handle spot-market price data. The past is encoded into a hidden state, which provides a way to learn the temporal dependencies in the observations and highly volatile rewards. The proposed method is then evaluated in experiments on a simulated data centre. Considering real temperature and price signals over multiple years, the results show a cost reduction compared to a proportional, integral and derivative controller while maintaining the temperature of the data centre within the desired operating ranges. In this context, this work demonstrates an innovative and applicable reinforcement learning approach that incorporates complex economic objectives into agent decision-making. The proposed control method can be integrated into various Internet of things-based smart building solutions for energy management.

22 July 2026 in Energy Conversion and Management
Verified
Journal Article
Open access
VOVincent Olesen
Vincent Olesen
MBMarco Biemann
Marco Biemann
UTUffe Høgsbro Thygesen
Uffe Høgsbro Thygesen
HMHenrik Madsen
Henrik Madsen