tiantian qian

Dr. tiantian qian


Research Focus & Metrics

Academic Career Length

2Years (2025-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
27 October 2025 in Energies
Verified
Journal Article
Open access
PDF file
TQtiantian qian
tiantian qian
Kaifeng ZhangKaifeng Zhang
Kaifeng Zhang
DSDifen Shi
Difen Shi
ZLZhang Lei
Zhang Lei
The hybrid energy storage system (HESS) that combines battery with hydrogen storage exploits complementary power/energy characteristics, but most studies optimize capacity and operation separately, leading to suboptimal overall performance. To address this issue, this paper proposes a bi-level co-optimization framework that integrates deep reinforcement learning (DRL) and mixed integer programming (MIP). The outer layer employs the TD3 algorithm for capacity configuration, while the inner layer uses the Gurobi solver for optimal operation under constraints. On a standalone PV–wind–load-HESS system, the method attains near-optimal quality at dramatically lower runtime. Relative to GA + Gurobi and PSO + Gurobi, the cost is lower by 4.67% and 1.31%, while requiring only 0.52% and 0.58% of their runtime; compared with a direct Gurobi solve, the cost remains comparable while runtime decreases to 0.07%. Sensitivity analysis further validates the model’s robustness under various cost parameters and renewable energy penetration levels. These results indicate that the proposed DRL–MIP cooperation achieves near-optimal solutions with orders of magnitude speedups. This study provides a new DRL–MIP paradigm for efficiently solving strongly coupled bi-level optimization problems in energy systems.

6 October 2025 in Preprints.org
Verified
Preprint
Open access
PDF file
TQtiantian qian
tiantian qian
KZKaifeng Zhang
Kaifeng Zhang
DSDifen Shi
Difen Shi
LZLei Zhang
Lei Zhang
The Hybrid energy storage system (HESS) that combines battery with hydrogen storage exploits complementary power/energy characteristics, but most studies optimize capacity and operation separately, leading to suboptimal overall performance. To address this issue, this paper proposes a bi-level co-optimization framework that integrates deep reinforcement learning (DRL) and mixed integer programming (MIP). The outer layer employs the TD3 algorithm for capacity configuration, while the inner layer uses the Gurobi solver for optimal operation under constraints. On a standalone PV–wind–load-HESS system, the method attains near-optimal quality at dramatically lower runtime. Relative to GA+Gurobi and PSO+Gurobi, the cost is lower by 4.67% and 1.31%, and the runtime is 0.52% and 0.58% of theirs, respectively; compared with a direct Gurobi solve, the cost remains comparable but the runtime is 0.07% of its. Sensitivity analysis further validates the model’s robustness under various cost parameters and renewable energy penetration levels. These results indicate that the proposed DRL–MIP cooperation achieves near-optimal solutions with orders of magnitude speedups. This study provides a new DRL-MIP paradigm for efficiently solving strongly coupled bi-level optimization problems in energy systems.