Fan Ding

Dr. Fan Ding

School of Transportation, Southeast University; Jiangsu Key Laboratory of Urban ITS, Jiangsu Province Collaborative Innovation Center of Modern Urban Traffic Technologies, Nanjing 211189, China
orcid

Research Focus & Metrics

Academic Career Length

8Years (2019-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
8 December 2020 in IEEE Transactions on Transportation Electrification
Verified
Journal Article
Closed access
HZHailong Zhang
Hailong Zhang
JPJiankun Peng
Jiankun Peng
Huachun TanHuachun Tan
Huachun Tan
HDHanxuan Dong
Hanxuan Dong
Fan DingFan Ding
Fan Ding
Reinforcement learning (RL) based energy management is one of the current hot-spots of hybrid electric vehicles. Recent advances in RL based energy management focus on energy-saving performance but less considers the constrained setting for training safety. This paper proposes an RL framework named Coach-Actor-Double Critic (CADC) for the optimization of energy management considered as the constrained Markov Decision Process (CMDP). A bi-level onboard controller includes a neural network (NN) based strategy Actor and rule-based strategy Coach for online energy management. Once the output of Actor exceeds the constrained range of feasible solutions, Coach would take charge of energy management to ensure safety. By using Lagrangian relaxation, the optimization for constrained Markov decision process transforms into an unconstrained dual problem to minimize the energy consumption while minimizing the Coach participation. The parameters of Actor are updated in a manner of policy gradient through RL training with the Lagrangian value function. Double Critic with the same structure synchronously estimate the value function to avoid overestimate bias. Several experiments with the bus trajectories data demonstrate the optimality, self-learning ability, and adaptability of CADC. The results indicate that CADC outperforms the existing RL based strategies and reaches above 95% energy-saving rate of the offline global optimum.

23 February 2024 in Expert Systems with Applications
Verified
Journal Article
Closed access
ZLZhao Liu
Zhao Liu
Fan DingFan Ding
Fan Ding
YDYunqi Dai
Yunqi Dai
LLLinchao Li
Linchao Li
TCTianyi Chen
Tianyi Chen
HTHuachun Tan
Huachun Tan

24 July 2023 in IEEE Transactions on Transportation Electrification
Verified
Journal Article
Closed access
HZHailong Zhang
Hailong Zhang
JPJiankun Peng
Jiankun Peng
HDHanxuan Dong
Hanxuan Dong
Fan DingFan Ding
Fan Ding
Huachun TanHuachun Tan
Huachun Tan
Coordinating a platoon of connected hybrid electric vehicles (HEVs) poses challenges due to the intricacy of their powertrains and the diverse driving scenarios encountered. The existing mainstream framework uses a hierarchical control scheme, simplifying the unified optimization problem into two separate series control processes: the powertrain level and the vehicle level. However, this approach overlooks the inherent interdependence between the vehicle and powertrain systems, which can hinder effective optimization and collaboration in terms of energy management across multiple vehicles. To address this problem, a multi-agent reinforcement learning-based energy control framework is proposed, aiming to unleash the energy-saving potential through an integrated collaborative optimization of velocity optimization and energy management strategy for HEV platoon. The proposed strategy constructs a joint-goals value function based on Markov games for HEV platooning and utilizes long short-term memory networks to capture temporal associations of the platoon dynamics. In addition, an asynchronous reinforcement learning method is introduced for knowledge sharing among HEVs in the platoon. The simulation results demonstrate that the proposed approach effectively improves driving behavior and powertrain energy efficiency through multi-vehicle coordination. Compared to the rule-based baseline, the fuel consumption of the platoon is reduced by 19.2% through the coordination of connected HEVs.

31 March 2020 in IEEE Access
Verified
Journal Article
Open access
QLqin li
qin li
Huachun TanHuachun Tan
Huachun Tan
Yuankai WuYuankai Wu
Yuankai Wu
LYLinhui Ye
Linhui Ye
Fan DingFan Ding
Fan Ding
Missing data is inevitable and ubiquitous in intelligent transportation systems (ITSs). A handful of completion methods have been proposed, among which the tensor-based models have been shown to be the most advantageous for missing traffic data imputation. Despite their superior imputation accuracies, the adoption of these imputed data is not uniform in modern ITSs applications. The primary goal of this paper is to explore how to use tensor completion methods to support ITSs. In particular, we study how to improve traffic flow prediction accuracy under different missing scenarios. Specifically, three common missing scenarios including element-wise random missing, time-structured missing, and space-structured missing are considered. Four classical tensor completion models including Smooth PARAFAC Decomposition based Completion (SPC), CP Decomposition-based (CP-WOPT) Completion, Tucker Decomposition-based Completion (TDI), and High-accuracy Low-rank Tensor Completion (HaLRTC) are used to impute the missing data. Four well-known prediction methods including Support Vector Regression (SVR), K-nearest Neighbor (KNN), Gradient Boost Regression Tree (GBRT), and Long Short-term Memory (LSTM) are tested. The simple mean value interpolation completed traffic data is regarded as the baseline data. The extensive experiments show that improvements of traffic flow prediction can be achieved by increasing missing traffic data imputation accuracy at most cases. Interestingly we find that prediction accuracy cannot be improved by an imputation model when the sparsely observed training datasets already provide sufficient training samples.

5 December 2023 in IEEE Transactions on Transportation Electrification
Verified
Journal Article
Closed access
JPJiankun Peng
Jiankun Peng
JZJiaxuan Zhou
Jiaxuan Zhou
JCJun Chen
Jun Chen
Dawei PiDawei Pi
Dawei Pi
JWJingda Wu
Jingda Wu
Fan DingFan Ding
Fan Ding
The eco-driving strategy based on deep reinforcement learning holds significant potential for achieving energy efficiency, longevity, and safety of fuel cell hybrid electric vehicle (FCHEV). This paper proposes a health-aware eco-driving strategy for FCHEV based on the soft actor-critic (SAC) algorithm. Building upon health awareness of multiple electric components including power battery, fuel cell, and driving motor, this eco-driving strategy integrates energy management system (EMS) and adaptive cruise control (ACC) to comprehensively optimize vehicle performance. By incorporating health-awareness into the eco-driving approach, this study aims to maximize the lifespan of electric components, enhance energy utilization efficiency, and ensure driving comfort and safety. SAC algorithm not only enhances optimization performance in complex nonlinear multi-objective optimization problems but also accommodates real-time control requirements under diverse driving conditions. The simulation results demonstrate that the proposed strategy achieves 0.41% reduction in H2 consumption and same level health maintenance of electric components compared with the dynamic programming benchmark of EMS, while maintaining the comfort within 6% of the gap but safer following performance compared with the intelligent driver model benchmark of ACC. Moreover, the comparative experiments demonstrate that the effectiveness and adaptability of proposed eco driving strategy.

3 September 2020 in Sustainability
Verified
Journal Article
Open access
PDF file
JPJiankun Peng
Jiankun Peng
JJJIWAN JIANG
JIWAN JIANG
Fan DingFan Ding
Fan Ding
Huachun TanHuachun Tan
Huachun Tan
A driving cycle is important to accomplish an accurate depiction of a vehicle’s driving characteristics as the traction motor’s flexible response to stop and start commands. In this paper, the driving cycle construction of an urban hybrid electric bus (HEB) in Zhengzhou, China is developed in which a measurement system integrating global positioning and inertial navigation function is used to acquire driving data. The collected data are then divided into acceleration, deceleration, uniform, and stop fragments. Meanwhile, the velocity fragments are classified into seven state clusters according to their average velocities. A transfer matrix applied to reveal the transfer relationship of velocity clusters can be obtained with statistical analysis. In the third stage, a three-part construction method of driving cycle is designed. Firstly, according to the theory of Markov chain, all the alternative parts that satisfy the construction’s precondition are selected based on the transfer matrix and Monte Carlo method. The Zhengzhou urban driving cycle (ZZUDC) could be determined by comparing the performance measure (PM) values subsequently. Eventually, the method and the cycle are validated by the high correlation coefficient (0.9972) with original data of ZZUDC than that of the other driving cycle (0.9746) constructed with traditional micro-trip and as well by comparing several statistical characteristics of ZZUDC and seven international cycles. Particularly, with around 20.5 L/100 km fuel and approximately 12.8 kwh/100 km electricity consumption, there is a narrow gap between the energy consumption of ZZUDC and WVUCITY, and their characteristics are similar.