1 January 2018 in Transportation Science
Optimizing operations at electric vehicle (EV) battery swap stations is internally motivated by the movement to make transportation cleaner and more efficient. An EV battery swap station allows EV owners to quickly exchange their depleted battery for a fully charged battery. We introduce the EV Battery-Swap Station Management Problem (EVB-SSMP), which models battery charging and discharging operations at an EV battery swap station facing nonstationary, stochastic demand for battery swaps, nonstationary prices for charging depleted batteries, and nonstationary prices for discharging fully charged batteries. Discharging through vehicle-to-grid is beneficial for aiding power load balancing. The objective of the EVB-SSMP is to determine the optimal policy for charging and discharging batteries that maximizes expected total profit over a fixed time horizon. The EVB-SSMP is formulated as a finite-horizon, discrete-time Markov decision problem and an optimal policy is found using dynamic programming. We derive structural properties, to include sufficiency conditions that ensure the existence of a monotone optimal policy. Utilizing available demand and electricity pricing data, we design and conduct two main computational experiments to obtain policy insights regarding the management of EV battery swap stations. We compare the optimal policy to two benchmark policies that are easily implementable by swap station managers. Policy insights include the relationship between the minimum battery level and the number of EVs in a local service area, the pricing incentive necessary to encourage effective discharge behavior, and the viability of EV battery swap stations under many conditions. The online appendix is available at https://doi.org/10.1287/trsc.2016.0676 .
1 June 2017 in European Journal of Operational Research
16 September 2014 in Health Care Management Science
1 January 2021 in INFORMS Journal on Computing
Military medical planners must consider how aerial medical evacuation (MEDEVAC) assets will be dispatched when preparing for and supporting high-intensity combat operations. The dispatching authority seeks to dispatch MEDEVAC assets to prioritized requests for service, such that battlefield casualties are effectively and efficiently transported to nearby medical-treatment facilities. We formulate and solve a discounted, infinite-horizon Markov decision process (MDP) model of the MEDEVAC dispatching problem. Because the high dimensionality and uncountable state space of our MDP model renders classical dynamic programming solution methods intractable, we instead apply approximate dynamic programming (ADP) solution methods to produce high-quality dispatching policies relative to the currently practiced closest-available dispatching policy. We develop, test, and compare two distinct ADP solution techniques, both of which utilize an approximate policy iteration (API) algorithmic framework. The first algorithm uses least-squares temporal differences (LSTD) learning for policy evaluation, whereas the second algorithm uses neural network (NN) learning. We construct a notional, yet representative planning scenario based on high-intensity combat operations in southern Azerbaijan to demonstrate the applicability of our MDP model and to compare the efficacies of our proposed ADP solution techniques. We generate 30 problem instances via a designed experiment to examine how selected problem features and algorithmic features affect the quality of solutions attained by our ADP policies. Results show that the respective policies determined by the NN-API and LSTD-API algorithms significantly outperform the closest-available benchmark policies in 27 (90%) and 24 (80%) of the problem instances examined. Moreover, the NN-API policies significantly outperform the LSTD-API policies in each of the problem instances examined. Compared with the closest-available policy for the baseline problem instance, the NN-API policy decreases the average response time of important urgent (i.e., life-threatening) requests by 39 minutes. These research models, methodologies, and results inform the implementation and modification of current and future MEDEVAC tactics, techniques, and procedures, as well as the design and purchase of future aerial MEDEVAC assets.
1 May 2020 in Computers & Operations Research