14 September 2021 in IEEE Transactions on Neural Networks and Learning Systems
A traveling salesman problem (TSP) is a well-known NP-complete problem. Traditional TSP presumes that the locations of customers and the traveling time among customers are fixed and constant. In real-life cases, however, the traffic conditions and customer requests may change over time. To find the most economic route, the decisions can be made constantly upon the time-point when the salesman completes his service of each customer. This brings in a dynamic version of the traveling salesman problem (DTSP), which takes into account the information of real-time traffic and customer requests. DTSP can be extended to a dynamic pickup and delivery problem (DPDP). In this article, we ameliorate the attention model to make it possible to perceive environmental changes. A deep reinforcement learning algorithm is proposed to solve DTSP and DPDP instances with a size of up to 40 customers in 100 locations. Experiments show that our method can capture the dynamic changes and produce a highly satisfactory solution within a very short time. Compared with other baseline approaches, more than 5% improvements can be observed in many cases.
16 February 2022 in IEEE Transactions on Neural Networks and Learning Systems
Deep reinforcement learning (DRL) has recently shown its success in tackling complex combinatorial optimization problems. When these problems are extended to multiobjective ones, it becomes difficult for the existing DRL approaches to flexibly and efficiently deal with multiple subproblems determined by the weight decomposition of objectives. This article proposes a concise meta-learning-based DRL approach. It first trains a meta-model by meta-learning. The meta-model is fine-tuned with a few update steps to derive submodels for the corresponding subproblems. The Pareto front is then built accordingly. Compared with other learning-based methods, our method can greatly shorten the training time of multiple submodels. Due to the rapid and excellent adaptability of the meta-model, more submodels can be derived so as to increase the quality and diversity of the found solutions. The computational experiments on multiobjective traveling salesman problems and multiobjective vehicle routing problems with time windows demonstrate the superiority of our method over most of the learning-based and iteration-based approaches.
11 December 2018 in IEEE Transactions on Intelligent Transportation Systems
10 January 2022 in Soft Computing
22 April 2019 in IEEE Transactions on Intelligent Transportation Systems
An importer in Hong Kong employs vehicles, all from external transport companies, to deliver products to its customers geographically scattered in different locations. The delivery plan needs to simultaneously minimize the total traveling cost and balance the profits among all transport companies. This transportation practice engenders a new variant of vehicle routing problems, called the vehicle routing problem with outsourcing and profit balancing (VRPOPB). The profits are balanced by maximizing the minimum unit profit of all transport companies, which can effectively avoid the occurrence of distorted solutions. We develop two multi-objective local search (MOLS) algorithms for the problem, where the second one enhances the first one by incorporating several additional techniques. To evaluate our algorithms, we conduct extensive experiments on 57 generated instances and a real case obtained from a food importer in Hong Kong. The computational results clearly demonstrate that our enhanced MOLS algorithm is able to achieve satisfactory solutions.
19 February 2020 in IEEE Transactions on Intelligent Transportation Systems
This paper presents an arc-routing problem with time-dependent penalty cost (ARPTPC), which arises from a practical application in garbage collection service. ARPTPC considers the minimization of service cost, traveling cost and penalty cost. While the first two parts are known as the traditional objectives of arc-routing problems, the third part is determined by the parking pattern and service period on each arc. We formulate the problem by using a mixed integer linear model. To solve it, we design a dynamic programming to determine the optimal service beginning time on each edge when a routing sequence is given. We then propose a problem-specific intelligent heuristic search approach involving six neighborhood operators, a priority maintenance mechanism and a perturbation process. Through numerical experiments, we demonstrate that the proposed approach is able to produce satisfactory solutions of ARPTPC. Additional experiments are also carried out to analyze the effects of operators and parameters on solution quality.