3 November 2022 in International Journal of Production Research
Decision-making in supply chains is challenged by high complexity, a combination of continuous and discrete processes, integrated and interdependent operations, dynamics, and adaptability. The rapidly increasing data availability, computing power and intelligent algorithms unveil new potentials in adaptive data-driven decision-making. Reinforcement Learning, a class of machine learning algorithms, is one of the data-driven methods. This semi-systematic literature review explores the current state of the art of reinforcement learning in supply chain management (SCM) and proposes a classification framework. The framework classifies academic papers based on supply chain drivers, algorithms, data sources, and industrial sectors. The conducted review revealed a few critical insights. First, the classic Q-learning algorithm is still the most popular one. Second, inventory management is the most common application of reinforcement learning in supply chains, as it is a pivotal element of supply chain synchronisation. Last, most reviewed papers address toy-like SCM problems driven by artificial data. Therefore, shifting to industry-scale problems will be a crucial challenge in the next years. If this shift is successful, the vision of data-driven decision-making in real-time could become a reality.
9 March 2023 in Journal of Intelligent Manufacturing
As an essential scheduling problem with several practical applications, the parallel machine scheduling problem (PMSP) with family setups constraints is difficult to solve and proven to be NP-hard. To this end, we present a deep reinforcement learning (DRL) approach to solve a PMSP considering family setups, aiming at minimizing the total tardiness. The PMSP is first modeled as a Markov decision process, where we design a novel variable-length representation of states and actions, so that the DRL agent can calculate a comprehensive priority for each job at each decision time point and then select the next job directly according to these priorities. Meanwhile, the variable-length state matrix and action vector enable the trained agent to solve instances of any scales. To handle the variable-length sequence and simultaneously ensure the calculated priority is a global priority among all jobs, we employ a recurrent neural network, particular gated recurrent unit, to approximate the policy of the agent. The agent is trained based on Proximal Policy Optimization algorithm. Moreover, we develop a two-stage training strategy to enhance the training efficiency. In the numerical experiments, we first train the agent on a given instance and then employ it to solve instances with much larger scales. The experimental results demonstrate the strong generalization capability of the trained agent and the comparison with three dispatching rules and two metaheuristics further validates the superiority of this agent.
19 August 2024 in International Journal of Production Research
12 March 2019 in Procedia Computer Science
MKMohammed Saif Sheikh Dastagir Kota
Mohammed Saif Sheikh Dastagir Kota
In 2016, Microsoft released the mixed reality (MR) head-mounted display (HMD) HoloLensTM. As augmented reality (AR) devices, the HoloLensTM can enrich the user’s perceived environment with virtual information. However, Microsoft does not consider the HoloLensTM as AR device, but as the first MR device, since it has some additional features compared to competing AR devices. Especially to mention is the possibility to interact with virtual objects and vice versa. This paper shall provide an insight about the application potentials of MR in the field of production and logistics. For this purpose, we present the findings of a literature review about the current state of research concerning the application of Microsoft HoloLensTM in the field of production and logistics. Furthermore, we present a small HoloLensTM application, which we have developed to evaluate the capabilities of the device. Several persons tested our application and gave us feedback concerning the utility and usability of the HoloLensTM. We provide an evaluation of the user experiences at the end of the paper.
1 June 2021 in Expert Systems with Applications