The emerging digitalization in today’s industrial environments allows manufacturers to store online knowledge about production and use it to make better informed management decisions. This paper proposes a multi-agent framework enhanced with digital twin (DT) for production scheduling and optimization. Decentralized scheduling agents interact to efficiently manage the work allocation in different segments of production. A DT is used to evaluate the performance of different scheduling decisions and to avoid potential risks and bottlenecks. Production managers can supervise the system’s decision-making processes and manually regulate them online. The multi-agent system (MAS) uses asset administration shells (AASs) for data modelling and communication, enabling interoperability and scalability. The framework was deployed and tested in an industrial pilot coming from the bicycle production industry, optimizing and controlling the short-term production schedule of the different departments. The evaluation resulted in a higher production rate, thus achieving higher production volume in a shorter time span. Managers were also able to coordinate schedules from different departments in a dynamic way and achieve early bottleneck detection.
Production scheduling is a critical task in the management of manufacturing systems. It is difficult to derive an optimal schedule due to the problem complexity. Computationally expensive and time-consuming solutions have created major issues for companies trying to respect their customers’ demands. Simple dispatching rules have typically been applied in manufacturing practice and serve as a good scheduling option, especially for small and midsize enterprises (SMEs). However, in recent years, the progress in smart systems enabled by artificial intelligence (AI) and machine learning (ML) solutions has revolutionized the scheduling approach. Under different production circumstances, one dispatch rule may perform better than others, and expert knowledge is required to determine which rule to choose. The objective of this work is to design and implement a framework for the modeling and deployment of a deep reinforcement learning (DRL) agent to support short-term production scheduling. The DRL agent selects a dispatching rule to assign jobs to manufacturing resources. The model is trained, tested and evaluated using a discrete event simulation (DES) model that simulates a pilot case from the bicycle production industry. The DRL agent can learn the best dispatching policy, resulting in schedules with the best possible production makespan.
Industry 4.0 (I4.0) aims at achieving the interconnectivity of multiple industrial assets from different hierarchical layers within a manufacturing environment. The Asset Administration Shell (AAS) is a pilar component of I4.0 for the digital representation of assets and can be applied in both physical and digital assets, such as enterprise software, artificial intelligence (AI) agents, and databases. Multi-agent systems (MASs), in particular, are useful in the decentralized optimization of complex problems and applicable in various planning or scheduling scenarios that require the system’s ability to adapt to any given problem by using different optimization methods. In order to achieve this, a universal model for the agent’s information, communication, and behaviors should be provided in a way that is interoperable with the rest of the I4.0 assets and agents. To address these challenges, this work proposes an AAS-based information model for the description of scheduling agents. It allows multiple AI methods for scheduling, such as heuristics, mathematical programming, and deep reinforcement learning, to be encapsulated within a single agent, making it adjustable to different production scenarios. The software implementation of the proposed architecture aims to provide granularity in the deployment of scheduling agents which utilize the underlying AAS metamodel. The agent was implemented using the SARL agent-oriented programming (AOP) language and deployed in an open-source MAS platform. The system evaluation in a real-life bicycle production scenario indicated the agent’s ability to adapt and provide fast and accurate scheduling results.
Digital manufacturing tools aim to provide intelligent solutions that will help manufacturing industry adapt to the volatile work environment. Modern technologies such as artificial intelligence (AI) and digital twins (DT) are primarily exploited in a way to simulate and select efficient solutions from a broad range of alternative decisions. This work aims to couple DT and AI technologies in a framework where training, testing, and deployment of AI agents is made more efficient in production scheduling applications. A set of different AI agents were developed, utilizing key optimization technologies such as mathematical programming, deep learning, heuristic algorithms, and deep reinforcement learning are developed to address hard production schedule optimization problems. DT is the pilar technology, which is used to simulate accurately the production environment and allow the agents to reach higher efficiency. On top of that, Asset Administration Shell (AAS) technology, being the pilar components of Industry 4.0 (I4.0), was used for transferring data in a standardized format in order to provide interoperability within the multi-agent system (MAS) and compatibility with the rest of I4.0 ecosystem. The system validation was provided in the manufacturing system of the bicycle industry by improving the business performance.
Resilience in production environments is defined as the system’s ability to avoid, adapt, and rapidly recover from disruptive events, attaining normal operational conditions with minimal time and financial investment. Current methods lack the capability to quantify risks based on real-time data from production devices, creating a critical gap. This article presents a novel method aimed at enhancing resilience by integrating data from micro and meso levels within precision machining production plants. By utilizing real-time monitoring data, from machines and production processes, the proposed approach is based on the assessment of risks of failure of machines and early detection of anomalies in machining processes, to support decision-making. Leveraging the Industrial Internet of Things (IIoT), the method collects and analyses real-time machines and machining process data for risk assessment and early anomaly detection. The proposed method minimizes the impact of unexpected failures by incorporating failure risk calculations into plant-level decision-making. Validation of the method was conducted using a milling machine in a controlled laboratory setting, demonstrating the significance of real-time data and health assessment in developing resilient industrial systems. Preliminary results indicate strong potential for industrial application, with the next step being implemented in a production plant.
Resilience is increasingly critical in modern manufacturing, especially within complex supply chains. Information sharing based on data sovereignty principles enables informed, timely decisions, improving supply chain resilience. Data space technologies, like International Data Spaces (IDS) and Gaia-X, support secure, multi-stakeholder data sharing. This work integrates IDS and Gaia-X data spaces into a data spaces framework for resilience (DSF4R). The framework facilitates secure data exchange using a compute on demand environment, ensuring data remains secure within the provider’s system while enabling external services to process it. This eliminates the need for data transfer, ensuring privacy and compliance. Applied in a real-world industrial use case from the steel industry sector, it demonstrates enhanced resilience and broader applicability.