Crowd congestion is one of the main causes of modern public safety issues such as stampedes. Conventional crowd congestion monitoring using closed-circuit television (CCTV) video surveillance relies on manual observation, which is tedious and often error-prone in public urban spaces where crowds are dense, and occlusions are prominent. With the aim of managing crowded spaces safely, this study proposes a framework that combines spatial and temporal information to automatically map the trajectories of individual occupants, as well as to assist in real-time congestion monitoring and prediction. Through exploiting both features from CCTV footage and spatial information of the public space, the framework fuses raw CCTV video and floor plan information to create visual aids for crowd monitoring, as well as a sequence of crowd mobility graphs (CMGraphs) to store spatiotemporal features. This framework uses deep learning-based computer vision models, geometric transformations, and Kalman filter-based tracking algorithms to automate the retrieval of crowd congestion data, specifically the spatiotemporal distribution of individuals and the overall crowd flow. The resulting collective crowd movement data is then stored in the CMGraphs, which are designed to facilitate congestion forecasting at key exit/entry regions. We demonstrate our framework on two video data, one public from a train station dataset and the other recorded at a stadium following a crowded football game. Using both qualitative and quantitative insights from the experiments, we demonstrate that the suggested framework can be useful to help assist urban planners and infrastructure operators with the management of congestion hazards.
19 October 2023 in Journal of Manufacturing Science and Engineering
The interrupting swap-allowed blocking job shop problem (ISBJSSP) is a complex scheduling problem that is able to model many manufacturing planning and logistics applications realistically by addressing both the lack of storage capacity and unforeseen production interruptions. Subjected to random disruptions due to machine malfunction or maintenance, industry production settings often choose to adopt dispatching rules to enable adaptive, real-time re-scheduling, rather than traditional methods that require costly re-computation on the new configuration every time the problem condition changes dynamically. To generate dispatching rules for the ISBJSSP problem, we introduce a dynamic disjunctive graph formulation characterized by nodes and edges subjected to continuous deletions and additions. This formulation enables the training of an adaptive scheduler utilizing graph neural networks and reinforcement learning. Furthermore, a simulator is developed to simulate interruption, swapping, and blocking in the ISBJSSP setting. By employing a set of reported benchmark instances, we conduct a detailed experimental study on ISBJSSP instances with a range of machine shutdown probabilities to show that the scheduling policies generated can outperform or are at least as competitive as existing dispatching rules with predetermined priority. This study shows that the ISBJSSP, which requires real-time adaptive solutions, can be scheduled efficiently with the proposed method when production interruptions occur with random machine shutdowns.
10 April 2024 in Smart and Sustainable Manufacturing Systems
Laser powder bed fusion (LPBF) is a popular additive manufacturing process with many advantages compared with traditional (subtractive) manufacturing. However, ensuring the quality of LPBF parts remains a challenge in the manufacturing industry. This work proposes the use of unsupervised learning, specifically, the k-means clustering method, to identify unique melt pool shapes produced during LPBF manufacturing. Melt pools are a key process signature in LPBF and can assist in the evaluation of process quality. k-means is employed multiple times sequentially to produce clusters of melt pools, and the silhouette value is used to identify the optimal number of clusters. The clusters produced by k-means are used as labels to train a deep neural network to classify the melt pool shapes. By inputting the melt pool image and the corresponding LPBF machine process parameters into the neural network, the neural network identifies the melt pool shape to aid human analysis and provide insight into part quality. The trained neural network is interpreted using explainable artificial intelligence (XAI) methods to investigate the relationships between process parameters and the melt pool shape. Using layer-wise relevance propagation, the process parameters that most significantly influence the melt pool shapes are identified. The relationship between process parameters and melt pool shapes can be useful for selecting the process parameters to produce the desired melt pool shapes. In summary, this study describes an approach that combines unsupervised machine learning and XAI methods to effectively enable the analysis and interpretation of melt pools.