This paper addresses the critical environmental issue of effectively managing construction and demolition waste (CDW), which has seen a global surge due to rapid urbanization. With the advent of deep learning-based computer vision, this study focuses on improving intelligent identification of valuable recyclables from cluttered and heterogeneous CDW streams in material recovery facilities (MRFs) by optimally leveraging both visual and spatial features (depth). A high-quality CDW RGB-D dataset was curated to capture MRF stream complexities often overlooked in prior studies, and comprises over 3500 images for each modality and more than 160,000 dense object instances of diverse CDW materials with high resource value. In contrast to former studies which directly concatenate RGB and depth features, this study introduces a new depth fusion strategy that utilizes computationally efficient convolutional operations at the end of the conventional waste segmentation architecture to effectively fuse colour and depth information. This avoids cross-modal interference and maximizes the use of distinct information present in the two different modalities. Despite the high clutter and diversity of waste objects, the proposed RGB-DL architecture achieves a 13% increase in segmentation accuracy and a 36% reduction in inference time when compared to the direct concatenation of features. The findings of this study emphasize the benefit of effectively incorporating geometrical features to complement visual cues. This approach helps to deal with the cluttered and varied nature of CDW streams, enhancing automated waste recognition accuracy to improve resource recovery in MRFs. This, in turn, promotes intelligent solid waste management for efficiently managing environmental concerns.
24 November 2024 in Journal of Environmental Management
Efficient recycling strategies are crucial for mitigating the adverse environmental impacts of escalating construction and demolition waste (CDW). While automated identification via deep-learning is a promising direction, localizing CDW recyclables is uniquely challenging due to significant clutter and compositional complexity. Recognizing that accurate and fast localization is a strong prerequisite for swift robotic action, this study provides a comprehensive assessment of state-of-the-art (s.o.t.a) real-time instance segmentation of recyclables from complex CDW streams. Unlike previous studies that simplify the real-world conditions, this study curates and employs a high-quality CDW instance segmentation dataset tailored to capture often-ignored domain intricacies such as deformation, contamination, intricate class distinctions, scale variations, and high levels of clutter, ensuring practical applicability. The results show that even advanced networks struggle with complexity of real CDW streams due to high clutter, with segmentation accuracy not surpassing 50%. To address this, the study proposes integrating patch-based inferencing techniques, which help the model focus on cluttered regions more effectively, boosting overall performance by a notable 12.9%. Additionally, to enhance the zero-shot capabilities of s.o.t.a prompt-based real-time segmentation for identifying CDW recyclables, a simple yet effective domain-transfer framework is proposed, substantially increasing number of correct mask predictions by 68%. This study serves as a practical reference for applying deep-learning tools in automated environmental management tasks such as waste sorting and suggests the best architectural framework for practical use.
Instance segmentation is the fundamental computer vision task that facilitates robotic sorting by localizing object instances. This task becomes particularly challenging when dealing with Construction and Demolition Waste (CDW), as CDW objects often exhibit complex, non-uniform shapes and are frequently overlapped or occluded due to cluttering. Current waste segmentation benchmarks relying on fully connected networks for pixel-wise classification overlook crucial shape and boundary information. It is imperative to use shape information to guide mask prediction in order to improve waste segmentation accuracy. In response, this paper introduces ShARP-WasteSeg; a Shape-Aware Real-Time Precise Waste Segmentation framework. This conceptually straightforward approach mutually learns objects masks and boundaries within a single network, resulting in sharper mask predictions for complex recyclables despite cluttering. ShARP-WasteSeg enhances the segmentation process by extracting boundary features from depth maps, which are rich in shape and location information. These features complement RGB boundary features, guiding the final mask predictions through feature fusion. Moreover, it leverages the ground-breaking capabilities of cross-stage partial networks to optimize the feature extraction process, permitting real-time applicability of the multi-modal approach. Tested on a challenging CDW dataset representing real conditions, ShARP-WasteSeg improved Mask Average Precision (AP) by 7.91%, and the boundary-sensitive Boundary Average Precision by a significant 11.44%, demonstrating the effectiveness of the proposed shape-aware approach in increasing boundary quality of predicted masks for cluttered CDW recyclables.
In this paper, a system identification method for continuous fractional-order Hammerstein models is proposed. A block structured nonlinear system constituting a static nonlinear block followed by a fractional-order linear dynamic system is considered. The fractional differential operator is represented through the generalized operational matrix of block pulse functions to reduce computational complexity. A special test signal is developed to isolate the identification of the nonlinear static function from that of the fractional-order linear dynamic system. The merit of the proposed technique is indicated by concurrent identification of the fractional order with linear system coefficients, algebraic representation of the immeasurable nonlinear static function output, and permitting use of non-iterative procedures for identification of the nonlinearity. The efficacy of the proposed method is exhibited through simulation at various signal-to-noise ratios.