Equipment and workers are two important resources in the construction industry. Performance monitoring of these resources would help project managers improve the productivity rates of construction jobsites and discover potential performance issues. A typical construction workface monitoring system consists of four major levels: location tracking, activity recognition, activity tracking, and performance monitoring. These levels are employed to evaluate work sequences over time and also assess the workers’ and equipment’s well-being and abnormal edge cases. Results of an automated performance monitoring system could be used to employ preventive measures to minimize operating/repair costs and downtimes. The authors of this paper have studied the feasibility of implementing a wide range of technologies and computational techniques for automated activity recognition and tracking of construction equipment and workers. This paper provides a comprehensive review of these methods and techniques as well as describes their advantages, practical value, and limitations. Additionally, a multifaceted comparison between these methods is presented, and potential knowledge gaps and future research directions are discussed.
Automatically recognizing and tracking construction equipment activities is the first step towards performance monitoring of a job site. Recognizing equipment activities helps construction managers to detect the equipment downtime/idle time in a real-time framework, estimate the productivity rate of each equipment based on its progress, and efficiently evaluate the cycle time of each activity. Thus, it leads to project cost reduction and time schedule improvement. Previous studies on this topic have been based on single sources of data (e.g., kinematic, audio, video signals) for automated activity-detection purposes. However, relying on only one source of data is not appropriate, as the selected data source may not be applicable under certain conditions and fails to provide accurate results. To tackle this issue, the authors propose a hybrid system for recognizing multiple activities of construction equipment. The system integrates two major sources of data—audio and kinematic—through implementing a robust data fusion procedure. The presented system includes recording audio and kinematic signals, preprocessing data, extracting several features, as well as dimension reduction, feature fusion, equipment activity classification using Support Vector Machines (SVM), and smoothing labels. The proposed system was implemented in several case studies (i.e., ten different types and equipment models operating at various construction job sites) and the results indicate that a hybrid system is capable of providing up to 20% more accurate results, compared to cases using individual sources of data.
Material quantity take-off is a necessary factor in estimating the cost of construction projects; accordingly, fast and precise estimations would better facilitate the overall construction process. In recent years, several Building Information Modeling (BIM) based applications (e.g., Autodesk Revit, Tekla Structure, Autodesk Navisworks Manage, and Solibri Model Checker) have emerged to assist in performing quantity take-off. Quantity take-off measurement using these applications is accurate when the elements length multiplies with their precise section area. Still, the process encounters errors when using element volumes or Industry Foundation Classes (IFC). In this study, the authors examined the embedded quantity take-off feature of these applications for sample steel and reinforced concrete structure and provided precautions in employing BIM properties. Consequently, an automated approach has been applied to facilitate an accurate quantity take-off by using an Application Program Interface (API) extracting information from a Navisworks model as well as database management systems. A case study is subsequently presented to demonstrate and validate the proposed methodology.
Several studies have been conducted to automatically recognize activities of construction equipment using their generated sound patterns. Most of these studies are focused on single-machine scenarios under controlled environments. However, real construction job sites are more complex and often consist of several types of equipment with different orientations, directions, and locations working simultaneously. The current state-of-research for recognizing activities of multiple machines on a job site is hardware-oriented, on the basis of using microphone arrays (i.e., several single microphones installed on a board under specific geometric layout) and beamforming principles for classifying sound directions for each machine. While effective, the common hardware-approach has limitations and using microphone arrays is not always a feasible option at ordinary job sites. In this paper, the authors proposed a software-oriented approach using Deep Neural Networks (DNNs) and Time-Frequency Masks (TFMs) to address this issue. The proposed method requires using single microphones, as the sound sources could be differentiated by training a DNN. The presented approach has been tested and validated under simulated job site conditions where two machines operated simultaneously. Results show that the average accuracy for soft TFM is 38% higher than binary TFM.