Conventional damage detection techniques are gradually being replaced by state-of-the-art smart monitoring and decision-making solutions. Near real-time and online damage assessment in structural health monitoring (SHM) systems is a promising transition toward bridging the gaps between the past’s applicative inefficiencies and the emerging technologies of the future. In the age of the smart city, Internet of Things (IoT), and big data analytics, the complex nature of data-driven civil infrastructures monitoring frameworks has not been fully matured. Machine learning (ML) algorithms are thus providing the necessary tools to augment the capabilities of SHM systems and provide intelligent solutions for the challenges of the past. This article aims to clarify and review the ML frontiers involved in modern SHM systems. A detailed analysis of the ML pipelines is provided, and the in-demand methods and algorithms are summarized in augmentative tables and figures. Connecting the ubiquitous sensing and big data processing of critical information in infrastructures through the IoT paradigm is the future of SHM systems. In line with these digital advancements, considering the next-generation SHM and ML combinations, recent breakthroughs in (1) mobile device-assisted, (2) unmanned aerial vehicles, (3) virtual/augmented reality, and (4) digital twins are discussed at length. Finally, the current and future challenges and open research issues in SHM-ML conjunction are examined. The roadmap of utilizing emerging technologies within ML-engaged SHM is still in its infancy; thus, the article offers an outlook on the future of monitoring systems in assessing civil infrastructure integrity.

Conventional displacement sensors have limitations in practical applications. This paper develops a vision sensor system for remote measurement of structural displacements. An advanced template matching algorithm, referred to as the upsampled cross correlation, is adopted and further developed into a software package for real-time displacement extraction from video images. By simply adjusting the upsampling factor, better subpixel resolution can be easily achieved to improve the measurement accuracy. The performance of the vision sensor is first evaluated through a laboratory shaking table test of a frame structure, in which the displacements at all the floors are measured by using one camera to track either high-contrast artificial targets or low-contrast natural targets on the structural surface such as bolts and nuts. Satisfactory agreements are observed between the displacements measured by the single camera and those measured by high-performance laser displacement sensors. Then field tests are carried out on a railway bridge and a pedestrian bridge, through which the accuracy of the vision sensor in both time and frequency domains is further confirmed in realistic field environments. Significant advantages of the noncontact vision sensor include its low cost, ease of operation, and flexibility to extract structural displacement at any point from a single measurement.

Ubiquitous smartphones have created a significant opportunity to form a low-cost wireless Citizen Sensor network and produce big data for monitoring structural integrity and safety under operational and extreme loads. Such data are particularly useful for rapid assessment of structural damage in a large urban setting after a major event such as an earthquake. This study explores the utilization of smartphone accelerometers for measuring structural vibration, from which structural health and post-event damage can be diagnosed. Widely available smartphones are tested under sinusoidal wave excitations with frequencies in the range relevant to civil engineering structures. Large-scale seismic shaking table tests, observing input ground motion and response of a structural model, are carried out to evaluate the accuracy of smartphone accelerometers under operational, white-noise and earthquake excitations of different intensity. Finally, the smartphone accelerometers are tested on a dynamically loaded bridge. The extensive experiments show satisfactory agreements between the reference and smartphone sensor measurements in both time and frequency domains, demonstrating the capability of the smartphone sensors to measure structural responses ranging from low-amplitude ambient vibration to high-amplitude seismic response. Encouraged by the results of this study, the authors are developing a citizen-engaging and data-analytics crowdsourcing platform towards a smartphone-based Citizen Sensor network for structural health monitoring and post-event damage assessment applications.

This paper presents an innovative structural health monitoring (SHM) platform in terms of how it integrates smartphone sensors, the web, and crowdsourcing. The ubiquity of smartphones has provided an opportunity to create low-cost sensor networks for SHM. Crowdsourcing has given rise to citizen initiatives becoming a vast source of inexpensive, valuable but heterogeneous data. Previously, the authors have investigated the reliability of smartphone accelerometers for vibration-based SHM. This paper takes a step further to integrate mobile sensing and web-based computing for a prospective crowdsourcing-based SHM platform. An iOS application was developed to enable citizens to measure structural vibration and upload the data to a server with smartphones. A web-based platform was developed to collect and process the data automatically and store the processed data, such as modal properties of the structure, for long-term SHM purposes. Finally, the integrated mobile and web-based platforms were tested to collect the low-amplitude ambient vibration data of a bridge structure. Possible sources of uncertainties related to citizens were investigated, including the phone location, coupling conditions, and sampling duration. The field test results showed that the vibration data acquired by smartphones operated by citizens without expertise are useful for identifying structural modal properties with high accuracy. This platform can be further developed into an automated, smart, sustainable, cost-free system for long-term monitoring of structural integrity of spatially distributed urban infrastructure. Citizen Sensors for SHM will be a novel participatory sensing platform in the way that it offers hybrid solutions to transitional crowdsourcing parameters.

State-of-the-art multisensory technologies and heterogeneous sensor networks propose a wide range of response measurement opportunities for structural health monitoring (SHM). Measuring and fusing different physical quantities in terms of structural vibrations can provide alternative acquisition methods and improve the quality of the modal testing results. In this study, a recently introduced SHM concept, SHM with smartphones, is focused to utilize multisensory smartphone features for a hybridized structural vibration response measurement framework. Based on vibration testing of a small-scale multistory laboratory model, displacement and acceleration responses are monitored using two different smartphone sensors, an embedded camera and accelerometer, respectively. Double-integration or differentiation among different measurement types is performed to combine multisensory measurements on a comparative basis. In addition, distributed sensor signals from collocated devices are processed for modal identification, and performance of smartphone-based sensing platforms are tested under different configuration scenarios and heterogeneity levels. The results of these tests show a novel and successful implementation of a hybrid motion sensing platform through multiple sensor type and device integration. Despite the heterogeneity of motion data obtained from different smartphone devices and technologies, it is shown that multisensory response measurements can be blended for experimental modal analysis. Getting benefit from the accessibility of smartphone technology, similar smartphone-based dynamic testing methodologies can provide innovative SHM solutions with mobile, programmable, and cost-free interfaces.

With the help of community participants, smartphones can become useful wireless sensor network (WSN) components, form a self-governing structural health monitoring (SHM) system, and merge structural mechanics with participatory sensing and server computing. This paper presents a methodology and framework of such a cyber-physical system (CPS) that generates a bridge finite element model (FEM) integrated with vibration measurements from smartphone WSNs and centralized/distributed computational facilities, then assesses structural reliability based on updated FEMs. Structural vibration data obtained from smartphones are processed on a server to identify modal frequencies of an existing bridge. Without design drawings and supportive documentation but field measurements and observations, FEM of the bridge is drafted with uncertainties in the structural mass, stiffness, and boundary conditions (BCs). Then, 2700 FEMs are autonomously generated, and the baseline FEM is updated by minimizing the error between the crowdsourcing-based modal identification results and the FEM analysis. Furthermore, using 151 strong ground motion records from databases, the bridge response time history simulations are conducted to obtain displacement demand distribution. Finally, based on reference performance criteria, structural reliability of the bridge is estimated. Integrating the cyber (FEM analysis) and the physical (the bridge structure and measured vibration characteristics) worlds, this crowdsourcing-based CPS can provide a powerful tool for supporting rapid, remote, autonomous, and objective infrastructure-related decision-making. This study presents a new example of the emerging fourth industrial revolution from structural engineering and SHM perspective.