22 October 2021 in IEEE Access
Fire is one of the most commonly occurring disasters and is the main cause of catastrophic personal injury and devastating property damage. An early detection system is necessary to prevent fires from spreading out of control. In this paper, we propose a multistage fire detection method using convolutional neural networks (CNNs) and long short-term memory (LSTM) networks. In the first stage, fire candidates are detected by using their salient features, such as their color, flickering frequency, and brightness. In the second stage, a pretrained CNN model is used to extract the 2D features of flames that are the input for the LSTM network. In the last stage, a softmax classifier is utilized to determine whether the flames represent a true fire or a nonfire moving object. The experimental results show that our proposed method can achieve competitive performance compared with other state-of-the-art methods and is suitable for real-world applications.
9 November 2022 in IEEE Access
There has been an ongoing demand for monitoring landslides due to the heavy economic losses and casualties caused by such natural disasters. In this paper, we introduce a swift landslide detection system that can detect and segment landslides occurring on roads. To tackle the challenges of data collection, we propose an automatic annotation procedure to create a new landslide dataset consisting of 2963 images, termed the LandslidePTIT dataset. Additionally, we construct a novel deep learning architecture that can perform both classification and segmentation tasks well from a few annotated images of landslides. Specifically, the model consists of four main modules that are delicately designed to solve the few-shot segmentation problem using landslide images, namely hypercorrelation construction, attentive squeeze block, a cross-feature layer, and broadcast and squeeze layer. Experimental results exhibit the superiority of the proposed methods in comparison with competitive baselines, in terms of both quantitative and qualitative manners.
21 July 2020 in IEEE Access
Sinkholes can cause severe property damage and threaten public safety. Therefore, the early prediction and detection of sinkholes are important measures for protecting both citizenry and infrastructure. Although many studies have made significant progress on sinkhole detection, challenges remain, including long-term data collection and the discovery of lightweight machine learning models that can be deployed to analyze sinkhole images. In this paper, we propose a method that takes advantage of the recent success of deep learning models to detect and track sinkholes via video streaming. Our system consists of two main stages: sinkhole detection with a cascaded convolutional neural network and sinkhole tracking with a data association algorithm. The experimental results show that a sinkhole can be tracked in real time using the dataset [1]. Furthermore, we implement the system on a Jetson TX2 embedded board (weighing 85 grams), which can operate at 13.2 FPS (frames per second). With an average IoU (intersection over union) score of 88% for sinkhole tracking and an accuracy of 97,6% for sinkhole detection on a 45-minute dataset, this study demonstrates the feasibility of sinkhole detection and tracking using IR images and their suitability for practical applications.
19 September 2023 in IEEE Sensors Journal
Sign Language Recognition (SLR) is the task of recognizing human actions that represent the language, which is not only helpful for deaf-mute people but also a means for human-computer interaction. Although data from wearable sensors have been proven useful for this task, it is still difficult to collect such data for training deep fusion models. In this study, our contributions are two-fold: 1) we collect and release a dataset for SLR consisting of both video and sensor data obtained from wearable devices, and 2) we propose the first self-learning fusion model for SLR, termed STSLR, that utilizes a portion of annotated data to simulate sensor embedding vectors. By virtue of the simulated sensor features, the video features from video-only data are enhanced to allow the fusion model to recognize the annotated actions more effectively. We empirically demonstrate the superiority of STSLR over competitive benchmarks on our newly released dataset and well-known publicly available ones.
19 March 2026 in Pattern Recognition Letters
26 January 2026 in IEEE Wireless Communications Letters
Recently, environment reconstruction (ER) in integrated sensing and communication (ISAC) systems has emerged as a promising approach for achieving high-resolution environmental perception. However, the initial results obtained from ISAC systems are coarse and often unsatisfactory due to the high sparsity of the point clouds and significant noise variance. To address this problem, we propose a noise–sparsity-aware diffusion model (NSADM) post-processing framework. Leveraging the powerful data recovery capabilities of diffusion models, the proposed scheme exploits spatial features and the additive nature of noise to enhance point cloud density and denoise the initial input. Simulation results demonstrate that the proposed method significantly outperforms existing model-based and deep learning-based approaches in terms of Chamfer distance and root mean square error.