The purpose of this article is to present a framework for capturing and analyzing social media posts using a sentiment analysis tool to determine the views of the general public towards autonomous mobility. The paper presents the systems used and the results of this analysis, which was performed on social media posts from Twitter and Reddit. To achieve this, a specialized lexicon of terms was used to query social media content from the dedicated application programming interfaces (APIs) that the aforementioned social media platforms provide. The captured posts were then analyzed using a sentiment analysis framework, developed using state-of-the-art deep machine learning (ML) models. This framework provides labeling for the captured posts based on their content (i.e., classifies them as positive or negative opinions). The results of this classification were used to identify fears and autonomous mobility aspects that affect negative opinions. This method can provide a more realistic view of the general public’s perception of automated mobility, as it has the ability to analyze thousands of opinions and encapsulate the users’ opinion in a semi-automated way.
Potholes on the road surface are a significant safety hazard and can cause severe damage to vehicles. Identifying and repairing potholes is a challenging task that requires efficient and accurate methods. In recent years, deep learning models, such as U-Nets and transformers, have been used for image segmentation tasks with promising results. This paper proposes a transformer-based model and in particular the SegFormer framework, for pothole segmentation using high-resolution images captured from a road inspection vehicle. The proposed network outperformed the traditional U-Net model that demonstrates state-of-the-art performance in various segmentation tasks, achieving an average F1-score close to 80%. The results show that the proposed method can effectively identify and localize potholes, providing a useful auxiliary tool for road maintenance and safety.
27 April 2020 in IEEE Computer Graphics and Applications
Serious games are receiving increasing attention in the field of Cultural Heritage (CH) applications. A special field of CH and education is Intangible Cultural Heritage and particularly dance. Machine learning (ML) tools are necessary elements for the success of a serious game platform since they introduce intelligence in processing and analysis of users' interactivity. ML provides intelligent scoring and monitoring capabilities of the user's progress in a serious game platform. In this paper, we introduce a deep learning model for motion primitive classification. The model combines a convolutional processing layer with a bi-directional analysis module. This way, RGB information is efficiently handled by the hierarchies of convolutions, while the bi-directional properties of an LSTM model are retained. The resulting Convolutionally Enhanced Bi-directional LSTM (CEBi-LSTM) architecture is less sensitive to skeleton errors, occurring using low-cost sensors, such as Kinect, while simultaneously handling the high amount of detail when using RGB visual information.
The use of UAVs and artificial intelligence has emerged as a promising approach for monitoring road defects. This paper highlights the importance of these technologies in improving road inspection, maintenance, and safety. Traditional methods for inspecting roads are often time-consuming, expensive, and can put human inspectors in dangerous situations. However, drones equipped with high-resolution cameras and sensors can capture pavement image data quickly and safely. Deep learning algorithms can then analyze this data to identify and localize areas in need of repair. By leveraging these technologies, engineers and road construction experts can more efficiently monitor and maintain roads, reducing the costs associated with repairs and maintenance, while in parallel improving safety. To this end, this work emphasizes the potential of UAVs in conjunction with deep learning techniques to provide a more comprehensive view of road conditions, allowing for targeted repairs and more effective maintenance strategies, such as prefabrication and robotic interventions. Experimental results using objective evaluation criteria, such as precision, recall, F1-score, and IoU are promising, which entails that this study advocates for the adoption of these technologies to enhance the monitoring and maintenance of road infrastructures.
Man overboard is an emergency in which fast and efficient detection of the critical event is the key factor for the recovery of the victim. Its severity urges the utilization of intelligent video surveillance systems that monitor the ship’s perimeter in real time and trigger the relative alarms that initiate the rescue mission. In terms of deep learning analysis, since man overboard incidents occur rarely, they present a severe class imbalance problem, and thus, supervised classification methods are not suitable. To tackle this obstacle, we follow an alternative philosophy and present a novel deep learning framework that formulates man overboard identification as an anomaly detection task. The proposed system, in the absence of training data, utilizes a multi-property spatiotemporal convolutional autoencoder that is trained only on the normal situation. We explore the use of RGB video sequences to extract specific properties of the scene, such as gradient and saliency, and utilize the autoencoders to detect anomalies. To the best of our knowledge, this is the first time that man overboard detection is made in a fully unsupervised manner while jointly learning the spatiotemporal features from RGB video streams. The algorithm achieved 97.30% accuracy and a 96.01% F1-score, surpassing the other state-of-the-art approaches significantly.