In the Digital Cultural Heritage (DCH) domain, the semantic segmentation of 3D Point Clouds with Deep Learning (DL) techniques can help to recognize historical architectural elements, at an adequate level of detail, and thus speed up the process of modeling of historical buildings for developing BIM models from survey data, referred to as HBIM (Historical Building Information Modeling). In this paper, we propose a DL framework for Point Cloud segmentation, which employs an improved DGCNN (Dynamic Graph Convolutional Neural Network) by adding meaningful features such as normal and colour. The approach has been applied to a newly collected DCH Dataset which is publicy available: ArCH (Architectural Cultural Heritage) Dataset. This dataset comprises 11 labeled points clouds, derived from the union of several single scans or from the integration of the latter with photogrammetric surveys. The involved scenes are both indoor and outdoor, with churches, chapels, cloisters, porticoes and loggias covered by a variety of vaults and beared by many different types of columns. They belong to different historical periods and different styles, in order to make the dataset the least possible uniform and homogeneous (in the repetition of the architectural elements) and the results as general as possible. The experiments yield high accuracy, demonstrating the effectiveness and suitability of the proposed approach.
Correctly identifying gait phases is a prerequisite to achieve a spatial/temporal characterization of muscular recruitment during walking. Recent approaches have addressed this issue by applying machine learning techniques to treadmill-walking data. We propose a deep learning approach for surface electromyographic (sEMG)-based classification of stance/swing phases and prediction of the foot–floor-contact signal in more natural walking conditions (similar to everyday walking ones), overcoming constraints of a controlled environment, such as treadmill walking. To this aim, sEMG signals were acquired from eight lower-limb muscles in about 10.000 strides from 23 healthy adults during level ground walking, following an eight-shaped path including natural deceleration, reversing, curve, and acceleration. By means of an extensive evaluation, we show that using a multi layer perceptron to learn hidden features provides state of the art performances while avoiding features engineering. Results, indeed, showed an average classification accuracy of for learned subjects and for unlearned ones, while mean absolute difference ( ) between phase transitions timing predictions and footswitch data was ms and ms for heel-strike and toe off, respectively. The suitable performance achieved by the proposed method suggests that it could be successfully used to automatically classify gait phases and predict foot–floor-contact signal from sEMG signals during level ground walking.
28 April 2021 in IEEE Transactions on Neural Systems and Rehabilitation Engineering
Machine-learning techniques are suitably employed for gait-event prediction from only surface electromyographic (sEMG) signals in control subjects during walking. Nevertheless, a reference approach is not available in cerebral-palsy hemiplegic children, likely due to the large variability of foot-floor contacts. This study is designed to investigate a machine-learning-based approach, specifically developed to binary classify gait events and to predict heel-strike (HS) and toe-off (TO) timing from sEMG signals in hemiplegic-child walking. To this objective, sEMG signals are acquired from five hemiplegic-leg muscles in nearly 2500 strides from 20 hemiplegic children, acknowledged as Winters’ group 1 and 2. sEMG signals, segmented in overlapping windows of 600 samples (pace = 5 samples), are used to train a multi-layer perceptron model. Intra-subject and inter-subject experimental settings are tested. The best-performing intra-subject approach is able to provide in the hemiplegic population a mean classification accuracy (±SD) of 0.97±0.01 and a suitable prediction of HS and TO events, in terms of average mean absolute error (MAE, 14.8±3.2 ms for HS and 17.6±4.2 ms for TO) and F1-score (0.95±0.03 for HS and 0.92±0.07 for TO). These results outperform previous sEMG-based attempts in cerebral-palsy populations and are comparable with outcomes achieved by reference approaches in control populations. In conclusion, the findings of the study prove the feasibility of neural networks in predicting the two main gait events using surface EMG signals, also in condition of high variability of the signal to predict as in hemiplegic cerebral palsy.
Background: Muscular-activity timing is useful information that is extractable from surface EMG signals (sEMG). However, a reference method is not available yet. The aim of this study is to investigate the reliability of a novel machine-learning-based approach (DEMANN) in detecting the onset/offset timing of muscle activation from sEMG signals. Methods: A dataset of 2880 simulated sEMG signals, stratified for signal-to-noise ratio (SNR) and time support, was generated to train a hidden single-layer fully-connected neural network. DEMANN’s performance was evaluated on simulated sEMG signals and two different datasets of real sEMG signals. DEMANN was validated against different reference algorithms, including the acknowledged double-threshold statistical algorithm (DT). Results: DEMANN provided a reliable prediction of muscle onset/offset in simulated and real sEMG signals, being minimally affected by SNR variability. When directly compared with state-of-the-art algorithms, DEMANN introduced relevant improvements in prediction performances. Conclusions: These outcomes support DEMANN’s reliability in assessing onset/offset events in different motor tasks and the condition of signal quality (different SNR), improving reference-algorithm performances. Unlike other works, DEMANN’s adopts a machine learning approach where a neural network is trained by only simulated sEMG signals, avoiding the possible complications and costs associated with a typical experimental procedure, making this approach suitable to clinical practice.
1 January 2021 in Biomedical Signal Processing and Control
Artificial neural networks were satisfactorily implemented for assessing gait events from different walking data. This study aims to propose a novel approach for recognizing gait phases and events, based on deep-learning analysis of only sagittal knee-joint angle measured by a single electrogoniometer per leg. Promising classification/prediction performances have been previously achieved by surface-EMG studies; thus, a further aim is to test if adding electrogoniometer data could improve classification performances of state-of-the-art methods. Gait data are measured in about 10,000 strides from 23 healthy adults, during ground walking. A multi-layer perceptron model is implemented, composed of three hidden layers and a one-dimensional output. Classification/prediction accuracy is tested vs. ground truth represented by foot–floor-contact signals, through samples acquired from subjects not seen during training phase. Average classification-accuracy of 90.6 ± 2.9% and mean absolute value (MAE) of 29.4 ± 13.7 and 99.5 ± 28.9 ms in assessing heel-strike and toe-off timing are achieved in unseen subjects. Improvement of classification-accuracy (four points) and reduction of MAE (at least 35%) are achieved when knee-angle data are used to enhance sEMG-data prediction. Comparison of the two approaches shows as the reduction of set-up complexity implies a worsening of mainly toe-off prediction. Thus, the present electrogoniometer approach is particularly suitable for the classification tasks where only heel-strike event is involved, such as stride recognition, stride-time computation, and identification of toe walking.