Global aging leads to a surge in neurological diseases. Quantitative gait analysis for the early detection of neurological diseases can effectively reduce the impact of the diseases. Recently, extensive research has focused on gait-abnormality-recognition algorithms using a single type of portable sensor. However, these studies are limited by the sensor’s type and the task specificity, constraining the widespread application of quantitative gait recognition. In this study, we propose a multimodal gait-abnormality-recognition framework based on a Convolutional Neural Network-Bidirectional Long Short-Term Memory (CNN-BiLSTM) network. The as-established framework effectively addresses the challenges arising from smooth data interference and lengthy time series by employing an adaptive sliding window technique. Then, we convert the time series into time–frequency plots to capture the characteristic variations in different abnormality gaits and achieve a unified representation of the multiple data types. This makes our signal processing method adaptable to several types of sensors. Additionally, we use a pre-trained Deep Convolutional Neural Network (DCNN) for feature extraction, and the consequently established CNN-BiLSTM network can achieve high-accuracy recognition by fusing and classifying the multi-sensor input data. To validate the proposed method, we conducted diversified experiments to recognize the gait abnormalities caused by different neuropathic diseases, such as amyotrophic lateral sclerosis (ALS), Parkinson’s disease (PD), and Huntington’s disease (HD). In the PDgait dataset, the framework achieved an accuracy of 98.89% in the classification of Parkinson’s disease severity, surpassing DCLSTM’s 96.71%. Moreover, the recognition accuracy of ALS, PD, and HD on the PDgait dataset was 100%, 96.97%, and 95.43% respectively, surpassing the majority of previously reported methods. These experimental results strongly demonstrate the potential of the proposed multimodal framework for gait abnormality identification. Due to the advantages of the framework, such as its suitability for different types of sensors and fewer training parameters, it is more suitable for gait monitoring in daily life and the customization of medical rehabilitation schedules, which will help more patients alleviate the harm caused by their diseases.

In order to meet the current expanding market demand for knitwear, high-speed automatic knitting machines with “one-line knit to shape” capability are widely used. However, the frequent emergence of floating-yarn stacking anomalies during the high-speed knitting process will seriously hinder the normal reciprocating motion of the needles and cause a catastrophic fracture of the whole machine needle plate, greatly affecting the efficiency of the knitting machines. To overcome the limitations of the existing physical-probe detection method, in this work, we propose a visual floating-yarn anomaly recognition framework based on a CNN-BiLSTM network with the knit feature sequence (CNN-BiLSTM-KFS), which is a unique sequence of knitting yarn positions depending on the knitting status. The sequence of knitting characteristics contains the head speed, the number of rows, and the head movements of the automatic knitting machine, enabling the model to achieve more accurate and efficient floating-yarn identification in complex knitting structures by utilizing contextual information from knitting programs. Compared to the traditional probe inspection method, the framework is highly versatile as it does not need to be adjusted to the specifics of the automatic knitting machine during the production process. The recognition model is trained at the design and sampling stages, and the resulting model can be applied to different automatic knitting machines to recognize floating yarns occurring in various knitting structures. The experimental results show that the improved network spends 75% less time than the probe-based detection, has a higher overall average detection accuracy of 93% compared to the original network, and responds faster to floating yarn anomalies. The as-proposed CNN-BiLSTM-KFS floating-yarn visual detection method not only enhances the reliability of floating-yarn anomaly detection, but also reduces the time and cost required for production adjustments. The results of this study will bring significant improvements in the field of automatic floating-yarn detection and have the potential to promote the application of smart technologies in the knitting industry.