The lower limb joints might be affected by different shoe types and gait speeds. Monitoring joint angles might require skill and proper technique to obtain accurate data for analysis. We aimed to estimate the knee joint angle using a textile capacitive sensor and artificial neural network (ANN) implementing with three shoe types at two gait speeds. We developed a textile capacitive sensor with a simple structure design and less costly placing in insole shoes to measure the foot plantar pressure for building the deep learning models. The smartphone was used to video during walking at each condition, and Kinovea was applied to calibrate the knee joint angle. Six ANN models were created; three shoe-based ANN models, two speed-based ANN models, and one ANN model that used datasets from all experiment conditions to build a model. All ANN models at comfortable and fast gait provided a high correlation efficiency (0.75 to 0.97) with a mean relative error lower than 15% implement for three testing shoes. And compare the ANN with A convolution neural network contributes a similar result in predict the knee joint angle. A textile capacitive sensor is reliable for measuring foot plantar pressure, which could be used with the ANN algorithm to predict the knee joint angle even using high heel shoes.
The use of various footwear results in change in knee biomechanics, altering gait pattern. Monitoring the joint angle using machine or deep learning approaches ischallenging due to input data type selection. This study introduces a convolution neural network (CNN) relied on foot pressure mapping to assess knee joint angle during use of various footwear. A pilot study was conducted with six healthy participants walking at a comfortable gait on a treadmill wearing three types of footwear. We used the F-scan system to measure foot pressure and saved the information to video as input data. Kinematic data of knee joint angle was calibrated by Kinovea software using video recording and served as reference data. We extracted 10 gait cycles from input and reference data. The CNN model was trained with 12000 images and validated with 3000 images. Results of our study suggest that the CNN image-based can accurately predict the knee joint angle with mean absolute error lower than 10.0(deg), mean relative error less than 10.0%, and the correlation coefficient between 70.0% and 90.0% for the three types of tested footwear. The CNN image-based generated a similar knee joint angle pattern for a gait cycle (GC) of all tested shoes; less information about the image pattern during the swing phase is available. Integration between CNN and foot pressure mapping image provided a strong correlation in estimating knee joint angle for a GC during use of three footwear types.
The current trend of assessing joint angles could be conducted through machines, or deep learning (DL) relies on various input data. The development of different types of DL models using foot data may avoid finding optimal sensor positions and direct contact with human skin and can be accessible for subjects. We aimed to investigate the performance of artificial neural network (ANN) and convolutional neural network (CNN) in predicted joint angles based on center of force. Twenty subjects were required to walk on a treadmill at three gait speed modes: comfortable, fast, and running. Foot data were collected through an F-scan system during the experiment. The kinematics of the lower limb joints were recorded using a camera system. Two different types of DL approaches were applied: ANN and CNN. The DL models were trained using the input data of center of force (CoF) and combination of CoF with joint angle. The two matrices of root mean square error (RMSE) and correlation coefficient were used to evaluate each model’s performance. The DL approaches of ANN and CNN provided maximum RMSEs (°) of 12.56 and 14.62, while the minimum correlation coefficient were 0.9102 and 0.9354, respectively. Accordingly, DL based on ANN or CNN architecture is a promising approach that can accurately estimate joint angles even with running gait, beneficial for the sport and rehabilitation field.