Human movement researchers are often restricted to laboratory environments and data capture techniques that are time and/or resource intensive. Markerless pose estimation algorithms show great potential to facilitate large scale movement studies ‘in the wild’, i.e., outside of the constraints imposed by marker-based motion capture. However, the accuracy of such algorithms has not yet been fully evaluated. We computed 3D joint centre locations using several pre-trained deep-learning based pose estimation methods (OpenPose, AlphaPose, DeepLabCut) and compared to marker-based motion capture. Participants performed walking, running and jumping activities while marker-based motion capture data and multi-camera high speed images (200 Hz) were captured. The pose estimation algorithms were applied to 2D image data and 3D joint centre locations were reconstructed. Pose estimation derived joint centres demonstrated systematic differences at the hip and knee (~ 30–50 mm), most likely due to mislabeling of ground truth data in the training datasets. Where systematic differences were lower, e.g., the ankle, differences of 1–15 mm were observed depending on the activity. Markerless motion capture represents a highly promising emerging technology that could free movement scientists from laboratory environments but 3D joint centre locations are not yet consistently comparable to marker-based motion capture.
The ability to accurately and non-invasively measure 3D mass centre positions and their derivatives can provide rich insight into the physical demands of sports training and competition. This study examines a method for non-invasively measuring mass centre velocities using markerless human pose estimation and Kalman smoothing. Marker (Qualysis) and markerless (OpenPose) motion capture data were captured synchronously for sprinting and skeleton push starts. Mass centre positions and velocities derived from raw markerless pose estimation data contained large errors for both sprinting and skeleton pushing (mean ± SD = 0.127 ± 0.943 and −0.197 ± 1.549 m·s−1, respectively). Signal processing methods such as Kalman smoothing substantially reduced the mean error (±SD) in horizontal mass centre velocities (0.041 ± 0.257 m·s−1) during sprinting but the precision remained poor. Applying pose estimation to activities which exhibit unusual body poses (e.g., skeleton pushing) appears to elicit more erroneous results due to poor performance of the pose estimation algorithm. Researchers and practitioners should apply these methods with caution to activities beyond sprinting as pose estimation algorithms may not generalise well to the activity of interest. Retraining the model using activity specific data to produce more specialised networks is therefore recommended.
10 July 2024 in Scandinavian Journal of Medicine & Science in Sports
Background: Two‐dimensional (2D) video is a common tool used during sports training and competition to analyze movement. In these videos, biomechanists determine key events, annotate joint centers, and calculate spatial, temporal, and kinematic parameters to provide performance reports to coaches and athletes. Automatic tools relying on computer vision and artificial intelligence methods hold promise to reduce the need for time‐consuming manual methods.Objective: This study systematically analyzed the steps required to automate the video analysis workflow by investigating the applicability of a threshold‐based event detection algorithm developed for 3D marker trajectories to 2D video data at four sampling rates; the agreement of 2D keypoints estimated by an off‐the‐shelf pose estimation model compared with gold‐standard 3D marker trajectories projected to camera's field of view; and the influence of an offset in event detection on contact time and the sagittal knee joint angle at the key critical events of touch down and foot flat.Methods: Repeated measures limits of agreement were used to compare parameters determined by markerless and marker‐based motion capture.Results: Results highlighted that a minimum video sampling rate of 100 Hz is required to detect key events, and the limited applicability of 3D marker trajectory‐based event detection algorithms when using 2D video. Although detected keypoints showed good agreement with the gold‐standard, misidentification of key events—such as touch down by 20 ms resulted in knee compression angle differences of up to 20°.Conclusion: These findings emphasize the need for de novo accurate key event detection algorithms to automate 2D video analysis pipelines.
Wearable sensors and motion capture technology are accepted instruments to measure spatiotemporal variables during punching performance and to study the externally observable effects of fatigue. This study aimed to develop a computational framework enabling three-dimensional inverse dynamics analysis through the tracking of punching kinematics obtained from inertial measurement units and uniplanar videography. The framework was applied to six elite male boxers performing a boxing-specific punch fatigue protocol. OpenPose was used to label left side upper-limb landmarks from which sagittal plane kinematics were computed. Custom-made inertial measurement units were embedded into the boxing gloves, and three-dimensional punch accelerations were analyzed using statistical parametric mapping to evaluate the effects of both fatigue and laterality. Tracking simulations of a sub-set of left-handed punches were formulated as optimal control problems and converted to nonlinear programming problems for solution with a trapezoid collocation method. The laterality analysis revealed the dominant side fatigued more than the non-dominant, while tracking simulations revealed shoulder abduction and elevation moments increased across the fatigue protocol. In future, such advanced simulation and analysis could be performed in ecologically valid contexts, whereby multiple inertial measurement units and video cameras might be used to model a more complete set of dynamics.
Barbell hip thrust exercises have risen in popularity within the biomechanics and strength and conditioning literature over recent years, as a method of developing the hip extensor musculature. Biomechanical analysis of the hip thrust beyond electromyography is yet to be conducted. The aim of this study was therefore to perform the first comprehensive biomechanical analysis the barbell hip thrust. Nineteen resistance trained males performed three repetitions of the barbell hip thrust at 70% one-repetition maximum. Kinematic (250 Hz) and kinetic (1000 Hz) data were used to calculate angle, angular velocity, moment and power data at the ankle, knee, hip and pelvic-trunk joint during the lifting phase. Results highlighted that the hip thrust elicits significantly (p< 0.05) greater bilateral extensor demand at the hip joint in comparison with the knee and pelvic-trunk joints, whilst ankle joint kinetics were found to be negligible. Against contemporary belief, hip extensor moments were not found to be consistent throughout the repetition and instead diminished throughout the lifting phase. The current study provides unique insight to joint kinematics and kinetics of the barbell hip thrust, based on a novel approach, that offers a robust evidence base for practitioners to guide exercise selection.
This study describes the development, evaluation and application of a computer vision and deep learning system capable of capturing sprinting and skeleton push start step characteristics and mass centre velocities (sled and athlete). Movement data were captured concurrently by a marker-based motion capture system and a custom markerless system. High levels of agreement were found between systems, particularly for spatial based variables (step length error 0.001 ± 0.012 m) while errors for temporal variables (ground contact time and flight time) were on average within ± 1.5 frames of the criterion measures. Comparisons of sprinting and pushing revealed decreased mass centre velocities as a result of pushing the sled but step characteristics were comparable to sprinting when aligned as a function of step velocity. There were large asymmetries between the inside and outside leg during pushing (e.g. 0.22 m mean step length asymmetry) which were not present during sprinting (0.01 m step length asymmetry). The observed asymmetries suggested that force production capabilities during ground contact were compromised for the outside leg. The computer vision based methods tested in this research provide a viable alternative to marker-based motion capture systems. Furthermore, they can be deployed into challenging, real world environments to non-invasively capture data where traditional approaches are infeasible.