Accurate multi-label image classification is essential for real-world applications, especially in scenarios with long-tailed class distributions, where some classes appear frequently while others are rare. This imbalance often leads to biased models that struggle to accurately recognize underrepresented classes. Existing methods either trade off performance between head and tail classes or rely on image captions, limiting adaptability. To address these limitations, we propose LM-CLIP, a novel framework built around a unified loss function. Our Balanced Asymmetric Loss (BAL) extends traditional asymmetric loss by emphasizing the gradients of rare positive samples where the model is uncertain, mitigating bias toward dominant classes. This is complemented by a contrastive loss that pushes negative samples further from the decision boundary, creating a more optimal embedding space even in long-tailed scenarios. These loss functions together ensure balanced performance across all classes. Our framework is built on pre-trained models utilizing textual and visual features from millions of image-text pairs. Furthermore, we incorporate a dynamic sampling strategy that prioritizes rare classes based on their occurrence, which ensures effective training without compromising overall performance. Experiments conducted on VOC-MLT and COCO-MLT benchmarks demonstrate the effectiveness of our approach, achieving +4.66% and +8.14% improvements in mean Average Precision (mAP) over state-of-the-art methods. Our code is publicly available at https://github.com/damilab/lm-clip.
We propose a graph-based, explainable golf swing analysis framework that integrates human body keypoints with golf club keypoints to predict ball flight outcomes. We collected 321 driver swing sequences from six amateur golfers in a controlled studio setting, synchronizing monocular swing videos with TrackMan-derived ball trajectory measurements. Using a unified spatial–temporal graph that jointly models body joints and golf club keypoints, we trained graph neural networks (ST-GCN and STGAT) to perform three prediction tasks: Spin Axis and Launch Direction (classification) and Ball Speed (regression). Model performance was evaluated using AUC and accuracy for classification, and R2 and RMSE for regression. STGAT achieved the best overall performance, reaching an AUC of 0.9188 and an accuracy of 78.33% for Spin Axis classification, an AUC of 0.7599 and an accuracy of 69.81% for Launch Direction classification, and an R2 of 0.6925 with an RMSE of 6.4020 for Ball Speed prediction, outperforming traditional machine learning baselines. Finally, we applied Integrated Gradients to quantify the importance of both body and club keypoints across swing phases, enabling interpretable, phase-specific feedback to support individualized swing refinement.