Visual inspection remains a cornerstone of quality control in welded structures, yet manual evaluations are inherently constrained by subjectivity, inconsistency, and limited scalability. This study presents WeldVGG, a deep learning-based visual inspection model designed to automate weld defect classification using radiographic imagery. The proposed model is trained on the RIAWELC dataset, a publicly available collection of X-ray weld images acquired in real manufacturing environments and annotated across four defect conditions: cracking, porosity, lack of penetration, and no defect. RIAWELC offers high-resolution imagery and standardized class labels, making it a valuable benchmark for defect classification under realistic conditions. To improve trust and explainability, Grad-CAM++ is employed to generate class-discriminative saliency maps, enabling visual validation of predictions. The model is rigorously evaluated through stratified cross-validation and benchmarked against traditional machine learning baselines, including SVC, Random Forest, and a state-of-the-art architecture, MobileNetV3. The proposed model achieves high classification accuracy and interpretability, offering a practical and scalable solution for intelligent weld inspection. Furthermore, to prove the model’s ability to generalize, a test on the GDXray was performed, yielding positive results. Additionally, a Wilcoxon signed-rank test was conducted separately to assess statistical significance between model performances.