This study introduces an innovative, non-contact method for classifying the hardness of austenitic stainless steels (grade AISI 304) based on their intrinsic magnetic fields. Utilizing a 3 × 3 matrix sensor system, this research captures weak magnetic fields to produce precise 2D magnetic field maps of the samples. A key advancement is the application of a modified GoogleNet convolutional neural network, optimized with the stochastic gradient descent with momentum algorithm, which achieves exceptional classification accuracy, ranging from 95% to 100%, and median accuracies of 97.5% to 99%. This method stands out by revealing a novel correlation between annealing temperature and magnetic field strength, particularly a pronounced decline in magnetic properties at temperatures near 1000 °C. This observation underscores the sensitivity of magnetic profiles to heat treatments, offering a groundbreaking approach to material characterization. By enabling reliable, efficient, and fully automated hardness evaluation based on magnetic signatures, this work has the potential to transform materials engineering and manufacturing, setting a new benchmark for non-destructive material analysis techniques.