This paper introduces a methodology to compensate inertial Micro-Electro-Mechanical System (IMU-MEMS) time-varying calibration loss, induced by stress and aging. The approach relies on a periodic assessment of the sensor through specific stimuli, producing outputs which are compared with the response of a high-precision sensor, used as ground truth. At any re-calibration iteration, differences with respect to the ground truth are approximated by quantization-aware trained tiny neural networks, allowing calibration-loss compensations. Due to the unavailability of aging IMU-MEMS datasets, a synthetic dataset has been produced, taking into account aging effects with both linear and nonlinear calibration loss. Also, field-collected data in conditions of thermal stress have been used. A model relying on Dense and 1D Convolution layers was devised and compensated for an average of 1.97 g and a variance of 1.07 g², with only 903 represented with 16 bit parameters. The proposed model can be executed on an intelligent signal processing inertial sensor in 126.4 ms. This work represents a step forward toward in-sensor machine learning computing through integrating the computing capabilities into the sensor package that hosts the accelerometer and gyroscope sensing elements.