Since light propagation in a multimode fiber (MMF) exhibits visually random and complex scattering patterns due to external interference, this study numerically models temperature and curvature through the finite element method in order to understand the complex interactions between the inputs and outputs of an optical fiber under conditions of temperature and curvature interference. The systematic analysis of the fiber’s refractive index and bending loss characteristics determined its critical bending radius to be 15 mm. The temperature speckle atlas is plotted to reflect varying bending radii. An optimal end-to-end residual neural network model capable of automatically extracting highly similar scattering features is proposed and validated for the purpose of identifying temperature and curvature scattering maps of MMFs. The viability of the proposed scheme is tested through numerical simulations and experiments, the results of which demonstrate the effectiveness and robustness of the optimized network model.