The content of the flavonolignan mixture silymarin and its individual components (silichristin, silidianin, silibinin A, silibinin B, isosilibinin A, and isosilibinin B) in whole and milled milk thistle seeds (Silybi mariani fructus) was analyzed with near-infrared spectroscopy. The analytical performance of one benchtop and two handheld near-infrared spectrometers was compared. Reference analysis was performed with HPLC following a Soxhlet extraction (European Pharmacopoeia) and a more resource-efficient ultrasonic extraction. The reliability of near-infrared spectral analysis determined through partial least squares regression models constructed independently for the spectral datasets obtained by the three spectrometers was as follows. The benchtop device NIRFlex N-500 performed the best both for milled and whole seeds with a root mean square error of CV between 0.01 and 0.17%. The handheld spectrometer MicroNIR 2200 as well as the microPHAZIR provided a similar performance (root mean square error of CV between 0.01 and 0.18% and between 0.01 and 0.23%, respectively). We carried out quantum chemical simulation of near-infrared spectra of silichristin, silidianin, silibinin, and isosilibinin for interpretation of the results of spectral analysis. This provided understanding of the absorption regions meaningful for the calibration. Further, it helped to better separate how the chemical and physical properties of the samples affect the analysis. While the study demonstrated that milling of samples slightly improves the performance, it was deemed to be critical only for the analysis carried out with the microPHAZIR. This study evidenced that rapid and nondestructive quantification of silymarin and individual flavonolignans is possible with miniaturized near-infrared spectroscopy in whole milk thistle seeds.