Massive galaxies stopped forming stars surprisingly early in the history of the Universe. However, after quenching, the galaxies continued to grow in size across time, as established in the literature up to cosmic noon. We assemble one of the largest and most comprehensive multiwavelength photometric sample of massive quenched galaxies at z > 3 from publicly available JWST observations, counting 137 quiescent candidates within ∼825 arcmin 2 and redshift 3 ≤ z < 7 across the well-studied extragalactic fields GOODS, PRIMER, and CEERS. We modeled their surface brightness distribution across five bands mapping their UV-to-near-IR rest-frame wavelength with Sérsic profiles, and derived their sizes, concentrations, and ellipticities. The size-mass relation is consistent with previous studies, showing a shallower slope at low redshift z ∈ [3, 3.5] and a steeper slope at high redshift z > 3.5. The size decreases with increasing redshift, in agreement with previous studies and we extend them up to z spec = 4.9. Leveraging the large sample statistics, we robustly constrain the intrinsic scatter of the mass–size relation to ∼0.3 dex with no relevant dependence on the redshift and the filter used. At the population level, our multiwavelength modeling reveals that the size decreases with increasing observed wavelength, and the wavelength gradient decreases with increasing stellar mass. This result proves that in the near-IR bands, massive elliptical galaxies appear to be more compact. The Sérsic index shows no significant dependence on wavelength, regardless of the stellar mass. Following a forward–backward Bayesian fit analysis to assess the significance of several parameters in predicting the size of our sample, we identified no significant secondary dependence of the size on the axis ratio q , Sérsic index n , UVJ -colors, or environment. The combination of stellar mass and redshift is sufficient to predict the size of quiescent galaxies at z > 3, albeit with a large scatter. This suggests that the commonly used parameters of a Sérsic distribution cannot explain the large intrinsic scatter around the stellar mass–size relation, suggesting that other physical quantities need to be taken into account to break the degeneracy between evolution paths across the galaxy population.