To tailor the properties and enhance the applicability of starch, various ways of starch modification have been practiced. Among them, physical modification methods (micronization, nonthermal plasma, high-pressure, ultrasonication, pulsed electric field, and γ-irradiation) are highly potential for starch modification considering its safety, environmentally friendliness, and cost-effectiveness, without generating chemical wastes. Thus, this article provides an overview of the recent advances in nonthermal physical modification of starch and summarizes the resulting changes in the multi-level structures and physicochemical properties. While the effect of these techniques highly depends on starch type and treatment condition, they generally lead to the destruction of starch granules, the degradation of molecules, decreases in crystallinity, gelatinization temperatures, and viscosity, increases in solubility and swelling power, and an increase or decrease in digestibility, to different extents. The advantages and shortcomings of these techniques in starch processing are compared, and the knowledge gap in this area is commented on.