Viticulture is a perennial cropping system that provides large inter-row space as a non-crop habitat for a range of different taxa. Extensive vegetation management has been shown to increase biodiversity and ecosystem service provision in vineyards. Important soil ecosystem services are decomposition, nutrient cycling, and pest regulation provided by the mesofauna (e.g., Acari and Collembola). However, studies investigating the effects of inter-row management on soil mesofauna are scarce. We studied the effect of inter-row management intensity (complete vegetation cover, alternating vegetation cover, and bare ground) and local pedoclimatic conditions on Acari and Collembola in nine Austrian vineyards. Our results showed that the clay content of the soil was the most important factor and increased the abundances of both analyzed taxa. Complete and alternating vegetation cover increased their abundance in comparison to bare ground management. Higher soil respiration slightly contributed to higher abundances of those two taxa in both years. In conclusion, besides the positive effects of the clay content in the soil, complete and alternating vegetation cover are feasible management practices for increasing soil mesofauna in vineyards.