To investigate the effect of hybrid fibers on the compressive strength of aeolian sand concrete, compressive strength tests were conducted on aeolian sand concrete with single polypropylene fibers and aeolian sand concrete with mixed polypropylene fibers and calcium carbonate whisker, and their variation rules were studied. Using scanning electron microscopy and nuclear magnetic resonance, the microstructure and pore structure of specimens were analyzed, and a mathematical model of the relationship between compressive strength and pore structure was established with gray entropy analysis. The results show that the compressive strength of hybrid fiber aeolian sand concrete first increases and then decreases with an increase in whisker content. When the replacement rate of wind-accumulated sand is 80% and the fiber content is 0.1%, the optimal volume content of whisker is 0.4%, and the 28 d compressive strength of whisker is 24.8% higher than that of aeolian sand concrete. The average relative errors of compressive strength at 7 d and 28 d are 8.16% and 7.48%, respectively, using the GM (1,3) model. This study can provide effective theoretical support for the application of calcium carbonate whisker and polypropylene fibers in aeolian sand concrete.