In order to improve the strength and permeability of coal gangue pervious concrete, an optimized mix design was conducted. An orthogonal experiment was employed to study the variations of compressive strength and permeability coefficient of coal gangue pervious concrete under the influence of aggregate particle size, water-cement ratio, designed porosity, and dosage of permeable admixture. After obtaining a relatively optimal mix proportion, further discussions were carried out by restricting the values of compressive strength and permeability coefficient to determine the appropriate range for the excess paste content ratio, total porosity, and effective porosity, resulting in the determination of the optimal mix design. Results indicated that the compressive strength reached its maximum at an aggregate particle size of 9.5–16 mm, with minimal impact on the permeability coefficient. As the water-cement ratio increased, the compressive strength gradually increased, while the permeability coefficient slightly decreased within the range of 0.25–0.29, and decreased by 60% within the range of 0.29–0.31. With the increase of designed porosity, the compressive strength gradually decreased, while the permeability performance gradually enhanced.