Cement-based materials are the most widely used building materials and have two main problems: low flexural/tensile strength and low sustainability. To solve these two problems at the same time, the strategy of the utilization of fillers as cement paste replacement and utilization of fiber was proposed. Mixes with varying PVA fiber and LF were produced for workability and mechanical properties measurement and analysis. The results showed that the addition of PVA fibers reduced the flowability and bonding, while the addition of LF similarly reduced the flowability but enhanced its bonding. Both effects on strength showed an increase and then a decrease. An analysis of microstructure and chemical composition demonstrated that the addition of PVA fiber and/or LF first decreased the porosity, and a further addition increased the porosity. The mixes with 0.2% fiber content showed fracture failure mode, while the mixes with 0.4–0.6% fiber content showed the pulling out of failure mode. A mix with 0.2% fiber content and 10% LF content exhibited concurrently good workability and mechanical properties.