Waste glass (WG) is a solid waste with increasing reserves, and its disposal has become a global issue. The application of WG in the construction industry is one of the promising pathways for recycling WG while reducing high-cost WG landfills. This study is conducted to systematically review the potential effects of WG as both a cement and aggregate replacement on the mechanical and durability properties of cementitious composites. Different waste glass powders (WGP) can lead to various effects on both the workability and hydration of cementitious composites. 10 to 20 wt% WGP as supplementary cementitious materials (SCMs) is the optimal dosage to promote the mechanical and durability properties of the WGP–cement composites. The presence of WGP can promote the chemical resistance, freeze–thaw resistance, and elevated temperature resistance of WGP–cement composites. However, more studies and experiments are needed to provide conservative conclusions on how WGP would affect the durability properties of both normal and high-strength concrete. Sustainable concrete technology requires the use of low-carbon materials while maintaining long-term structural resilience. There is an increasing trend in recycling WGP as a cement or aggregate replacement in designing green concrete.