Ultra-high-performance concrete (UHPC) has been used as an advanced construction material in civil engineering because of its excellent mechanical properties and durability. However, with the depletion of the raw material (river sand) used for preparing UHPC, it is imperative to find a replacement material. Recycled sand is an alternative raw material for preparing UHPC, but it degrades the performance. In this study, we investigated the use of graphene oxide (GO) as an additive for enhancing the properties of UHPC prepared from recycled sand. The primary objective was to investigate the effects of GO on the mechanical properties and durability of the UHPC at different concentrations. Additionally, the impact of the GO additive on the microstructure of the UHPC prepared from recycled sand was analysed at different mixing concentrations. The addition of GO resulted in the following: (1) The porosity of the UHPC prepared from recycled sand was reduced by 4.45–11.35%; (2) the compressive strength, flexural strength, splitting tensile strength, and elastic modulus of the UHPC prepared from recycled sand were enhanced by 8.24–16.83%, 11.26–26.62%, 15.63–29.54%, and 5.84–12.25%, respectively; (3) the resistance of the UHPC to penetration of chloride ions increased, and the freeze–thaw resistance improved; (4) the optimum mixing concentration of GO in the UHPC was determined to be 0.05 wt.%, according to a comprehensive analysis of its effects on the microstructure, mechanical properties, and durability of the UHPC. The findings of this study provide important guidance for the utilisation of recycled sand resources.