Extensive research on functionalized graphene, graphene oxide, and carbon nanotube based cement composites has been carried out to strengthen and overcome the shortcomings of construction materials. However, less literature is available on the pure graphene based cement composite. In this review paper, an in-depth study on a graphene-based cement composite was performed. Various structural forms of graphene and classifications of graphene-based nanomaterial have been presented. The dispersion mechanism and techniques, which are important for effective utilization in the construction industry, are reviewed critically. Micro-scale characterization of carbon-based cement composite using thermogravimetric analysis (TGA), infrared (IR) spectroscopic analysis, x-ray diffractometric (XRD) analysis, and morphological analysis has also been reviewed. As per the authors’ knowledge, for the first time, a review of flow, energy harvesting, thermoelectrical, and self-sensing properties of graphene and its derivatives as the bases of cement composite are presented. The self-sensing properties of the composite material are reported by exploring physical applications by reinforcing graphene nanoplatelets (GNPs) into concrete beams.