Cellulose, the most prevalent biopolymer on Earth, has proven to be an effective multifunctional material for enhancing the performance of concrete and other cement-based products. The current review analyzes recent developments in the application of cellulosic polymers in concrete and cement composites, including microcrystalline cellulose (MCC), cellulose nanofibrils (CNF/NFC), cellulose nanocrystals (CNC), carboxymethyl cellulose (CMC), and hydroxypropyl methylcellulose (HPMC). Special attention is paid to their interfacial interactions with cement hydration products, modes of incorporation, and impact on the properties of fresh concrete and performance of hardened materials (mechanical performance, transport properties, durability, etc.). According to published data, the addition of CNF in an amount of approximately 0.1 wt. % results in a 106% enhancement of flexural strength and a 184% increase in energy absorption capacity. Meanwhile, the flexural strength was enhanced by CNC (approximately 0.2 vol. %) by approximately 30%. Ultra-high-performance concrete containing nanocellulose experienced a 45-75% reduction in autogenous shrinkage in the initial 24 h. Nevertheless, the effects and signs of these improvements are strongly determined by the cellulose structure, dosage, surface chemistry, dispersion quality, consumption of water, cement formulation, and other parameters, which must be controlled because excessive amounts of cellulose and its improper dispersion could negatively influence the workability, hydration process, and strength development. In addition, potential drawbacks such as agglomeration, requirement for high energy input for dispersion, incompatibility with certain chemical admixtures, durability under aggressive environments, and other factors are considered in this review.