Temperature control and crack prevention are crucial for mass concrete structures in cold regions. Electrically conductive roller-compacted concrete (ERCC) provides a promising route to shift surface temperature regulation from passive protection to active control. To develop an ERCC material suitable for engineering applications, this study first established a quantitative relationship between interparticle interaction energy and particle spacing to elucidate the effect of carbon black (CB) dispersion and agglomeration on concrete performance. The dispersion quality of CB was then evaluated by sedimentation tests, UV absorbance, and resistivity measurements. The absorbance of CB suspensions containing PCE, SDS, and TA increased by 79.9%, 80.1%, and 100.4%, respectively, compared with the suspension without dispersant, and TA gave the lowest mortar resistivity. Mechanical tests and mesoscopic simulations showed that coarse aggregate volume fraction and CB dosage had stronger effects on the compressive strength and elastic modulus of ERCC than aggregate gradation and specimen size. After calibration using the ERCC-2-TA mixture, the average errors between simulation and experiment were 0.7% for compressive strength and 0.4% for elastic modulus. For engineering applications, the recommended ERCC parameters were a coarse aggregate volume fraction of 40%, a CB content of 4–5% and a water-to-binder ratio of 0.45–0.50 for roads, and a CB content of 8% with a water-to-binder ratio of 0.55 for dams.