Significance: Quantifying the viscoelastic properties of weak colloidal gels remains challenging due to the continuously aging nature of these pasty materials. Through time-resolved mechanical and structural spectroscopy and application of the time–connectivity superposition principle we construct the viscoelastic moduli of these gels over eight decades of effective material time. This protocol reveals the dual nature of the relaxation time spectrum with gel- and glass-like characteristics at large and small scales, respectively. The structure of the network at the critical gel point sets the underlying shape of the relaxation spectrum, which the aging material retains as a fixed skeleton. The observed nonergodic behavior suggests that the local arrest of clusters initiates from small scales and continuously evolves toward larger ones.