Chromatin 3D structure is highly dynamic and associated with many biological processes, such as cell cycle progression, cellular differentiation, cell fate reprogramming, cancer development, cellular senescence, and aging. Recently, by using chromosome conformation capture technologies, tremendous findings have been reported about the dynamics of genome architecture, their associated proteins, and the underlying mechanisms involved in regulating chromatin spatial organization and gene expression. Cellular senescence and aging, which involve multiple cellular and molecular functional declines, also undergo significant chromatin structural changes, including alternations of heterochromatin and disruption of higher-order chromatin structure. In this review, we summarize recent findings related to genome architecture, factors regulating chromatin spatial organization, and how they change during cellular senescence and aging.