The aim of this study was to investigate the effects of different exercise modes on improving inflammatory response in the elderly. For the research methodology, databases such as CNKI (China National Knowledge Infrastructure), Wanfang Data, Pubmed, Web of Science, and EBSCO were selected for searching. The Cochrane Risk of Bias (ROB) tool was used to evaluate the methodological quality of the included studies, and RevMan5.4.1 analysis software was applied for the statistical analysis. A total of 31 studies (20 randomized controlled trials and 11 self-controlled trials) with 1528 subjects were included. The results of this meta-analysis showed that aerobic exercise, resistance exercise, aerobic + resistance exercise, and HIIT all significantly reduced the levels of IL-6, TNF-α, and CRP in the elderly, and the improvement effects of aerobic + resistance exercise on IL-6, HIIT on TNF-α, and resistance exercise on CRP in the elderly were better than those of the other three exercise modes, respectively. In conclusion, aerobic exercise, resistance exercise, aerobic + resistance exercise, and HIIT all contribute to ameliorating the inflammatory status of the elderly, among which resistance exercise is a noteworthy exercise mode for the elderly to improve inflammatory status.