To investigate the changes in the intestinal flora in the Chinese elderly with cardiovascular disease (CVD) and its correlation with the metabolism of trimethylamine (TMA), the intestinal flora composition of elderly individuals with CVD and healthy elderly individuals was analyzed using 16S rRNA sequencing, the TMA levels in the feces of elderly were detected using headspace–gas chromatography (HS-GC), and four kinds of characterized TMA-producing intestinal bacteria in the elderly were quantified using real-time fluorescence quantitative polymerase chain reaction (qPCR). The results showed that Firmicutes, Actinobacteria, Proteobacteria, Bacteroidetes, and Verrucomicrobia are the dominant microorganisms of the intestinal flora in the Chinese elderly. And there were significant differences in the intestinal bacteria composition between healthy elderly individuals and those with CVD, accompanied by a notable difference in the TMA content. The richness and diversity of the intestinal flora in the elderly with CVD were higher than those in the healthy elderly. Correlation analysis indicated that certain significantly different intestinal flora were associated with the TMA levels. Our findings showed a significant difference in TMA-producing intestinal flora between healthy elderly individuals and those with CVD. The TMA levels were found to be positively and significantly correlated with Klebsiella pneumoniae, suggesting that this bacterium is closely linked to the production of TMA in the elderly gut. This may have implications for the development and progression of CVD in the elderly population.