Background: Gut microbiota play important roles in their co-evolution with mammals. However, little is understood about gut bacterial community of Tibetan sheep compared with other sheep breeds. In this study, we investigated the gut bacterial community in 4 different sheep breeds living in the Qinghai-Tibetan Plateau (QTP) of China using high-throughput sequencing (HTS) technique. Results: The results suggested that bacterial community abundance and breeds diversity of Tibetan sheep (TS) were significantly lower than that of the other three breeds of sheep [Dorset sheep (DrS), Dorper sheep (DrS) and Small Tail Han sheep (STHS)] (p < 0.05). Principal coordinates analysis (PCoA) and nonmetric multidimensional scaling (NMDS) analysis indicated that microbiome composition of TS was significantly different from that of other three sheep breeds (p < 0.01). Firmicutes was the most predominant microbial phylum in the gut, followed by Bacteroidetes. The gut bacterial community of TS showed higher proportions of phylum Spirochaetes, Proteobacteria and Verrucomicrobia, compared to the other three sheep breeds, but the Deferribacteres was absent in TS. At the genus level, Treponema, Succinivibrio, 5-7 N15 and Prevotella showed significantly higher abundance in TS than in the other three sheep breeds (p < 0.05). Conclusions: In this study, we first employed HTS to understand the gut microbiomes among different sheep breeds in QTP of China.