Background: Our understanding of the gut microbiota of animals is largely based on studies of mammals. To better understand the evolutionary basis of symbiotic relationships between animal hosts and indigenous microbes, it is necessary to investigate the gut microbiota of non-mammalian vertebrate species. In particular, fish have the highest species diversity among groups of vertebrates, with approximately 33,000 species. In this study, we comprehensively characterized gut bacterial communities in fish. Results: We analyzed 227 individual fish representing 14 orders, 42 families, 79 genera, and 85 species. The fish gut microbiota was dominated by Proteobacteria (51.7%) and Firmicutes (13.5%), different from the dominant taxa reported in terrestrial vertebrates (Firmicutes and Bacteroidetes). The gut microbial community in fish was more strongly shaped by host habitat than by host taxonomy or trophic level. Using a machine learning approach trained on the microbial community composition or predicted functional profiles, we found that the host habitat exhibited the highest classification accuracy. Principal coordinate analysis revealed that the gut bacterial community of fish differs significantly from those of other vertebrate classes (reptiles, birds, and mammals). Conclusions: Collectively, these data provide a reference for future studies of the gut microbiome of aquatic animals as well as insights into the relationship between fish and their gut bacteria, including the key role of host habitat and the distinct compositions in comparison with those of mammals, reptiles, and birds.