Multiple factors over the lifetime of an individual, including diet, geography, and physiologic state, will influence the microbial communities within the primate gut. To determine the source of variation in the composition of the microbiota within and among species, we investigated the distal gut microbial communities harbored by great apes, as present in fecal samples recovered within their native ranges. We found that the branching order of host-species phylogenies based on the composition of these microbial communities is completely congruent with the known relationships of the hosts. Although the gut is initially and continuously seeded by bacteria that are acquired from external sources, we establish that over evolutionary timescales, the composition of the gut microbiota among great ape species is phylogenetically conserved and has diverged in a manner consistent with vertical inheritance. The microbial communities that inhabit the gastrointestinal tract of humans and other mammals are complex, dynamic, and critical to both health and disease. The composition and constituents of these communities are influenced by multiple factors such as host diet, geography, physiology, and disease state. Given the central role of the gut microbiota in the physiology of the host, it is important to determine whether it is predictable and substantially determined by the host, or variable and largely determined by the external environment (including diet) experienced by the host. A valuable way of determining the relative contributions of such factors is by comparing gut microbial communities in closely related host species. Applying a high-throughput sequencing approach, we profiled the distal gut microbiotae of great ape species sampled in their native ranges and then employed a parsimony-based analysis of phylogenetically informative phylotypes (i.e., bacterial taxa residing in multiple individuals) to determine the relationships among the diverse microbial communities. Our analyses revealed a clear species-specific signature of microbial community structure. Moreover, the pattern of relationships among the five great ape species (Homo sapiens, Pan troglodytes, P. paniscus, Gorilla gorilla, and G. beringei) inferred from their fecal microbial communities was identical to that inferred from host mitochondrial DNA, indicating that host phylogeny shapes the gut microbiota over evolutionary timescales. It seems after all that you are not what you eat.