Low-dose carrot rhamnogalacturonan-I (cRG-I) has shown consistent modulatory effects on the gut microbiota and immune function in humans. In this study we investigated its effects on the microbial composition and metabolite production of the gut microbiota of small (5–10 kg), medium-sized (10–27 kg), and large (27–45 kg) dogs, using inulin and xanthan as comparators. Fecal samples from six dogs of each size group were evaluated. Overall microbiome composition, assessed using metagenomic sequencing, was shown to be driven mostly by dog size and not treatment. There was a clear segregation in the metabolic profile of the gut microbiota of small dogs versus medium-sized and large dogs. The fermentation of cRG-I specifically increased the levels of acetate/propionate-producing Phocaeicola vulgatus. cRG-I and inulin were fermented by all donors, while xanthan fermentation was donor-dependent. cRG-I and inulin increased acetate and propionate levels. The responses of the gut microbiota of different sized dogs to cRG-I were generally consistent across donors, and interindividual differences were reduced. This, together with the significant increase in P. vulgatus during fermentation in both this study and an earlier human ex vivo study, suggests that this abundant and prevalent commensal species has a core capacity to selectively utilize cRG-I.