This study aimed to explore the protective effects of raffinose (Raf) against inflammatory bowel disease in mice with colitis. Mice were administered 100, 200, or 400 mg/kg Raf for 21 d, followed by drinking-water containing 3% dextran sulfate sodium salt (DSS) for 3 d. Thereafter, the phenotype, pathological lesions in the colon, cytokines levels, and gut microbiota were evaluated. Treatment with Raf reduced the severity of the pathological changes in the colon, mitigating the reduction in colon length. Following Raf intervention, serum levels of inflammatory cytokines (IL-2, IL-6, IL-1β, and TNF-α) tended to return to normal. These results suggest that the anti-inflammatory effects of Raf are associated with a reduction in TLR4–MyD88–NF-κB pathway expression in mouse colonic tissues. Analysis of gut microbiota abundance and its correlation with colitis parameters revealed that DSS-induced dysbiosis was partially mitigated by Raf. In conclusion, Raf exerts a protective effect in colitis by modulating the gut microbiota and TLR4-MyD88-NF-κB pathway.