Gaultheria yunnanensis (Franch.) Rehder is a kind of traditional Chinese herbal medicine used for the treatments of rheumatoid arthritis, swelling and pain. Two methyl salicylate glycosides, namely methyl benzoate-2-O-b-D-xylopyranosyl(1-6)-O-b-D-gluco-pyranoside (J12122) and methyl benzoate-2-O-β-D-xylopyranosyl(1-2)[O-β-D-xylopyranosyl(1-6)]-O-β-D-glucopyranoside (J12123), are natural salicylic derivatives isolated from Gaultheria yunnanensis. In this study, we investigated the anti-inflammatory activity of J12122 and J12123 on LPS-induced RAW264.7 macrophage cells by measuring the production of pro-inflammatory cytokines, accumulation of nitric oxide (NO), and level of reactive oxygen species (ROS). The results showed that both methyl salicylate glycosides dose-dependently inhibited the production of tumor necrosis factor-α (TNF-α), interleukin-1β (IL-1β), and IL-6, respectively. Consistent with these observations, J12122 and J12123 significantly suppressed the accumulation of NO, with an inhibitory rate of 56.20% and 51.72% at 3.0 μg/mL concentration, respectively. Furthermore, the two methyl salicylate glycosides reduced the level of ROS induced by LPS. These results showed that the isolated compounds possess anti-inflammatory properties through inhibition the production pro-inflammatory cytokines, NO, and ROS.