α-glucosidase inhibitors (AGIs) have been an important category of oral antidiabetic drugs being widely exploited for the effective management of type 2 diabetes mellitus. However, the marketed AGIs not only inhibited the disaccharidases, but also exhibited an excessive inhibitory effect on α-amylase, resulting in undesirable gastrointestinal side effects. Compared to these agents, Ramulus Mori alkaloids (SZ-A), was a group of effective alkaloids from natural Morus alba L., and showed excellent hypoglycemic effect and fewer side effects in the Phase II/III clinical trials. Thus, this paper aims to investigate the selective inhibitory effect and mechanism of SZ-A and its major active ingredients (1-DNJ, FA and DAB) on different α-glucosidases (α-amylase and disaccharidases) by using a combination of kinetic analysis and molecular docking approaches. From the results, SZ-A displayed a strong inhibitory effect on maltase and sucrase with an IC₅₀ of 0.06 μg/mL and 0.03 μg/mL, respectively, which was similar to the positive control of acarbose with an IC₅₀ of 0.07 μg/mL and 0.68 μg/mL. With regard to α-amylase, SZ-A exhibited no inhibitory activity at 100 μg/mL, while acarbose showed an obvious inhibitory effect with an IC₅₀ of 1.74 μg/mL. The above analysis demonstrated that SZ-A could selectively inhibit disaccharidase to reduce hyperglycemia with a reversible competitive inhibition, which was primarily attributed to the three major active ingredients of SZ-A, especially 1-DNJ molecule. In the light of these findings, molecular docking study was utilized to analyze their inhibition mechanisms at molecular level. It pointed out that acarbose with a four-ring structure could perform desirable interactions with various α-glucosidases, while the three active ingredients of SZ-A, belonging to monocyclic compounds, had a high affinity to the active site of disaccharidases through forming a wide range of hydrogen bonds, whose affinity and consensus score with α-amylase was significantly lower than that of acarbose. Our study illustrates the selective inhibition mechanism of SZ-A on α-glucosidase for the first time, which is of great importance for the treatment of type 2 diabetes mellitus.