(Poly)phenols inhibit α-amylase by directly binding to the enzyme and/or by forming starch-polyphenol complexes. Conventional methods using starch as the substrate measure inhibition from both mechanisms, whereas the use of shorter oligosaccharides as substrates exclusively measures the direct interaction of (poly)phenols with the enzyme. In this study, using a chromatography-based method and a short oligosaccharide as the substrate, we investigated the detailed structural prerequisites for the direct inhibition of human salivary and pancreatic α-amylases by over 50 (poly)phenols from the (poly)phenol groups: flavonols, flavones, flavanones, flavan-3-ols, polymethoxyflavones, isoflavones, anthocyanidins and phenolic acids. Despite being structurally very similar (97% sequence homology), human salivary and pancreatic α-amylases were inhibited to different extents by the tested (poly)phenols. The most potent human salivary α-amylase inhibitors were luteolin and pelargonidin, while the methoxylated anthocyanidins, peonidin and petunidin, significantly blocked pancreatic enzyme activity. B-ring methoxylation of anthocyanidins increased inhibition against both human α-amylases while hydroxyl groups at C3 and B3' acted antagonistically in human salivary inhibition. C4 carbonyl reduction, or the positive charge on the flavonoid structure, was the key structural feature for human pancreatic inhibition. B-ring glycosylation did not affect salivary enzyme inhibition, but increased pancreatic enzyme inhibition when compared to its corresponding aglycone. Overall, our findings indicate that the efficacy of interaction with human α-amylase is mainly influenced by the type and placement of functional groups rather than the number of hydroxyl groups and molecular weight.