Glioma grading plays an important role in surgical resection. We investigated the ability of different feature reduction methods in support vector machine (SVM)-based diffusion kurtosis imaging (DKI) histogram parameters to distinguish glioma grades. A total of 161 glioma patients who underwent magnetic resonance imaging (MRI) from January 2017 to January 2020 were included retrospectively. The patients were divided into low-grade (n = 61) and high-grade (n = 100) groups. Parametric DKI maps were derived, and 45 features from the DKI maps were extracted semi-automatically for analysis. Three feature selection methods [principal component analysis (PCA), recursive feature elimination (RFE) and least absolute shrinkage and selection operator (LASSO)] were used to establish the glioma grading model with an SVM classifier. To evaluate the performance of SVM models, the receiver operating characteristic (ROC) curves of SVM models for distinguishing glioma grades were compared with those of conventional statistical methods. The conventional ROC analysis showed that mean diffusivity (MD) variance, MD skewness and mean kurtosis (MK) C50 could effectively distinguish glioma grades, particularly MD variance. The highest classification distinguishing AUC was found using LASSO at 0.904 ± 0.069. In comparison, classification AUC by PCA was 0.866 ± 0.061, and 0.899 ± 0.079 by RFE. The SVM-PCA model with the lowest AUC among the SVM models was significantly better than the conventional ROC analysis (z = 1.947, p = 0.013). These findings demonstrate the superiority of DKI histogram parameters by LASSO analysis and SVM for distinguishing glioma grades.