Machine learning models may not be able to effectively learn and predict from imbalanced data in the fields of machine learning and data mining. This study proposed a method for analyzing the performance impact of imbalanced binary data on machine learning models. It systematically analyzes 1. the relationship between varying performance in machine learning models and imbalance rate (IR); 2. the performance stability of machine learning models on imbalanced binary data. In the proposed method, the imbalanced data augmentation algorithms are first designed to obtain the imbalanced dataset with gradually varying IR. Then, in order to obtain more objective classification results, the evaluation metric AFG, arithmetic mean of area under the receiver operating characteristic curve (AUC), F-measure and G-mean are used to evaluate the classification performance of machine learning models. Finally, based on AFG and coefficient of variation (CV), the performance stability evaluation method of machine learning models is proposed. Experiments of eight widely used machine learning models on 48 different imbalanced datasets demonstrate that the classification performance of machine learning models decreases with the increase of IR on the same imbalanced data. Meanwhile, the classification performances of LR, DT and SVC are unstable, while GNB, BNB, KNN, RF and GBDT are relatively stable and not susceptible to imbalanced data. In particular, the BNB has the most stable classification performance. The Friedman and Nemenyi post hoc statistical tests also confirmed this result. The SMOTE method is used in oversampling-based imbalanced data augmentation, and determining whether other oversampling methods can obtain consistent results needs further research. In the future, an imbalanced data augmentation algorithm based on undersampling and hybrid sampling should be used to analyze the performance impact of imbalanced binary data on machine learning models.
The Wanjiang City Belt is an important part of Anhui’s economic development. It is the core area of the two national strategies regarding the rise of the central region and the integration of the Yangtze River Delta. This paper analyzes the urban development level of the Wanjiang City Belt using a nonparametric test. Holt’s linear trend method of a time series prediction model is used to predict and analyze the GDP growth rate of the second and third industries in the Wanjiang area. The results show that: (1) the economic development level of cities in the Wanjiang City Belt is unbalanced, and there is a significant gap in some cities in Jiangsu, Zhejiang and Shanghai; (2) the speed of undertaking industrial transfer in the Wanjiang City Belt is slowing down, and the competition of undertaking industrial transfer in the Wanjiang region is increasingly fierce; (3) in the process of the Wanjiang City Belt undertaking an industrial transfer, there are some problems such as the imbalance of undertaking ability, industrial isomorphism and regional competition, which hinder the coordinated development and sustainable economic development of the Wanjiang area. To achieve high-quality and sustainable development of the Wanjiang City Belt, it is necessary to further improve the policy guarantee, industrial cluster, talent introduction and independent innovation.