In the realm of data analysis and machine learning, achieving an optimal balance of feature importance, known as feature weighting, plays a pivotal role, especially when considering the nuanced interplay between the symmetry of data distribution and the need to assign differential weights to individual features. Also, avoiding the dominance of large-scale traits is essential in data preparation. This step makes choosing an effective normalization approach one of the most challenging aspects of machine learning. In addition to normalization, feature weighting is another strategy to deal with the importance of the different features. One of the strategies to measure the dependency of features is the correlation coefficient. The correlation between features shows the relationship strength between the features. The integration of the normalization method with feature weighting in data transformation for classification has not been extensively studied. The goal is to improve the accuracy of classification methods by striking a balance between the normalization step and assigning greater importance to features with a strong relation to the class feature. To achieve this, we combine Min–Max normalization and weight the features by increasing their values based on their correlation coefficients with the class feature. This paper presents a proposed Correlation Coefficient with Min–Max Weighted (CCMMW) approach. The data being normalized depends on their correlation with the class feature. Logistic regression, support vector machine, k-nearest neighbor, neural network, and naive Bayesian classifiers were used to evaluate the proposed method. Twenty UCI Machine Learning Repository and Kaggle datasets with numerical values were also used in this study. The empirical results showed that the proposed CCMMW significantly improves the classification performance through support vector machine, logistic regression, and neural network classifiers in most datasets.
Corporate bankruptcy prediction is an important task in the determination of corporate solvency, that is, whether a company can meet up to its financial obligations or not. It is widely studied as it has a significant effect on employees, customers, management, stockholders, bank lending assessments, and profitability. In recent years, machine learning techniques, particularly Artificial Neural Network (ANN), have widely been studied for bankruptcy prediction since they have proven to be a good predictor, especially in financial applications. A critical process in learning a network is weight training. Although the ANN is mathematically efficient, it has a complex weight training process, especially in computation time when involving a large training data. Many studies improved ANN’s weight training using metaheuristic algorithms such as Evolutionary Algorithms (EA), and Swarm Intelligence (SI) approaches for bankruptcy prediction. In this study, two metaheuristics algorithms, Magnetic Optimization Algorithm (MOA) and Particle Swarm Optimization (PSO), have been enhanced through hybridization to propose a new method MOA-PSO. Hybrid algorithms have been proven to be capable of solving optimization problems faster, with better accuracy. The MOA-PSO was used in training ANN to improve the performance of the ANN in bankruptcy prediction. The performance of the hybrid MOA-PSO was compared with that of four existing algorithms. The proposed hybrid MOA-PSO algorithm exhibits promising results with a faster and more accurate prediction, with 99.7% accuracy.
Link prediction is a technique to forecast future new or missing relationships between entities based on the current network information. Graph theory and network science are theoretical concepts that have influenced the link prediction research. Although previous reviews clearly outlined the link prediction research, it was focused on describing prediction approaches only. However, analysis of related studies identified other components that influence link prediction. This review aims to present a continued review and introduce the taxonomy of link prediction using three main components: the prediction approaches, prediction features, and prediction measurements. Each component has been detailed using its own taxonomy available at the present review. Furthermore, this review compares the prediction approaches and prediction features also benchmark algorithms and measurement methods of previous link prediction studies. In conclusion, the previous studies mostly focused on structural features and similarity-based approaches, while measuring the proposed methods using the Area Under the Curve (AUC) score. The proposed link prediction taxonomy can guide the researchers to generate new ideas and innovations that contribute to the link prediction research.
29 September 2018 in International Journal on Advanced Science, Engineering and Information Technology
Malaysia citizens are categorised into three different income groups which are the Top 20 Percent (T20), Middle 40 Percent (M40), and Bottom 40 Percent (B40). One of the focus areas in the Eleventh Malaysia Plan (11MP) is to elevate the B40 household group towards the middle-income society. Based on recent studies by the World Bank, Malaysia is expected to enter the high-income economy status no later than the year 2024. Thus, it is essential to clarify the B40 population through a predictive classification as a prerequisite towards developing a comprehensive action plan by the government. This paper is aimed at identifying the best machine learning models using Naive Bayes, Decision Tree and k-Nearest Neighbors algorithm for classifying the B40 population. Several data pre-processing task such as data cleaning, feature engineering, normalisation, feature selection: Correlation Attribute, Information Gain Attribute and Symmetrical Uncertainty Attribute and sampling methods using SMOTE has been conducted to the raw dataset to ensure the quality of the training data. Each classifier is then optimized using different tuning parameter with 10-Fold Cross Validation for achieving the optimal values before the performance of the three classifiers are compared to each other. For the experiments, a dataset from National Poverty Data Bank called eKasih obtained from the Society Wellbeing Department, Implementation Coordination Unit of Prime Minister's Department (ICU JPM), consisting of 99,546 households from 3 different states: Johor, Terengganu and Pahang are used to train each of the machine learning model. The experimental results using 10-Fold Cross-Validation method demonstrates that the overall performance of Decision Tree model outperformed the other models and the significance test specified the result is statistically significance.
The nature of decision making in healthcare is complex and crucial. It is essential to have a tool that helps with accurate and correct decisions based on real-time data. Moreover, the healthcare process itself is complex, comprising various stages from primary to palliative, closely related to each other, and the process is different depending on the type of disease. Each stage has a crucial decision to be made relying on other stages’ decisions. Thus, an intelligent decision support system (IDSS) model based on a data mining approach becomes a prominent solution. However, the existing IDSS and Group Decision Support System (GDSS) applied a single-stage approach and primarily focused on development at a certain stage for specific outcomes. In contrast, the nature of healthcare decision-making in each stage is related to the previous stages, which change dynamically. Therefore, this paper proposes an interrelated decision-making model (IDM) for IDSS in healthcare that aims to have an effective decision by utilizing knowledge from previous and following treatment stages known as IDM-IDSS-healthcare. The experiment was conducted using simulated diabetes treatments data that were validated by the medical expert. Eight data sets with distinct sizes were constructed and classified into two types of decision-making categories. Each data sets consists of primary and secondary care stages with a range of 25 to 58 attributes and 300-11,000 instances. The experiment results show algorithms J48, Logistic, NaiveBayes Updateable, RandomTree, BayesNet and AdaBoostM1 obtained the best accuracy in sequence from 46% to 99%. The result also shows the improvement of decision-making efficiency with the prediction model accuracy has increased up to 56%. In addition, all respondents agreed in a focus-group discussion with medical and information technology (IT) experts that the proposed IDM-IDSS-healthcare is practical as a healthcare solution. Moreover, the solution for the development of IDM-IDSS-healthcare should use the multi-agent approach.
Various applications, such as electronic business, satellite remote sensing, intrusion discovery, and network traffic monitoring, generate large unbounded data stream sequences at a rapid pace. The clustering of data streams has attracted considerable interest due to the increasing usage of evolving data streams. In particular, evolving data streams affect clustering because they introduce numerous challenges, such as time and memory limits and one-pass clustering. Furthermore, researchers need to be able to determine arbitrarily shaped clusters present in evolving data streams from applications. Due to these characteristics, conventional density grid-based clustering techniques cannot be used. Moreover, the existing density grid-based clustering algorithms have low cluster quality for clustering evolving data streams. This study conducted a systematic literature review (SLR) and noted numerous research-related issues encountered in solving the aforementioned problems. We summarized numerous grid-based clustering algorithms that have been used and determined their distinctive and limited features. We also observed how these algorithms address the challenges affecting the clustering of evolving data streams and studied their advantages and disadvantages. SLR was based on 104 articles published between 2010 and 2021. Numerous challenges remain for grid-based clustering algorithms, particularly in terms of time-limited and high-dimensional data handling. Last, our findings indicated a variety of active studies on density grid-based clustering.