The field of low-resource sentiment analysis has seen significant developments in recent years. This research review SLR evaluates the approaches and data sources utilized in low-resource sentiment analysis by deep learning. The primary aim is to discover suitable approaches for future sentiment analysis in low-resource. Our studies explore various languages, models, and data sources expressing a desire to create effective approaches. Our emphasis lies in the critical evaluation of the approaches and the datasets utilized, to identify areas where further research is needed. Our analysis study adds to the existing body of literature reviews, encompassing multilingual low-resource sentiment analysis research spanning from 2018 to 2023. The findings indicate that the transfer learning approach is the most frequently used, followed by word embedding learning and machine translation systems. Additionally, the study shows that social media is the most used platform for data collection, followed by product reviews, movies, and hotels. There has been a significant surge in the adoption of pre-trained transformers, indicating a growing interest in exploring the potential of these models for low-resource languages within the natural language processing (NLP) community. This trend is largely attributed to the novel nature of these models and their feature of being non-labour intensive. However, the scarcity of annotated datasets for such languages remains a major hurdle. finally, these research findings are relevant and informative for any researcher working in the field of low-resource multilingual sentiment analysis. The study introduces a conceptual framework for performing sentiment analysis in low-resource. The study provides a valuable resource for future researchers.
1 September 2022 in IAES International Journal of Artificial Intelligence (IJ-AI)
This paper addresses the performances of machine learning classification models for the detection of tax avoidance problems. The machine learning models employed automated features selection with hybrid two metaheuristics algorithms namely particle swarm optimization (PSO) and genetic algorithm (GA). Dealing with a real dataset on the tax avoidance cases among companies in Malaysia, has created a stumbling block for the conventional machine learning models to achieve higher accuracy in the detection process as the associations among all of the features in the datasets are extremely low. This paper presents a hybrid meta-heuristic between PSO and adaptive GA operators for the optimization of features selection in the machine learning models. The hybrid PSO-GA has been designed to employ three adaptive GA operators hence three groups of features selection will be generated. The three groups of features selection were used in random forest (RF), k-nearest neighbor (k-NN), and support vector machine (SVM). The results showed that most models that used PSO-GA hybrids have achieved better accuracy than the conventional approach (using all features from the dataset). The most accurate machine learning model was SVM, which used a PSO-GA hybrid with adaptive GA mutation.
1 June 2023 in Bulletin of Electrical Engineering and Informatics
Nowadays, various innovative educational and instructional tools have been created to deliver learning material including video content. One of the important issues with video-based learning is to devise effective teaching strategies to ensure higher level of learning can be achieved by the students. Getting insight and predicting the students’ video-based learning adoption will help the educators. Thus, this study aims to examine the potential of using machine learning prediction models on video-based learning adoption in higher education institutions. Five machine learning algorithms were used to be empirically compared namely generalized linear model (GLM), random forest (RF), decision tree (DT), gradient boosted tree (GBT), and support vector machine (SVM). The performance of each machine learning algorithm in predicting the students’ learning adoption with video-based learning has been observed based on the attributes of task-technology fit theory. The findings indicated that the task-technology fit is useful in helping the machine learning algorithm to achieve high accuracy in the prediction of video-based learning adoption. The GBT is the best outperforming algorithm, followed with RF and SVM. This paper presents a fundamental research framework useful for helping educators and researchers to enhance student interest and retention on video-based learning.
AutoML offers significant benefits in solving real-life problems because it accelerates the development of machine learning models. In contexts involving real scenarios like analyzing companies’ environmental, social and governance (ESG), where the dataset presents some challenges, AutoML is anticipated as a promising solution to address these complexities. Although researchers have shown significant interest in exploring Genetic Programming (GP) in AutoML for handling complex datasets, a critical issue that remains unresolved is the comprehensive understanding of GP hyper-parameters that influence machine learning performance. While GP-based AutoML excels in automating many aspects of the modelling, there has been a scarcity of research that provides insight into the significance of individual features and GP population size within the models of GP-based AutoML. This paper presents a comprehensive analysis of the models’ performance evaluation from multiple facets, including feature selection, GP population sizes, and different machine learning algorithms. Furthermore, this study provides insights into the association between Pearson correlations, machine learning performance, and the importance of machine learning features. The findings demonstrate that incorporating all the determinants as features in GP-based AutoML or relying solely on firm characteristics led to superior performance with an excellent trade-off between True Positive Rate and False Positive Rate. Thus, higher accuracy results exceeding 0.9 of Area Under the Curve (AUC) are presented by the proposed models. The novelty of this study lies in its empirical evaluation of different approaches to GP-based AutoML implementation. These findings provide alternative solutions for business investors to identify companies with strong sustainability practices.
1 October 2024 in Bulletin of Electrical Engineering and Informatics
One of the big challenges in machine learning is difficulty of achieving high accuracy in a short completion time. A more difficulties appeared when the algorithm needs to be used for solving real dataset from the survey-based data collection. Imbalance dataset, insufficient strength of correlations, and outliers are common problems in real dataset. To accelerate the modelling processes, automated machine learning based on meta-heuristics optimization such as genetic programming (GP) has started to emerge and is gaining popularity. However, identifying the best hyper-parameters of the meta-heuristics’ algorithm is the critical issue. This paper demonstrates the evaluation of GP hyper-parameters in modeling machine learning on house affordability dataset. The important hyper-parameters of GP are population size (PS), that has been observed with different setting in this research. The machine learning with GP was used to predict house affordability among employers with transport expenditure and job mobility as some of the attributes. The results from testing that run on hold-out samples show that GP machine learning can reach to 70% accuracy with split ratio 0.2 and GP PS 30. This research contributes to the advancement of automated machine learning techniques, offering potential for faster and more accurate real survey-based datasets.
31 May 2022 in Mathematical Sciences and Informatics Journal