The fast-growing Internet results in massive amounts of text data. Due to the large volume of the unstructured format of text data, extracting relevant information and its analysis becomes very challenging. Text document clustering is a text-mining process that partitions the set of text-based documents into mutually exclusive clusters in such a way that documents within the same group are similar to each other, while documents from different clusters differ based on the content. One of the biggest challenges in text clustering is partitioning the collection of text data by measuring the relevance of the content in the documents. Addressing this issue, in this work a hybrid swarm intelligence algorithm with a K-means algorithm is proposed for text clustering. First, the hybrid fruit-fly optimization algorithm is tested on ten unconstrained CEC2019 benchmark functions. Next, the proposed method is evaluated on six standard benchmark text datasets. The experimental evaluation on the unconstrained functions, as well as on text-based documents, indicated that the proposed approach is robust and superior to other state-of-the-art methods.
The research presented in this manuscript proposes a novel Harris Hawks optimization algorithm with practical application for evolving convolutional neural network architecture to classify various grades of brain tumor using magnetic resonance imaging. The proposed improved Harris Hawks optimization method, which belongs to the group of swarm intelligence metaheuristics, further improves the exploration and exploitation abilities of the basic algorithm by incorporating a chaotic population initialization and local search, along with a replacement strategy based on the quasi-reflection-based learning procedure. The proposed method was first evaluated on 10 recent CEC2019 benchmarks and the achieved results are compared with the ones generated by the basic algorithm, as well as with results of other state-of-the-art approaches that were tested under the same experimental conditions. In subsequent empirical research, the proposed method was adapted and applied for a practical challenge of convolutional neural network design. The evolved network structures were validated against two datasets that contain images of a healthy brain and brain with tumors. The first dataset comprises well-known IXI and cancer imagining archive images, while the second dataset consists of axial T1-weighted brain tumor images, as proposed in one recently published study in the Q1 journal. After performing data augmentation, the first dataset encompasses 8.000 healthy and 8.000 brain tumor images with grades I, II, III, and IV and the second dataset includes 4.908 images with Glioma, Meningioma, and Pituitary, with 1.636 images belonging to each tumor class. The swarm intelligence-driven convolutional neural network approach was evaluated and compared to other, similar methods and achieved a superior performance. The obtained accuracy was over 95% in all conducted experiments. Based on the established results, it is reasonable to conclude that the proposed approach could be used to develop networks that can assist doctors in diagnostics and help in the early detection of brain tumors.
29 April 2021 in Journal of Real-Time Image Processing
Artificial neural networks are one of the most commonly used methods in machine learning. Performance of network highly depends on the learning method. Traditional learning algorithms are prone to be trapped in local optima and have slow convergence. At the other hand, nature-inspired optimization algorithms are proven to be very efficient in complex optimization problems solving due to derivative-free solutions. Addressing issues of traditional learning algorithms, in this study, an enhanced version of artificial bee colony nature-inspired metaheuristics is proposed to optimize connection weights and hidden units of artificial neural networks. Proposed improved method incorporates quasi-reflection-based learning and guided best solution bounded mechanisms in the original approach and manages to conquer its deficiencies. First, the method is tested on a recent challenging CEC 2017 benchmark function set, then applied for training artificial neural network on five well-known medical benchmark datasets. Further, devised algorithm is compared to other metaheuristics-based methods. The efficiency is measured by five metrics - accuracy, specificity, sensitivity, geometric mean, and area under the curve. Simulation results prove that the proposed algorithm outperforms other metaheuristics in terms of accuracy and convergence speed. The improvement of the accuracy over the other methods on different datasets are between 0.03% and 12.94%. The quasi-refection-based learning mechanism significantly improves the convergence speed of the original artificial bee colony algorithm and together with the guided best solution bounded, the exploitation capability is enhanced, which results in significantly better accuracy.