The clustering ensemble has emerged as an important extension of the classical clustering problem. It provides an elegant framework to integrate multiple weak base clusterings to generate a strong consensus result. Most existing clustering ensemble methods usually exploit all data to learn a consensus clustering result, which does not sufficiently consider the adverse effects caused by some difficult instances. To handle this problem, we propose a novel self-paced clustering ensemble (SPCE) method, which gradually involves instances from easy to difficult ones into the ensemble learning. In our method, we integrate the evaluation of the difficulty of instances and ensemble learning into a unified framework, which can automatically estimate the difficulty of instances and ensemble the base clusterings. To optimize the corresponding objective function, we propose a joint learning algorithm to obtain the final consensus clustering result. Experimental results on benchmark data sets demonstrate the effectiveness of our method.
Phishing attack is now a big threat to people’s daily life and networking environment. Through disguising illegal URLs as legitimate ones, attackers can induce users to visit the phishing URLs to get private information and other benefits. Effective methods of detecting phishing websites are urgently needed to alleviate the threats posed by phishing attacks. As the active learning capability from massive data sets, the neural network is widely used to detect phishing attacks. However, in the stage of training data sets, many useless and small influence features will trap the neural network model into the problem of over-fitting. This problem usually causes the trained model that cannot effectively detect the phishing websites. In order to alleviate this problem, this paper proposes OFS-NN, an effective phishing websites detection model based on optimal feature selection method and neural network. In the proposed OFS-NN, a new index (FVV, Feature Validity Value) is firstly introduced to evaluate the impact of sensitive features on phishing websites detection. Then, based on the new FVV index, an algorithm is designed to select optimal features from the phishing websites. This algorithm is able to alleviate the over-fitting problem of the underlying neural network to a large extent. The selected optimal features are used to train the underlying neural network and, finally, an optimal classifier is constructed to detect the phishing websites. The experimental results show that the OFS-NN model is accurate and stable in detecting many types of the phishing websites.
11 January 2025 in Future Generation Computer Systems
A clustering ensemble provides an elegant framework to learn a consensus result from multiple prespecified clustering partitions. Though conventional clustering ensemble methods achieve promising performance in various applications, we observe that they may usually be misled by some unreliable instances due to the absence of labels. To tackle this issue, we propose a novel active clustering ensemble method, which selects the uncertain or unreliable data for querying the annotations in the process of the ensemble. To fulfill this idea, we seamlessly integrate the active clustering ensemble method into a self-paced learning framework, leading to a novel self-paced active clustering ensemble (SPACE) method. The proposed SPACE can jointly select unreliable data to label via automatically evaluating their difficulty and applying easy data to ensemble the clusterings. In this way, these two tasks can be boosted by each other, with the aim to achieve better clustering performance. The experimental results on benchmark datasets demonstrate the significant effectiveness of our method. The codes of this article are released in http://Doctor-Nobody.github.io/codes/space.zip.
2 December 2021 in IEEE Transactions on Cloud Computing
To cope with the rapid development of the Internet of Things (IoT) and the increasing demand for real-time services, mobile edge computing (MEC) has become a promising solution which extends centralised cloud computing, to provision computing resources, storage and network services closer to the mobile device from the network edge. While computation offloading is a key feature in MEC to enable real-time services, offloading workflow tasks in MEC is an NP-hard problem. Typically, the problem of multi-workflow offloading with multi-objective optimization is still an open and challenging issue. Therefore, this paper proposes a multi-objective optimization algorithm called CHCE to minimize the cost and energy consumption of multi-workflow execution under the deadline constraint. Firstly, the sub-deadline constraint is added during initialization to generate more initial solutions that satisfy the deadline constraint. Then an adaptive clustering method is adopted to guide individuals to find a suitable mate during crossover operation. Finally, the probabilities of crossover and mutation are dynamically adjusted based on the historical information to control the evolution direction and convergence speed of algorithm. Comprehensive experiments are carried out for complex workflow applications on FogWorkflowSim, which demonstrate that CHCE can achieve better performance than four representative algorithms in three evaluation metrics.
6 April 2023 in IEEE Transactions on Knowledge and Data Engineering
Consensus clustering, which learns a consensus clustering result from multiple weak base results, has been widely studied. However, conventional consensus clustering methods only focus on the ensemble process while ignoring the quality improvement of the base results, and thus they just use the fixed base results for consensus learning. In this paper, we provide an alternative idea to improve the final consensus clustering performance by considering the base results refining. In our framework, we adaptively refine the base results in the process of the ensemble. In more detail, on one hand, we ensemble multiple K-means results to learn the consensus one by considering the consensus and diversity; on the other hand, we apply the consensus result to design a graph filter to learn a more cluster-friendly embedding for refining the base K-means results. In our framework, the consensus learning and base results refining are integrated into one unified objective function so that these two tasks can be boosted by each other. Then we design an effective iterative algorithm to optimize the carefully designed objective function. The extensive experiments on benchmark data sets demonstrate that the proposed method can outperform both the single clustering and the state-of-the-art consensus clustering methods. The codes of this paper are released in http://Doctor-Nobody.github.io/codes/ACMK.zip .