20 November 2023 in Information Sciences
27 February 2025 in IEEE Transactions on Network and Service Management
Data stream classification is widely used in Internet of Things (IoT) scenarios such as health monitoring, anomaly detection and online diagnosis. Due to the continuous data stream changing dynamically over time, it is impossible to classify all the data simultaneously. Moreover, labeling each sample in practical data stream applications is time-and resource-consuming. The realistic situation is that only a few instances in a data stream are labeled. Therefore, classifying data streams with limited labels has become challenging in IoT scenarios. In this paper, we propose an incremental dynamic weighted semi-supervised method for classifying IoT data streams. Considering the dynamics and continuity in data streams, we use a chunk-based approach to learn the features in the data stream and assign weights to the classifier dynamically. Moreover, we deploy incremental learning methods to continuously learn from the sampled labeled data stream to update the classifier model, which can take advantage of newly incoming labeled data to improve learning performance. Experimental evaluations on seven IoT datasets show that the proposed method outperforms semi-supervised methods in accuracy, precision, and geometric mean (Gmean) by 10% and 5% over supervised methods, respectively.
18 February 2022 in Cluster Computing
15 January 2024 in IEEE Transactions on Network and Service Management
Anomaly detection is indispensable for achieving higher availability and reliability in the cloud computing. The traditional autoencoder-based method only models the historical normal samples and then identifies the current online anomaly samples by the fixed threshold of anomaly score. Although more advances have been made in recent years, two main challenges remain: (i) ignoring the historical anomaly samples, (ii) poor self-adaptive ability for online detection. To address the above challenges, we propose a unified detector, namely BroadCAE, which integrates autoencoder with contrastive learning and broad network. Specifically, the reconstruction loss is first replaced by contrastive loss, which equally formulates both normal and anomaly samples. These samples belonging to the same class become closer in a lower-dimensional space. Conversely, different classes of samples are far away from each other. Next, we apply the anomaly-score-based pseudo thresholds to train the dynamic threshold selection, which generates the threshold according to the coming sample. The broad network in dynamic threshold selection takes the place of the deep network, which overcomes catastrophic forgetting and adapts to new online samples. Finally, validation experiments are conducted on four benchmark datasets. Our BroadCAE outperforms the comparative baseline methods by averaging over 4% of the f1-score.
31 July 2023 in IEEE Transactions on Network and Service Management
The anomaly detection techniques for cloud service focus on alerting the operation engineers about the anomalous running state. However, their shortcoming of anomaly interpretability is an obstacle to understanding and further removing the anomalies. To overcome the abovementioned challenge, we propose a tree-like attention-based detection framework CauseFormer that provides both the metric and sample interpretations. Firstly, we develop stepwise attention based on the multi-head attention mechanism, which imitates the rule-based tree formation process. This network block extracts the higher-order features and generates the metric contribution that can be regarded as metric interpretation. Meanwhile, we design the hyper-circle loss function rather than cross-entropy-based approaches to optimize the representation. Then we introduce the majority voting rule into the classifier. This neighbor classification criterion raises the alarms of anomalies and achieves the sample interpretation. Finally, we conduct extensive experiments in four datasets collected from cloud application cases. The experimental results reveal the superiority of CauseFormer in improving detection accuracy and embodying practical interpretability.
19 June 2019 in IEEE Access