Jian Zhang

Jian Zhang

Auto-generated profile, based on publicly available information

Jian Zhang

National Supercomputer Center in Tianjin, Tianjin, China

Research Focus & Metrics

Academic Career Length

4Years (2023-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
17 November 2023
Verified
Conference Paper
Open access
YLYuqi Li
Yuqi Li
XLXiao Liquan
Xiao Liquan
JFJinghua Feng
Jinghua Feng
JZJian Zhang
Jian Zhang
QMQingzhen Ma
Qingzhen Ma
YYYuan Yuan
Yuan Yuan
Ensuring the reliability of the supercomputer is challenging. A potential solution could be to detect anomalies in a timely manner from the logs. However, current methods struggle with the vast diversity and volume of Exascale supercomputer logs due to the heavy reliance on manual labeling. This paper introduces AutoLAD, an unsupervised log anomaly detection method. Firstly, logs are embedded using a pre-trained language model. AutoLAD then creates a basic set of standard log patterns utilizing the Local Outlier Factor algorithm to remove anomalous entries. Finally, AutoLAD employs a single-log sliding-window strategy to handle the standard set, forming the autoencoder’s training set, which enables the learning of standard patterns. In the detection stage, the autoencoder evaluates a fixed-length log sequence. If the reconstruction error exceeds a set threshold, the sequence is deemed anomalous. Our approach, tested on logs from the NG-Tianhe supercomputer, achieved an F1 score of more than 0.91.