The rapid evolution of coronaviruses in respiratory diseases, including severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2), poses a significant challenge for deep learning models to accurately detect and adapt to new strains. To address this challenge, we propose a novel Continuous Learning approach, CoroTrans-CL, for the diagnosis and prevention of various coronavirus infections that cause severe respiratory diseases using chest radiography images. Our approach is based on the Swin Transformer architecture and uses a combination of the Elastic Weight Consolidation (EWC) and Herding Selection Replay (HSR) methods to mitigate the problem of catastrophic forgetting. We constructed an informative benchmark dataset containing multiple strains of coronaviruses and present the proposed approach in five successive learning stages representing the epidemic timeline of different coronaviruses (SARS, MERS, wild-type SARS-CoV-2, and the Omicron and Delta variants of SARS-CoV-2) in the real world. Our experiments showed that the proposed CoroTrans-CL model achieved a joint training accuracy of 95.34%, an F1 score of 92%, and an average accuracy of 83.40% while maintaining a balance between plasticity and stability. Our study demonstrates that CoroTrans-CL can accurately diagnose and detect the changes caused by new mutant viral strains in the lungs without forgetting existing strains, and it provides an effective solution for the ongoing diagnosis of mutant SARS-CoV-2 virus infections.
Humans have the ability to incrementally learn, accumulate, update, and apply knowledge from dynamic environments. This capability, known as continual learning or lifelong learning, is also a long-term goal in the development of artificial intelligence. However, neural network-based continual learning suffers from catastrophic forgetting: the acquisition of new knowledge typically disrupts previously learned knowledge, leading to partial forgetting and a decline in the model’s overall performance. Most current continual learning methods can only mitigate catastrophic forgetting and fail to incrementally improve the overall performance. In this work, we aim to incrementally improve performance within sample incremental context by utilizing inter-stage edges as a pathway for explicit knowledge transfer in continual graph learning. Building on this pathway, we propose a knowledge-augmented replay method by leveraging evolving subgraphs of important nodes. This method enhances the distinction between patterns associated with different node classes and consolidates previously learned knowledge. Experiments on phishing detection in Ethereum transaction networks validate the effectiveness of the proposed method, demonstrating effective knowledge retention and augmentation while overcoming catastrophic forgetting and incrementally improving performance. The results also reveal the relationship between average accuracy and average forgetting. Lastly, we identify the key factor to incremental performance improvement, which lays a foundation for convergence of continual graph learning.
Recently, continual graph learning has been increasingly adopted for diverse graph-structured data processing tasks in non-stationary environments. Despite its promising learning capability, current studies on continual graph learning mainly focus on mitigating the catastrophic forgetting problem while ignoring continuous performance improvement. To bridge this gap, this article aims to provide a comprehensive survey of recent efforts on continual graph learning. Specifically, we introduce a new taxonomy of continual graph learning from the perspective of overcoming catastrophic forgetting. Moreover, we systematically analyze the challenges of applying these continual graph learning methods in improving performance continuously and then discuss the possible solutions. Finally, we present open issues and future directions pertaining to the development of continual graph learning and discuss how they impact continuous performance improvement.