13 December 2023 in IEEE Transactions on Pattern Analysis and Machine Intelligence
The training and inference of Graph Neural Networks (GNNs) are costly when scaling up to large-scale graphs. Graph Lottery Ticket (GLT) has presented the first attempt to accelerate GNN inference on large-scale graphs by jointly pruning the graph structure and the model weights. Though promising, GLT encounters robustness and generalization issues when deployed in real-world scenarios, which are also long-standing and critical problems in deep learning ideology. In real-world scenarios, the distribution of unseen test data is typically diverse. We attribute the failures on out-of-distribution (OOD) data to the incapability of discerning causal patterns, which remain stable amidst distribution shifts. In traditional spase graph learning, the model performance deteriorates dramatically as the graph/network sparsity exceeds a certain high level. Worse still, the pruned GNNs are hard to generalize to unseen graph data due to limited training set at hand. To tackle these issues, we propose the Resilient Graph Lottery Ticket (RGLT) to find more robust and generalizable GLT in GNNs. Concretely, we reactivate a fraction of weights/edges by instantaneous gradient information at each pruning point. After sufficient pruning, we conduct environmental interventions to extrapolate potential test distribution. Finally, we perform last several rounds of model averages to further improve generalization. We provide multiple examples and theoretical analyses that underpin the universality and reliability of our proposal. Further, RGLT has been experimentally verified across various independent identically distributed (IID) and out-of-distribution (OOD) graph benchmarks. The source code for this work is available at https://github.com/Lyccl/RGLT for PyTorch implementation.
19 December 2025 in IEEE Signal Processing Magazine
Brain foundation models (BFMs) represent a transformative paradigm in computational neuroscience that leverages large-scale pretraining on diverse neural signals to achieve robust generalization across tasks, modalities, and experimental contexts. This survey article establishes the first comprehensive definition and framework for BFMs, systematically examining their construction, core methodologies, and applications. We present key approaches for data processing and training strategies alongside diverse applications spanning brain decoding and scientific discovery. Through critical analysis of recent methodological innovations, we identify fundamental challenges that must be addressed to realize the full potential of BFMs, including advancing data quality and standardization, optimizing model architectures, improving training efficiency, and enhancing interpretability. By bridging the gap between neuroscience and artificial intelligence (AI), BFMs present unprecedented opportunities to revolutionize brain research, clinical diagnostics, and therapeutic interventions. This article serves as a foundational reference for researchers and practitioners seeking to understand and advance this emerging field.