Graphs are widely used as a popular representation of the network structure of connected data. Graph data can be found in a wide spectrum of application domains such as social systems, ecosystems, biological networks, knowledge graphs, and information systems. With the continuous penetration of artificial intelligence technologies, graph learning (i.e., machine learning on graphs) has been gaining rapidly increasing attention from both researchers and practitioners. Graph learning has proved to be effective for many tasks, such as classification, link prediction, matching, and anomaly detection. Generally, graph learning methods extract relevant features of graphs by taking advantage of machine learning algorithms. In this survey, we present a comprehensive overview on the state of the art of graph learning. Special attention is paid to four categories of existing graph learning methods, including graph signal processing, matrix factorization, random walk, and deep learning. Major models and algorithms under these categories are reviewed respectively. Graph learning applications are examined. In addition, we discuss several promising research directions in this field.
12 January 2026 in IEEE Transactions on Neural Networks and Learning Systems
Graph transformers are a recent advancement in machine learning, offering a new class of neural network models for graph-structured data. The synergy between transformers and graph learning demonstrates strong performance and versatility across various graph-related tasks. This survey provides an in-depth review of recent progress and challenges in graph transformer research. We begin with foundational concepts of graphs and transformers. We then explore design perspectives of graph transformers, focusing on how they integrate graph inductive biases and graph attention mechanisms into the transformer architecture. Furthermore, we propose a taxonomy classifying graph transformers based on depth, scalability, and pretraining strategies, summarizing key principles for effective development of graph transformer models. Beyond technical analysis, we discuss the applications of graph transformer models for node-level, edge-level, and graph-level tasks, exploring their potential in other application scenarios as well. Finally, we identify remaining challenges in the field, such as scalability and efficiency, generalization and robustness, interpretability and explainability, dynamic and complex graphs, as well as data quality and diversity, charting future directions for graph transformer research.
19 March 2024 in IEEE Transactions on Neural Networks and Learning Systems
Understanding the latent disease patterns embedded in electronic health records (EHRs) is crucial for making precise and proactive healthcare decisions. Federated graph learning-based methods are commonly employed to extract complex disease patterns from the distributed EHRs without sharing the client-side raw data. However, the intrinsic characteristics of the distributed EHRs are typically non-independent and identically distributed (Non-IID), significantly bringing challenges related to data imbalance and leading to a notable decrease in the effectiveness of making healthcare decisions derived from the global model. To address these challenges, we introduce a novel personalized federated learning framework named PEARL, which is designed for disease prediction on Non-IID EHRs. Specifically, PEARL incorporates disease diagnostic code attention and admission record attention to extract patient embeddings from all EHRs. Then, PEARL integrates self-supervised learning into a federated learning framework to train a global model for hierarchical disease prediction. To improve the performance of the client model, we further introduce a fine-tuning scheme to personalize the global model using local EHRs. During the global model updating process, a differential privacy (DP) scheme is implemented, providing a high-level privacy guarantee. Extensive experiments conducted on the real-world MIMIC-III dataset validate the effectiveness of PEARL, demonstrating competitive results when compared with baselines.
With the support of cloud computing techniques, social coding platforms have changed the style of software development. Github is now the most popular social coding platform and project hosting service. Software developers of various levels keep entering Github, and use Github to save their public and private software projects. The large amounts of software developers and software repositories on Github are posing new challenges to the world of software engineering. This paper tries to tackle one of the important problems: analyzing the importance and influence of Github repositories. We proposed a HITS based influence analysis on graphs that represent the star relationship between Github users and repositories. A weighted version of HITS is applied to the overall star graph, and generates a different set of top influential repositories other than the results from standard version of HITS algorithm. We also conduct the influential analysis on per-month star graph, and study the monthly influence ranking of top repositories.
28 May 2021 in IEEE Transactions on Computational Social Systems
COVID-19 has spread all over the world, having an enormous effect on our daily life and work. In response to the epidemic, a lot of important decisions need to be taken to save communities and economies worldwide. Data clearly play a vital role in effective decision-making. Data-driven decision-making uses data-related evidence and insights to guide the decision-making process and verify the plan of action before it is committed. To better handle the epidemic, governments and policy-making institutes have investigated abundant data originating from COVID-19. These data include those related to medicine, knowledge, media, and so on. Based on these data, many prevention and control policies are made. In this survey article, we summarize the progress of data-driven decision-making in the response to COVID-19, including COVID-19 prevention and control, psychological counseling, financial aid, work resumption, and school reopening. We also propose some current challenges and open issues in data-driven decision-making, including data collection and quality, complex data analysis, and fairness in decision-making. This survey article sheds light on current policy-making driven by data, which also provides a feasible direction for further scientific research.
16 February 2023 in ACM Transactions on Intelligent Systems and Technology
The COVID-19 pandemic has posed great challenges to public health services, government agencies, and policymakers, raising huge social conflicts between public health and economic resilience. Policies such as reopening or closure of business activities are formulated based on scientific projections of infection risks obtained from infection dynamics models. Though most parameters in epidemic prediction service models can be set with domain knowledge of COVID-19, a key parameter, namely, human mobility, is often challenging to estimate due to complex spatio-temporal correlations and social contexts under escalating COVID-19 facilities. Moreover, how to integrate the various implicit features to accurately predict infectious cases is still an open issue. To address this challenge, we formulate the problem as a spatio-temporal network representation problem and propose STEP, a Spatio-Temporal Epidemic Prediction framework, to estimate pandemic infection risk of a city by integrating various real-world conditions (e.g., City Risk Index, climate, and medical conditions) into graph-structured data. We also employ a multi-head attention mechanism in representation learning to extract implicit features for a given city. Extensive experiments have been conducted upon the real-world dataset for 51 states (50 states and Washington, D.C.) of the USA. Experimental results show that STEP can yield more accurate pandemic infection risk estimation than baseline methods. Moreover, STEP outperforms other methods in both short-term and long-term prediction.