Effective Graph Modeling and Contrastive Learning Zhao

Effective Graph Modeling and Contrastive Learning Zhao


Research Focus & Metrics

Academic Career Length

6Years (2021-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
10 November 2022 in IEEE Transactions on Intelligent Transportation Systems
Verified
Journal Article
Closed access
EZEffective Graph Modeling and Contrastive Learning Zhao
Effective Graph Modeling and Contrastive Learning Zhao
YLYoufang Lin
Youfang Lin
HWHaomin Wen
Haomin Wen
TWTonglong Wei
Tonglong Wei
XJXiyuan Jin
Xiyuan Jin
HWHuaiyu Wan
Huaiyu Wan
Recent works demonstrate that capturing correlations between road network nodes is crucial to improving traffic flow forecasting accuracy. In general, there are spatial, temporal, and joint spatial-temporal correlations between two nodes, whose strength is related to spatial and temporal position factors. For example, traffic congestion that occurs at a traffic hub has a wider and stronger impact than that at a branch road. Moreover, the above impacts can vary with temporal position. Although spatial-temporal graph convolution networks have become a popular paradigm for modeling those correlations, there are still three problems with existing models: (i) failing to effectively model joint spatial-temporal correlations; (ii) ignoring spatial and temporal position factors when modeling the aforementioned correlations; and (iii) failing to capture distinct spatial-temporal patterns of each node. To cope with the above issues, this paper proposes a novel Spatial-Temporal Position-aware Graph Convolution Network (STPGCN) for traffic flow forecasting. Specifically, a trainable embedding module is constructed to represent the spatial and temporal positions of the nodes. Subsequently, a spatial-temporal position-aware relation inference module is proposed to adaptively infer the correlation weights of the three important spatial-temporal relations. Based on this, the generated spatial-temporal relations are integrated into a graph convolution layer for aggregating and updating node features. Finally, we design a spatial-temporal position-aware gated activation unit in the graph convolution, to capture the node-specific pattern features under the guidance of position embedding. Extensive experiments on six real-world datasets demonstrate the superiority of our model in terms of prediction performance and computational efficiency.

22 December 2023 in Knowledge-Based Systems
Verified
Journal Article
Closed access
TWTonglong Wei
Tonglong Wei
YLYoufang Lin
Youfang Lin
SGShengnan Guo
Shengnan Guo
YLYan Lin
Yan Lin
EZEffective Graph Modeling and Contrastive Learning Zhao
Effective Graph Modeling and Contrastive Learning Zhao
HWHuaiyu Wan
Huaiyu Wan

12 January 2023 in IEEE Transactions on Network and Service Management
Verified
Journal Article
Closed access
HLHuiqiang Lian
Huiqiang Lian
JLJiahui Li
Jiahui Li
HWHao Wu
Hao Wu
EZEffective Graph Modeling and Contrastive Learning Zhao
Effective Graph Modeling and Contrastive Learning Zhao
LZLei Zhang
Lei Zhang
XWXin Wang
Xin Wang
End-to-end QoS measurement plays an indispensable role in the decision-making of cloud services and IoT services. Many efforts have paid on developing QoS prediction approaches in the past decade leveraging the principle of collaborative filtering. But there remain many challenging issues concerning multi-task prediction requirements, feature selection for heterogeneous prediction tasks, and model training. To this end, we propose an effective personalized service QoS prediction method from the perspective of multi-task learning, named PMT. PMT consists of specially-designed feature selection components and a multi-step model training strategy. The feature selection method leverages the principle of multi-expert decision-making and self-attention mechanism. The multi-step model training enables a weight-free configuration for parallel prediction tasks. Experimental results on a large dataset with two tasks and a small dataset with three tasks demonstrate that PMT is superior to the state-of-the-art QoS prediction methods.

12 July 2022 in IEEE Transactions on Intelligent Transportation Systems
Verified
Journal Article
Closed access
EZEffective Graph Modeling and Contrastive Learning Zhao
Effective Graph Modeling and Contrastive Learning Zhao
YLYoufang Lin
Youfang Lin
YZYongkai Zhang
Yongkai Zhang
HWHaomin Wen
Haomin Wen
YLYunxiao Liu
Yunxiao Liu
HWHuaiyu Wan
Huaiyu Wan
Forecasting traffic inflows and outflows is crucial for intelligent transportation applications such as traffic management and risk assessment. Recently, deep learning models, which focus on capturing spatio-temporal correlations between stations (locations) by constructing Spatio-Temporal Feature Learners (STFL), have achieved promising performance in traffic inflows and outflows prediction. However, two unresolved issues limit the performance of these models. i) dynamic and heterogeneous intra-and inter-relationships between flows are ignored, and ii) the STFL in these models cannot capture the global information. To address the above issues, we propose a novel deep Spatio-Temporal Network framework based on Multi-Relational learning (MR-STN) for predicting traffic inflows and outflows. Specifically, a multi-relational learning module is designed to comprehensively model three kinds of relationships between flows while extracting diverse spatio-temporal features. In this module, an enhanced STFL is developed to capture both local and global information. Then, a feature fusion module is introduced to extract fused features for inflows and outflows respectively via a gated fusion mechanism. On this basis, the prediction module uses fusion features to generate future inflows and outflows. Finally, we implement the proposed framework with four state-of-the-art graph-based deep spatio-temporal models to demonstrate its generality and superiority. Extensive experiments on three datasets show that the proposed framework can significantly boost the performance of existing models.

13 December 2023 in IEEE Transactions on Services Computing
Verified
Journal Article
Closed access
JLJiahui Li
Jiahui Li
HWHao Wu
Hao Wu
QHQiang He
Qiang He
EZEffective Graph Modeling and Contrastive Learning Zhao
Effective Graph Modeling and Contrastive Learning Zhao
XWXin Wang
Xin Wang
Dynamic quality of service (QoS) measurement is crucial for discovering services and developing online service systems. Collaborative filtering-based approaches perform dynamic QoS prediction by incorporating temporal information only but never consider the dynamic network environment and suffer from poor performance. Considering different service invocation routes directly reflect the dynamic environment and further lead to QoS fluctuations, we coin the problem of Dynamic QoS Prediction (DQP) with Intelligent Route Estimation (IRE) and propose a novel framework named IRE4DQP. Under the IRE4DQP framework, the dynamic environment is captured by Network Status Representation, and the IRE is modeled as a Markov decision process and implemented by a deep learning agent. After that, the DQP is achieved by a specific neural model with the estimated route as input. Through collaborative training with reinforcement and inverse reinforcement learning, eventually, based on the updated representations of the network status, IRE learns an optimal route policy that matches well with observed QoS values, and DQP achieves accurate predictions. Experimental results demonstrate that IRE4DQP outperforms SOTA methods on the accuracy of response-time prediction by 5.79-31.34% in MAE, by 1.29-20.18% in RMSE, and by 4.43-27.73% in NMAE and with a success rate of nearly 45% on finding routes.

18 October 2023 in Expert Systems with Applications
Verified
Journal Article
Closed access
XJXiyuan Jin
Xiyuan Jin
Jing WangJing Wang
Jing Wang
SGShengnan Guo
Shengnan Guo
TWTonglong Wei
Tonglong Wei
EZEffective Graph Modeling and Contrastive Learning Zhao
Effective Graph Modeling and Contrastive Learning Zhao
HWHuaiyu Wan
Huaiyu Wan