Chengyi Yang

Chengyi Yang

Auto-generated profile, based on publicly available information

Chengyi Yang

Digital Research Institute of ENN Group, Beijing, China

Research Focus & Metrics

Academic Career Length

5Years (2022-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
16 August 2022 in IEEE Transactions on Big Data
Verified
Journal Article
Closed access
CYChengyi Yang
Chengyi Yang
JLJia Liu
Jia Liu
HSHao Sun
Hao Sun
TLTongzhi Li
Tongzhi Li
ZLZengxiang Li
Zengxiang Li
Artificial Intelligence (AI) has been widely applied for Safety Inspection in a number of industrial domains. However, individual company usually could not provide sufficient data to support well-trained AI models. Federated Learning, as a new AI paradigm, enables a number of participants to contribute training data to co-create high-performance models without compromising data privacy. However, an effective incentive mechanism is essential to encourage participants to contribute high-quality data, and the fundamental of the incentive mechanism is to evaluate participants' contribution fairly. Shapley Value (SV) is a well-known approach to evaluate individual's marginal contribution in a coalition, but the canonical SV calculation and its available variants are very costly. In this paper, we proposed an FL framework to enable a number of natural gas companies from different cities to jointly train an object detection computer vision deep learning model for the purpose of identifying potential hazards, without sharing their confidential inspection photos directly. We improve state-of-the-art SV algorithm by proposing Weighted Truncation (WT) for unnecessary computations, and go further with Dynamic Programming (WTDP), achieving better trade-off between efficiency and accuracy. Based on our proposed WTDP-Shapley participant contribution evaluation approach, an effective end-to-end incentive mechanism is designed by leveraging knowledge of both data scientists and domain experts. According to our experiments, it could encourage participants to contribute scarce photos with potential hazards, and thus co-create a high-performance AI model to identify various hazards accurately for residential natural gas installation safety inspection.

13 May 2024
Verified
Conference Paper
Open access
ZLZengxiang Li
Zengxiang Li
ZHZhaoxiang Hou
Zhaoxiang Hou
HLHui Liu
Hui Liu
TLTongzhi Li
Tongzhi Li
CYChengyi Yang
Chengyi Yang
ZLZelei Liu
Zelei Liu
With the tremendous success of large language models such as ChatGPT, artificial intelligence has entered a new era of large models. Multimodal data, which can comprehensively perceive and recognize the physical world, has become an essential path towards general artificial intelligence. However, multimodal large models trained on public datasets often underperform in specific industrial domains. In this paper, we tackle the problem of building large vision-language intelligent models for specific industrial domains by leveraging the general large models and federated learning. We compare the challenges faced by federated learning in the era of small models and large models from different dimensions, and propose a technical framework for federated learning in the era of large models.Specifically, our framework mainly considers three aspects: heterogeneous model fusion, flexible aggregation methods, and data quality improvement. Based on this framework, we conduct a case study of leading enterprises contributing vision-language data and expert knowledge to city safety operation management. The preliminary experiments show that enterprises can enhance and accumulate their intelligence capabilities through federated learning, and jointly create an intelligent city model that provides high-quality intelligent services covering energy infrastructure security, residential community security and urban operation management.

21 October 2024
Verified
Conference Paper
Open access
SZShubao Zhao
Shubao Zhao
MJMing Jin
Ming Jin
ZHZhaoxiang Hou
Zhaoxiang Hou
CYChengyi Yang
Chengyi Yang
ZLZengxiang Li
Zengxiang Li
YWYi Wang
Yi Wang
Time series forecasting is a critical and challenging task in practical application. Recent advancements in pre-trained foundation models for time series forecasting have gained significant interest. However, current methods often overlook the multi-scale nature of time series, which is essential for accurate forecasting. To address this, we propose HiMTM, a hierarchical multi-scale masked time series modeling with self-distillation for long-term forecasting. HiMTM integrates four key components: (1) hierarchical multi-scale transformer (HMT) to capture temporal information at different scales; (2) decoupled encoder-decoder (DED) that directs the encoder towards feature extraction while the decoder focuses on pretext tasks; (3) hierarchical self-distillation (HSD) for multi-stage feature-level supervision signals during pre-training; and (4) cross-scale attention fine-tuning (CSA-FT) to capture dependencies between different scales for downstream tasks. These components collectively enhance multi-scale feature extraction in masked time series modeling, improving forecasting accuracy. Extensive experiments on seven mainstream datasets show that HiMTM surpasses state-of-the-art self-supervised and end-to-end learning methods by a considerable margin of 3.16-68.54%. Additionally, HiMTM outperforms the latest robust self-supervised learning method, PatchTST, in cross-domain forecasting by a significant margin of 2.3%. The effectiveness of HiMTM is further demonstrated through its application in natural gas demand forecasting.