Federated Learning (FL) enables distributed clients to collaboratively train models without exposing their private data. However, it is difficult to implement efficient FL due to limited resources. Most existing works compress the transmitted gradients or prune the global model to reduce the resource cost, but leave the compressed or pruned parameters under-optimized, which degrades the training performance. To address this issue, the neural composition technique constructs size-adjustable models by composing low-rank tensors, allowing every parameter in the global model to learn the knowledge from all clients. Nevertheless, some tensors can only be optimized by a small fraction of clients, thus the global model may get insufficient training, leading to a long completion time, especially in heterogeneous edge scenarios. To this end, we enhance the neural composition technique, enabling all parameters to be fully trained. Further, we propose a lightweight FL framework, called Heroes, with enhanced neural composition and adaptive local update. A greedy-based algorithm is designed to adaptively assign the proper tensors and local update frequencies for participating clients according to their heterogeneous capabilities and resource budgets. On this basis, we further propose an extension of Heroes, termed AdaHeroes, which further improves the training performance under the statistical heterogeneity scenario based on an adaptive client selection strategy. Extensive experiments demonstrate that Heroes can reduce traffic consumption by about 72.46% and provide up to 2.76× speedup compared to the baselines. Furthermore, with the setting of statistical heterogeneity, AdaHeroes can improve the test accuracy by about 4.77% compared with Heroes and the baselines.
11 July 2024 in IEEE Transactions on Services Computing
Monitoring and anomaly detection of key performance indicators (KPIs) are crucial for large Internet companies to maintain the reliability of their Web services. Influenced by human behavior and schedules, the KPIs of Web services typically exhibit seasonal characteristics. These characteristics may be complex as different KPIs exhibit differences in trend, multiple periods, and noise behaviors. However, existing anomaly detection methods typically only model one fixed pattern of seasonal KPIs, which may lead to performance degradation when dealing with diverse seasonal KPIs. In this work, we propose a novel anomaly detection model for seasonal KPIs, Diner , which incorporates multiple interpretable components. It is able to capture the additive and multiplicative trends, multiple periods, and seasonal noise in intricate seasonal KPIs, making it easily adaptable to different types of seasonal KPIs. Additionally, we present a set of evaluation criteria for generic time series anomaly detection tasks, which prove more effective in handling ambiguous manual labels and various anomaly events. Experiments are conducted on three real-world datasets, and the performance Diner surpassed both the statistical baseline and the state-of-the-art deep learning baselines.
15 September 2021 in Journal of Advanced Transportation
Electric taxis have been adopted as a new energy public transportation tool as opposed to traditional taxis in modern city. Designing an efficient swapping station deployment scheme has become an important issue to improve the endurance capability of electric taxis. In this study, based on real operation trajectory data from 3997 taxis in Suzhou city, the battery swapping demand of taxis based on urban traffic flow is obtained to construct a network coverage deployment model under rule constraints, where the main optimization goal is to minimize the number of swapping stations and load balancing. According to this model, a traffic drive planning algorithm based on computational geometry is presented. The experimental results illustrate that the deployment scheme obtained by the proposed algorithm is significantly optimized in terms of the deployment cost and service load and has a lower algorithm time complexity than the typical unified deployment scheme. Therefore, the proposed method can be applied to improve the operating efficiency of the urban electric taxi system.
The proliferation of artificial intelligence (AI) and online services has significantly escalated the demand for computing and storage resources, which are fundamentally enabled by cloud computing infrastructure. As the backbone of cloud computing services, data centers have undergone continuous expansion in scale, consequently leading to significant energy consumption and a significant carbon footprint. To effectively mitigate the environmental impact, the strategy should prioritize the integration of renewable energy, while simultaneously minimizing other contributing factors such as energy consumption. Achieving both objectives simultaneously requires a fine-grained, dynamic approach to workload management. To this end, this study proposes a comprehensive container placement strategy that integrates a dynamic priority-based container selection algorithm with a multi-factor single-objective container placement algorithm based on the Dream Optimization Algorithm (DOA). The placement algorithm converts multiple factors—including load balancing in multi-data center environments, energy consumption, renewable energy utilization rate, carbon emissions, Service Level Agreement Violation (SLAV), and container migration costs—into a comprehensive fitness metric. Experimental results on Google and Alibaba datasets show our method consistently achieves the highest renewable energy utilization rates (up to 92.08%) and the lowest carbon emissions. Furthermore, our integrated strategy demonstrates a superior trade-off, reducing migration counts by up to 16.3% and SLAV by 12.4% compared to baselines, while maintaining excellent green performance. This establishes our method as a practical and effective solution for sustainable cloud computing.
Ensuring reliable operation of cloud networks is critical for cloud service providers to guarantee quality of service for tenants. A promising solution is to design a high-fidelity cloud network validation platform that proactively validates the correctness of all operations before implementing changes to the production network. However, the tight coupling between physical and virtual networks in the cloud poses challenges to achieving high-fidelity cloud network validation. Existing network validation platforms focus primarily on traditional physical networks, while ignoring virtual network validation. Regrettably, neglecting the combined validation of physical and virtual networks will result in inaccurate evaluations. To bridge this gap, we present HifiCNet, a high-fidelity platform that concurrently validates both physical and virtual networks. HifiCNet designs an orchestrator to elegantly coordinate the interaction between physical and virtual networks in the cloud and innovatively adopts an emulator-simulator hybrid architecture to ensure high fidelity and scalability for cloud network validation. Through extensive evaluation based on real topologies and traffic traces, we show that HifiCNet enables high-fidelity validation of cloud network configurations, services, and exceptions. Notably, HifiCNet can leverage 38 servers to establish a physical network comprising 10k hosts, as well as a virtual network consisting of 200k virtual machines.