17 April 2025 in IEEE Transactions on Network and Service Management
The rapid advancement of artificial intelligence applications has resulted in the deployment of a growing number of deep neural networks (DNNs) on mobile devices. Given the limited computational capabilities and small battery capacity of these devices, supporting efficient DNN inference presents a significant challenge. This paper considers the joint design of DNN model partitioning and offloading under high-concurrent tasks scenarios. The primary objective is to accelerate DNN task inference and reduce computational delay. Firstly, we propose an innovative adaptive inference framework that partitions DNN models into interdependent sub-tasks through a hierarchical partitioning method. Secondly, we develop a delay prediction model based on a Random Forest (RF) regression algorithm to estimate the computational delay of each sub-task on different devices. Finally, we designed a high-performance DNN partitioning and task offloading method based on an attention mechanism-aided Soft Actor-Critic (AMSAC) algorithm. The bandwidth allocation for each user is determined by the attention mechanism based on the characteristics of the DNN tasks, and the Soft Actor-Critic algorithm is used for adaptive layer-level partitioning and offloading of the DNN model, reducing collaborative inference delay. Extensive experiments demonstrate that our proposed AMSAC algorithm effectively reduces DNN task inference latency cost and improves service quality.
23 February 2026 in IEEE Internet of Things Journal
In collaborative inference scenarios, semantic communication replaces raw data transmission by conveying task-oriented semantic features to improve bandwidth efficiency. However, under noisy wireless channels, the combined effects of semantic compression distortion and channel noise lead to severe information loss, resulting in degraded inference accuracy. To address this issue, this article proposes a multiscale semantic compression collaborative inference (MSCCI) framework that achieves efficient, stable inference performance under high compression ratios (CRs) and elevated noise levels. Specifically, a UNet-based encoder extracts multiscale semantic features on an IoT device. These features are then integrated into a unified stream using a novel semantic fusion compression strategy, thereby substantially reducing communication overhead. The edge server decoder decompresses features and recovers image semantics via progressive upsampling and multiscale semantic restoration. For noisy wireless channels, the framework incorporates squeeze-and-excitation (SE) attention for dynamic feature channel weighting and residual connections for enhanced low-SNR robustness. Experimental results demonstrate that our collaborative inference framework for semantic communication outperforms state-of-the-art algorithms, and the approach’s effectiveness and robustness are verified across various channel conditions.
1 January 2026 in IEEE Transactions on Instrumentation and Measurement
17 August 2026 in Future Generation Computer Systems
1 January 2026 in IEEE Internet of Things Journal