10 April 2023 in IEEE Access
As informatization 3.0 accelerates the pace of people’s life and work, people’s happiness index and physical and mental health have become the focus of attention and research in sociology, psychology and medicine. Currently, neurological diseases represented by insomnia have become common chronic diseases. However, existing insomnia treatment methods mainly focus on drug therapy and EEG-based expert intervention, ignoring the individual variability of insomnia patients, the high cost of expert intervention, and the privacy of the user’s treatment environment. Therefore, aiming at the effect of white noise lite on sleep quality, this paper proposes a time-frequency domain correlation multimodal sleep enhancement framework based on reinforcement learning (RLSF), which is a closed-loop feedback sleep improvement framework that includes hardware and software. Specifically, the individual sleep state is fed for learning through EEG sensors’ input, and the agent is gradually trained to suit the sleep habit. This paper provides a reinforcement learning environment in which different agents can be deployed easily; then, we propose the Deep Net Sleep Improvement agent (DNSI agent) and the Time and Frequency-based Lightweight Sleep Improvement agent (TFLSI agent) for RLSF. Finally, the substantial experiments compare DNSI and TFLSI agent performance, and the results indicate that these two agents both have decision-making ability, and three volunteers’ Pittsburgh Sleep Quality Index significantly reduces by 3-7 points within two months and the average time to sleep is reduced by 131.4 seconds.
19 December 2019 in IEEE Access
Packet (link) scheduling algorithms in wireless networks should be able to maximize the networks' transmission capability while maintaining an acceptable delay and fairness performance. Maximum-weight (MW) policies based on the delay index are throughput-optimal in a wireless network. However, sampling the real-time head-of-line (HOL) packet statistics is still challenging. We model the delay as a function of the arrival rate and service rate, and this model enables the scheduling algorithms to obtain the packet delay without high-frequency sampling. Then, we model the delay-related performance problems in everyday life as a utility-maximization problem. By utilizing the Lyapunov optimization, we transform the initial problem into a queue stability problem and design an MW algorithm to solve it. The solution can ensure deterministic long-term average delay guarantees. Moreover, its throughput utility differs from the optimally fair value by an amount that is inversely proportional to the delay guarantee. We evaluate the theoretical performance via simulations. We also build a real-world software-defined wireless network platform and implement our algorithm on it to evaluate the algorithm's actual performance. The experimental results show that our method outperforms the state-of-the-art algorithm in terms of throughput by up to 13.83%, and it outperforms the default first-in, first-out (FIFO) method by up to 40.41%.
19 September 2025 in IEEE Communications Letters
Frequency modulation (FM) is widely used in broadcasting and IoT audio for its simplicity and low cost, yet remains susceptible to noise. We present DeepFM, a hybrid digital–analog system that supplements FM with a low-rate semantic side channel. A neural encoder compresses audio into quantized features sent alongside the FM signal. A channel-aware decoder fuses semantic bits, noisy analog input, and RSSI to restore high-fidelity audio. Evaluated on our SFR dataset at 0.5–12 kbps, DeepFM outperforms leading neural codecs in mainstream speech-quality metrics, particularly at low–medium bitrates (0.5–3 kbps). DeepFM demonstrates robust, real-time performance compatible with legacy FM infrastructure.