In wireless rechargeable sensor networks (WRSNs), a novel approach to energy replenishment is offered by the utilization of mobile chargers (MCs), which charge nodes via wireless energy transfer technology. However, previous research on mobile charging schemes has commonly prioritized charging efficiency as a performance index, neglecting the importance of quality of sensing coverage (QSC). As the network scale increases, the MC’s charging power becomes unable to meet the energy needs of all nodes, leading to a decline in network QSC when nodes’ energy is depleted. To solve this problem, we study the problem of mobile charging sequence scheduling for optimal network QSC (MSSQ) and propose an improved quantum-behaved particle swarm optimization (IQPSO) algorithm. With the attraction of potential energy in quantum space, this algorithm will adaptively adjust the contraction expansion coefficient iteratively, leading to a global optimal solution for the mobile charging sequence. Extensive simulation results demonstrate the superiority of IQPSO over the widely used QPSO and Greedy algorithms in terms of network QSC, especially in large-scale networks.
Wireless energy transfer technology (WET)-enabled mobile charging provides an innovative strategy for energy replenishment in wireless rechargeable sensor networks (WRSNs), where the mobile charger (MC) can charge the sensors sequentially by WET according to the mobile charging scheduling scheme. Although there have been fruitful studies, they usually assume that all sensors will be charged fully once scheduled or charged to a fixed percentage determined by a charging upper threshold, resulting in low charging performance as they cannot adjust the charging operation on each sensor adaptively according to the real-time charging demands. To tackle this challenge, we first formulate the mobile charging scheduling as a joint mobile charging sequence scheduling and charging upper threshold control problem (JSSTC), where the charging upper threshold of each sensor can adjust adaptively. Then, we propose a novel multi-discrete action space deep Q-network approach for JSSTC (MDDRL-JSSTC), where MC is regarded as an agent exploring the environment. The state information observed by MC at each time step is encoded to construct a high-dimensional vector. Furthermore, a two-dimensional action is mapped to the charging destination of MC and the corresponding charging upper threshold at the next time step, using bidirectional gated recurrent units (Bi-GRU). Finally, we conduct a series of experiments to verify the superior performance of the proposed approach in prolonging the lifetime compared with the state-of-the-art approaches.
Wireless rechargeable sensor network (WRSN) is a new type of wireless sensor networks (WSNs) with rechargeable sensor nodes, which provides a feasible way to overcome the energy constraint prob- lem in WSN. Mobile charging is promising for WRSN by charging sensors using the mobile charger (MC), usually via wireless energy transfer (WET). However, it is challenging to maintain the network working sustainably under the limited capacity of the MC, and most existing works assume that the capacity of MC is infinite or with a very large value, which may be impossible in many real applica- tions. This paper will study the mobile charging sequence scheduling problem to maintain the network working sustainably and minimize the energy capacity of the MC (CSSEC). Specifically, the problem of minimizing the energy capacity of MC is coupled with mobile charging sequence scheduling, and the charging sequence will directly affect the energy cost of MC during a charging tour. Therefore, we propose an improved deep Q-network for CSSEC (IDQN-CSSEC) to address this issue. It employs the MC as the agent to explore the WRSN, and determines a charging policy for MC based on the charging demand of sensors, which selects the next sensor for charging. IDQN-CSSEC uses the Q learning and deep Q-network (DQN) comprehensively, which trains the Q table of the Q learning and the networks of DQN in the early stage of the training, and updates them simultaneously. The action determined by Q learning is selected with a greater probability, which decreases as the iteration step increases. Simu- lation experiments verify that the charging policy determined by IDQN-CSSEC can make the network work sustainably with the minimal energy cost of the MC by comparing it with the baseline methods.