12 December 2023 in IEEE Internet of Things Journal
The wireless networked control system (WNCS) is a closed-loop hierarchical network that enables interaction among wireless communication, computation, and control components to support various services ranging from information exchange to intelligent decision making. Different from a single communication system aiming for reliable or efficient delivery, WNCS is goal-oriented, highlighting the ultimate control performance requirement guaranteed under various limits of communication, computation, and control resources. In this article, we present a comprehensive survey of WNCS from the communication perspective. We discuss appropriate WNCS architecture, topics, such as sensing strategy design, under energy and bandwidth constraints, state estimation problems in the presence of imperfect channels, and control approaches for WNCS performance. We further pay attention to the joint design within WNCS to achieve well-performing WNCS improvements. Moreover, considering the fact that timely transmission of the measurements is of significance to precise control, we provide a review of WNCS design involving the Age of Information (AoI) that copes with the goal-oriented requirements. The challenges and new research directions are discussed at the end of this survey.
28 December 2020 in IEEE Internet of Things Journal
In this article, we investigate the freshness of the vehicular status updates in space–air–ground-integrated networks (SAGINs), where the status updates are generated by sampling a fixed-rate dynamic Markov process and delivered to the monitor over an unreliable channel instantaneously. The Age of Information (AoI) is adopted to capture the timeliness of the status updates. Two hybrid automatic repeat request (HARQ) schemes, namely, classical HARQ scheme and incremental redundancy HARQ (IR-HARQ) scheme, are taken into consideration to combat the errors occurred in the transmission. In this setting, once an update is not decoded successfully, one should carefully decide how to schedule the updates for optimizing the AoI. Especially, differential encoding scheme is introduced in the considered system to exploit the temporal correlations of the source. By differential encoding, each update can be actual or differential, based on the differential encoding level. To minimize the long-term average age, we formulate a Markov decision process (MDP), and prove that the optimal transmission policies for classical HARQ scheme and IR-HARQ scheme behave differently in threshold structures. Furthermore, we jointly optimize the codeword length, differential encoding level, and retransmission times to minimize the AoI. The performance comparison shows the advantages of the IR-HARQ scheme over the classical HARQ scheme from the age perspective.
19 March 2024 in IEEE Transactions on Vehicular Technology
Addressing the goal-oriented design for mission-critical services like remote control, stands as a pivotal challenge in the space-air-ground integrated network (SAGIN). This paper investigates an energy-efficient wireless networked control system with local and remote controllers in SAGIN. Frequent state transmission from sensor to remote controller would improve the quality of control (QoC) at the expense of nontrivial energy consumption. Nevertheless, such a tradeoff for the considered system has received little attention. In this sense, we propose a goal-oriented transmission scheduling design to balance QoC and energy consumption. In particular, we formulate an optimization problem on minimizing the weighted sum of control cost and power consumption by making decisions about whether to transmit the state or not. By formulating a Markov Decision Process framework, the optimal transmission scheduling policy is proven to have a threshold structure tied to the age of information (AoI). Then, the optimal AoI threshold is obtained by means of a discrete-time Markov chain. Equipped with this, we propose an AoI-thresholding mechanism that can provide insights into when to transmit the state in a computationally-efficient manner. Numerical results shed light on the advantages of the proposed policy over the periodical and greedy transmission policies for the considered system.
1 December 2021 in IEEE Transactions on Intelligent Transportation Systems
In this paper, we investigate the timeliness of the vehicular status updates in space-air-ground integrated networks (SAGIN) for intelligent transportation systems (ITS). The Age of Information (AoI) is introduced to capture the timeliness of the vehicular status updates. To overcome the inherent end-to-end latency taken by the long-distance communications in SAGIN for ITS, prediction has attracted extensive attention in the existing literature and shown its superiority. Nevertheless, it is not clear whether prediction is beneficial to the AoI. Inspired by the motivation, we first formulate a model of a real-time vehicular communication link with prediction, where the generated update can be predicted and transmitted to the receiver in advance. Then, we derive the explicit expression of the average age and show that the prediction is not always beneficial to the AoI. Instead, prediction is more applicable for the short-distance communications than long-distance communications. Further, to improve the AoI performance, a MDP framework is presented to obtain a switching structure of the optimal prediction policy. The results show the advantage of the optimal prediction policy over the policy of predicting all the time or with no predicting.
16 January 2025 in IEEE Internet of Things Journal
We investigate a time-sensitive wireless networked control system (WNCS) where multiple Internet of Things (IoT) sensors embedded with their respective local controllers send their observations to a remote controller over shared wireless channels. From an infinite-time horizon perspective, each process should be stabilized essentially to prevent the process’s states from divergence. Nevertheless, limited channel resources may not fulfill users’ stability requirements due to possibly insufficient transmission attempts. Regarding the tradeoff between stability property and channel resources, we aim to design a transmission scheduling policy that minimizes the infinite-time control cost under channel constraints. Starting with the stability condition analysis under varying scheduling policies, the applied decentralized networked control architecture shows its superiority in extending the WNCS’s scale. By approximately expressing control cost as a function of the Age of Information (AoI), the considered scheduling issue is transformed into an AoI-dependent optimization problem under channel and stability constraints. Then, we develop a control-oriented Whittle index policy where AoI, system parameters, and stability incentives construct the Whittle indexes. Numerical results demonstrate that our proposed policy outperforms the baseline policies in terms of control cost, especially in heterogeneous WNCSs. Furthermore, results show that the proposed policy containing stability factor can support more users with respective stability guarantees.
27 August 2024 in IEEE Transactions on Wireless Communications
This paper investigates a wireless remote control problem in cyber-physical system (CPS) with multiple processes. In the system, sensors collect the state information of each process and transmit it to the controller through wireless channels. The communication constraints, including transmission delays, packet loss, and bandwidth limitation, are taken into account. To evaluate control timeliness for each process, this paper adopts the concept of age of information (AoI) in the context of closed-loop control. Meanwhile, to strike a tradeoff between transmission delay and outage, this paper introduces an innovative cross-slot scheduling policy not covered in existing literature, which can freely allocate transmission time and occupancy bandwidth. We prove that the scheduling problem in bandwidth limited remote control is an NP-hard problem, and establish the optimization problem as a Markov decision process (MDP) problem. The Deep-Double-Dueling-Q-Learning (D3QN) algorithm is employed to approximate the optimal scheduling policy for the scenario where the channel information is unknown and the system is model-free. By extensive simulations, the proposed cross-time slot scheduling policy demonstrates superior effectiveness in allocating time-frequency resources and achieving outstanding results.