We study the optimal transmission policy of a sensor node in an energy-harvesting wireless sensor network. We consider a hybrid wireless sensor network in which a mobile sink is used to collect data. Taking cues from recent works on the value of information (VoI), we posit that the optimal policy maximises the VoI that can be sent for the node to the sink. We model this system as a discrete-time queueing model with two coupled queues. In particular, the sensor node under study operates energy neutral and harvests energy according to a Bernoulli process. Discretising energy into “energy chunks”, the battery is modelled as a first queue, whereas a second queue is introduced to hold the VoI at the sensor node. From the vantage point of the sensor node, this means that the sensor can only send when the sink is sufficiently close. When this is the case, the sensor decides whether to transmit its data or not depending on the amount of available energy and the value of the information. Focusing on the optimal transmission policy, we formulate the optimal control problem as a Markov Decision Process with a level-dependent block-triangular transition probability matrix. We find the optimal policy which maximises the mean VoI transmitted from the node in the long run and numerically show that it is of threshold type. Further, we assess the value function at optimal policy analytically and provide some properties. Finally, we investigate the structure of the optimal policy and the mean VoI collected from the node for different system parameters by means of some numerical experiments.
We present a comprehensive numerical approach with reasonably light complexity in terms of implementation and computation for assessing the performance of hybrid make-to-stock (MTS)/make-to-order (MTO) systems. In such hybrid systems, semi-finished products are produced up front and stored in a decoupling inventory. When an order arrives, the products are completed and possibly customised. We study this system in a stochastic setting: demand and production are modelled by random processes. In particular, our model includes two coupled Markovian queues: one queue represents the decoupling inventory and the other the order backlog. These queues are coupled as order processing can only occur when both queues are non-empty. We rely on matrix analytic techniques to study the performance of the MTO/MTS system under non-restrictive stochastic assumptions. In particular, we allow for arrival correlation and non-exponential setup and MTS and MTO processing times, while the hybrid MTS/MTO system is managed by an -type threshold policy that governs switching from MTO to MTS and back. By some numerical examples, we assess the impact of inventory control, irregular order arrivals, setup and order processing times on inventory levels and lead times.