Merging technique is widely adopted by I/O schedulers to maximize system I/O throughput. However, I/O merging could increase the latency of individual I/O, thus incurring prolonged I/O latencies and enlarged performance variations. Even with better system throughput, higher worst-case latency experienced by some requests could block the SSD storage system, which violates the QoS (Quality of Service) requirement. In order to improve QoS performance while providing higher I/O throughput, this paper proposes a reinforcement learning based I/O merging approach. Through learning the characteristic of various I/O patterns, the proposed approach makes merging decisions adaptively based on different I/O workloads. Evaluation results show that the proposed scheme is capable of reducing the standard deviation of I/O latency by 19.1% on average, worst-case latency by 7.3-60.9% at the 99:9th percentile compared with the latest I/O merging scheme, while maximizing system throughput.

This work studies the Age-of-Information (AoI) optimization problem in the information-gathering wireless network systems, where time-sensitive data updates are collected from multiple information sources, and each source is equipped with a battery and harvests energy from ambient energy, such as solar, wind, etc. The arrival of the harvested energy can be modeled as the stochastic process, and an information source can deliver its data update only when 1) there is energy in the battery, and 2) this source is selected to transmit its data update based on the transmission policy. This work analyzes how the energy arrival pattern of each source and the transmission policy jointly influence the average AoI among multiple sources. To the best of our knowledge, this is the first work that formally develops the closed-form expression of average AoI in the Stationary Randomized Sampling (SRS) policy space and proposes approximation schemes with constant ratios in multi-source systems under a stochastic energy harvesting model. More specifically, under the perfect wireless channel, the closed-form expression of AoI under the SRS policy space with arbitrary finite battery size is developed. Based on the result, we propose the Max Energy-Aware Weight (MEAW) policy, which is proven to achieve 2-approximation in the full policy space. Under the uncertain wireless channel, we develop the closed-form expression of Whittle’s index to address the target problem. Based on the result, we propose the Energy-aware Whittle’s index policy (EWIP) and prove its approximate performance by using the Lyapunov optimization techniques. Experimental results show that MEAW under the perfect channel setting and EWIP under the uncertain channel setting both perform close to the theoretical lower bound and outperform the state-of-the-art schemes.

In a crowdsensing platform, users are invited to provide data services, and multiple requesters compete for desired services. Due to users' costs of providing services, it is critical to design incentive mechanisms to incentivize users with (monetary) rewards. Meanwhile, requesters may have individual budgets and compete for services with different procurement abilities. Such a setting falls into the budget-feasible mechanism design. However, most of the existing budget-feasible mechanisms focus on one-sided markets with a single requester rather than the two-sided markets with multiple requesters having different procurement abilities. Moreover, requesters and users can be selfish and strategic with their private information, which requires preventing information manipulation on both requesters' and users' sides. In this paper, we investigate budget-feasible mechanisms in two-sided crowdsensing markets where multiple strategic requesters come with private budgets to obtain services from the strategic users. We also consider the fairness on the requesters' side, i.e. , a requester with more budget should obtain more service. We propose budget-feasible mechanisms for two models by distinguishing the types of services, i.e. , the homogeneous or heterogeneous services. All proposed mechanisms satisfy fairness, budget feasibility, truthfulness on both users' and requesters' sides, and the constant approximation ratio. Numerical experiment results further demonstrate the efficiency of our proposed mechanisms.

In many IoT applications, information needs to be gathered from multiple heterogeneous sources to the base station for real-time processing and follow-up actions. Undoubtedly, information freshness, measured by age of information (AoI), is critical in taking responsive actions. Recent studies have taken AoI into the consideration of transmission scheduling over wireless channels. However, existing studies on guaranteeing AoI either assume error-free wireless channels or priorly known link reliability, which is unrealistic. In this paper, we tackle the AoI-guaranteed transmission scheduling problem over an unreliable channel with the aim of throughput maximization, which is modelled as an AoI-Guaranteed Multi-Armed Bandit (AG-MAB) problem. Since the problem has not been studied in the literature even for the oracle case with given link reliability, we first propose an optimal stationary randomized sampling (SRS) policy for the oracle case. For the AG-MAB problem with unknown link reliability, we propose learning algorithms that meet the AoI requirements with probability 1 and incur sublinear regret compared to Oracle SRS, which can also detect the unsatisfiability of the AoI constraint and switch to the fallback policy promptly with guaranteed accuracy. Numerical results show that our algorithm outperforms the AoI-constraint-aware baselines on throughput with per-source AoI requirement guaranteed.