Patients with type 1 diabetes must continually decide how much insulin to inject before each meal to maintain blood glucose levels within a healthy range. Recent research has worked on a solution for this burden, showing the potential of reinforcement learning as an emerging approach for the task of controlling blood glucose levels. In this paper, we test and evaluate several deep Q-learning algorithms for automated and personalized blood glucose regulation in an in silico type 1 diabetes patient with the goal of estimating and delivering proper insulin doses. The proposed algorithms are model-free approaches with no prior information about the patient. We used the Hovorka model with meal variation and carbohydrate counting errors to simulate the patient included in this work. Our experiments compare different deep Q-learning extensions showing promising results controlling blood glucose levels, with some of the proposed algorithms outperforming standard baseline treatment.

This paper proposes a robust control design method using reinforcement learning for controlling partially-unknown dynamical systems under uncertain conditions. The method extends the optimal reinforcement learning algorithm with a new learning technique based on the robust control theory. By learning from the data, the algorithm proposes actions that guarantee the stability of the closed-loop system within the uncertainties estimated also from the data. Control policies are calculated by solving a set of linear matrix inequalities. The controller was evaluated using simulations on a blood glucose model for patients with Type 1 diabetes. Simulation results show that the proposed methodology is capable of safely regulating the blood glucose within a healthy level under the influence of measurement and process noises. The controller has also significantly reduced the post-meal fluctuation of the blood glucose. A comparison between the proposed algorithm and the existing optimal reinforcement learning algorithm shows the improved robustness of the closed-loop system using our method.

Fibromyalgia is a chronic disease that affects a considerable fraction of the global population, primarily women. Physical activity is often recommended as a tool to manage the symptoms. In this study, we tried to replicate a positive result of pain reduction through physical activity. After collecting pain and physical activity data from seven women with fibromyalgia, one patient experienced a considerable reduction in pain intensity. According to the patient, the improvement was related to physical activity. Our study was conducted to investigate the replicability of this result through personalized activity recommendations. Out of the other six patients, three experienced a reduction in pain. The remaining three patients did not experience any pain relief. Our results show that two of these were not able to follow the activity recommendations. These results indicate that physical activity may have a positive effect on chronic pain patients. To estimate how effective physical activity can be for this patient group, an intervention with longer follow-ups and larger sample sizes needs to be performed in the future.