Online reinforcement learning (RL) algorithms are increasingly used to personalize digital interventions in the fields of mobile health and online education. Common challenges in designing and testing an RL algorithm in these settings include ensuring the RL algorithm can learn and run stably under real-time constraints, and accounting for the complexity of the environment, e.g., a lack of accurate mechanistic models for the user dynamics. To guide how one can tackle these challenges, we extend the PCS (predictability, computability, stability) framework, a data science framework that incorporates best practices from machine learning and statistics in supervised learning to the design of RL algorithms for the digital interventions setting. Furthermore, we provide guidelines on how to design simulation environments, a crucial tool for evaluating RL candidate algorithms using the PCS framework. We show how we used the PCS framework to design an RL algorithm for Oralytics, a mobile health study aiming to improve users’ tooth-brushing behaviors through the personalized delivery of intervention messages. Oralytics will go into the field in late 2022.
1 December 2015 in The Journal of the American Dental Association
The present work is focused on the development, analytical characterization and evaluation of selective and sensitive SWNT-chemiresistor immunosensor for the label-free detection of salivary α-amylase (SAA). SWNTs were aligned to bridge lithographically patterned gold microelectrodes using AC dielectrophoresis followed by functionalization with anti-SAA antibodies. The nano-immunosensors exhibited excellent sensitivity over the clinically relevant range (19 to 308 U ml−1) with a limit of detection (LOD) of 6 µg ml−1 (0.6 U ml−1) and 7.8 µg ml−1 (0.78 U ml−1) in phosphate buffer and artificial saliva, respectively, and no interference from other components of saliva. This label-free nano-immunosensor technology has potential application in clinical diagnosis for stress biomarkers expressed in human saliva at the point-of-care.