Journal of Medical Internet Research - International Scientific Journal for Medical Research, Information and Communication on the Internet #Preprint #PeerReviewMe: Warning: This is a unreviewed preprint. Readers are warned that the document has not been peer-reviewed by expert/patient reviewers or an academic editor, may contain misleading claims, and is likely to undergo changes before final publication, if accepted, or may have been rejected/withdrawn. Readers with interest and expertise are encouraged to sign up as peer-reviewer, if the paper is within an open peer-review period. Please cite this preprint only for review purposes or for grant applications and CVs (if you are the author). Background: Mobile health applications (apps) provide an opportunity for easy, just-in-time, access to health promotion and self-management support. The number and breadth of health-related apps in the marketplace has provided a programmatic resource with immense potential for public health. However, poor user engagement with these apps remains a significant unresolved challenge. Objectives: Given the information on when a user might benefit from which type of support, the primary aim of this quality improvement study was to assess the effect of offering this support via a push notification containing a tailored health message versus not sending a push notification on proximal engagement with the app. Secondary aims examined whether this effect varies by number of weeks in the program, day of the week, and time of day. Methods: The quality improvement study analyzes the causal effects of push notifications on proximal engagement in 1,255 users of a commercial workplace wellbeing intervention product over 89 days. The test application employs a micro-randomized trial (MRT) design to send push notifications. At one of six available times per day (8:30AM, 12:30PM, 5:30PM, 6:30PM, 7:30PM or 8:30PM; selected randomly), available users were randomized with equal probability to be sent or not sent a push notification containing a tailored health message. Availability rules were pre-specified and depended on time since the previous sent push notification, time since previous user engagement with the app, and day of the week. Push notifications contained health messages tailored to the user as well as to the user’s current context. The primary outcome was whether the user engaged with the app over the next 24 hours. A generalization of log-linear regression analysis, adapted for use with data arising from a MRT, was used to examine the effect of sending a push vs not sending a push on the probability of engagement over the next 24 hours. Results: Users were 3.9% more likely to engage with the app in the next 24 hours when a tailored health message was sent vs when it was not sent (95%CI, 1.01 to 1.08; p<0.05). The effect of sending the message attenuated over the course of the study, but not significantly (p=0.84). When sent a tailored health message on weekends, users were 8.7% more likely to engage with the app (95% CI, 1.01 to 1.17; p<0.05); whereas on weekdays users were 2.5% more likely to engage with the app (95% CI, 0.98 to 1.07; p=0.27). The effect of sending a tailored health message was greatest at 12:30PM on weekends: 11.8% more likely to engage (90% CI, 1.02 to 1.13; p<0.10). Conclusion: Sending a push notification containing a tailored health message was associated with greater engagement in a mobile health app. Results suggested that users are more likely to engage with the app within 24 hours when push notifications are sent at mid-day on weekends. This has potential implications for other mobile health apps that rely on user-engagement and self-monitoring.