Digital interventions offer great promise for supporting health-related behavior change. However, there is much that we have yet to learn about how people respond to them. In this study, we present a novel mixed-methods approach to analysis of the complex and rich data that digital interventions collect. We perform secondary analysis of IntelliCare, an intervention in which participants are able to try 14 different mental health apps over the course of eight weeks. The goal of our analysis is to characterize users' app use behavior and experiences, and is rooted in theoretical conceptualizations of engagement as both usage and user experience. In the first aim, we employ cluster analysis to identify subgroups of participants that share similarities in terms of the frequency of their usage of particular apps, and then employ other engagement measures to compare the clusters. We identified four clusters with different app usage patterns: Low Usage, High Usage, Daily Feats Users, and Day to Day users. Each cluster was distinguished by its overall frequency of app use, or the main app that participants used. In the second aim, we developed a computer-assisted text analysis and visualization method - message highlighting - to facilitate comparison of the clusters. Last, we performed a qualitative analysis using participant messages to better understand the mechanisms of change and usability of salient apps from the cluster analysis. Our novel approach, integrating text and visual analytics with more traditional qualitative analysis techniques, can be used to generate insights concerning the behavior and experience of users in digital health contexts, for subsequent personalization and to identify areas for improvement of intervention technologies.
Stigma associated with substance use can have severe negative consequences for physical and mental health and serve as a barrier to treatment. Yet, research on stigma processes and stigma reduction interventions is limited. We use a social media dataset to examine: 1) the nature of stigma-related experience related to substance use; and 2) salient affective and temporal factors in the use of three substances: alcohol, cannabis, and opioids. We harvested several years of data pertaining to three substances - alcohol, cannabis, and opioids - from Reddit, a popular social networking platform. For Part I, we selected posts based on stigma-related keywords, performed content analysis, and rendered word clouds to examine the nature of stigma associated with these substances. In Part II, we employed natural language processing in conjunction with hierarchical clustering and visualization to explore temporal and affective factors. In Part I, internalized stigma was most commonly exhibited. Anticipated and enacted stigma were less common in posts relating to cannabis compared to the other two substances. Work, home, and school were important contexts in which stigma was observed. Part II showed that temporal markers were prominent; post authors shared stories of substance use journeys, and timelines of their experience with quitting and withdrawals. Shame, sadness, anxiety, and fear were common, with shame being more prominent in alcohol-related posts. Our findings highlight the importance of contextual factors in substance use recovery and stigma reduction and offer directions for future interventions.