Courtney Diane Shelley

Courtney Diane Shelley

Auto-generated profile, based on publicly available information

Courtney Diane Shelley

Los Alamos National Lab. (LANL), Los Alamos, NM (United States)

Research Focus & Metrics

Academic Career Length

7Years (2020-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
14 April 2021 in JMIR Public Health and Surveillance
Verified
Journal Article
Open access
DGDax Gerts
Dax Gerts
CSCourtney D Shelley
Courtney D Shelley
NPNidhi Parikh
Nidhi Parikh
TPTravis Pitts
Travis Pitts
CRChrysm Watson Ross
Chrysm Watson Ross
ADAshlynn R Daughton
Ashlynn R Daughton
Background: The COVID-19 outbreak has left many people isolated within their homes; these people are turning to social media for news and social connection, which leaves them vulnerable to believing and sharing misinformation. Health-related misinformation threatens adherence to public health messaging, and monitoring its spread on social media is critical to understanding the evolution of ideas that have potentially negative public health impacts. Objective: The aim of this study is to use Twitter data to explore methods to characterize and classify four COVID-19 conspiracy theories and to provide context for each of these conspiracy theories through the first 5 months of the pandemic. Methods: We began with a corpus of COVID-19 tweets (approximately 120 million) spanning late January to early May 2020. We first filtered tweets using regular expressions (n=1.8 million) and used random forest classification models to identify tweets related to four conspiracy theories. Our classified data sets were then used in downstream sentiment analysis and dynamic topic modeling to characterize the linguistic features of COVID-19 conspiracy theories as they evolve over time. Results: Analysis using model-labeled data was beneficial for increasing the proportion of data matching misinformation indicators. Random forest classifier metrics varied across the four conspiracy theories considered (F1 scores between 0.347 and 0.857); this performance increased as the given conspiracy theory was more narrowly defined. We showed that misinformation tweets demonstrate more negative sentiment when compared to nonmisinformation tweets and that theories evolve over time, incorporating details from unrelated conspiracy theories as well as real-world events. Conclusions: Although we focus here on health-related misinformation, this combination of approaches is not specific to public health and is valuable for characterizing misinformation in general, which is an important first step in creating targeted messaging to counteract its spread. Initial messaging should aim to preempt generalized misinformation before it becomes widespread, while later messaging will need to target evolving conspiracy theories and the new facets of each as they become incorporated.

9 June 2021 in JMIR Public Health and Surveillance
Verified
Journal Article
Open access
LCLauren A Castro
Lauren A Castro
CSCourtney D Shelley
Courtney D Shelley
DODave Osthus
Dave Osthus
IMIsaac Michaud
Isaac Michaud
JMJason Mitchell
Jason Mitchell
SVSara Y Del Valle
Sara Y Del Valle
Background: Prior to the COVID-19 pandemic, US hospitals relied on static projections of future trends for long-term planning and were only beginning to consider forecasting methods for short-term planning of staffing and other resources. With the overwhelming burden imposed by COVID-19 on the health care system, an emergent need exists to accurately forecast hospitalization needs within an actionable timeframe. Objective: Our goal was to leverage an existing COVID-19 case and death forecasting tool to generate the expected number of concurrent hospitalizations, occupied intensive care unit (ICU) beds, and in-use ventilators 1 day to 4 weeks in the future for New Mexico and each of its five health regions. Methods: We developed a probabilistic model that took as input the number of new COVID-19 cases for New Mexico from Los Alamos National Laboratory’s COVID-19 Forecasts Using Fast Evaluations and Estimation tool, and we used the model to estimate the number of new daily hospital admissions 4 weeks into the future based on current statewide hospitalization rates. The model estimated the number of new admissions that would require an ICU bed or use of a ventilator and then projected the individual lengths of hospital stays based on the resource need. By tracking the lengths of stay through time, we captured the projected simultaneous need for inpatient beds, ICU beds, and ventilators. We used a postprocessing method to adjust the forecasts based on the differences between prior forecasts and the subsequent observed data. Thus, we ensured that our forecasts could reflect a dynamically changing situation on the ground. Results: Forecasts made between September 1 and December 9, 2020, showed variable accuracy across time, health care resource needs, and forecast horizon. Forecasts made in October, when new COVID-19 cases were steadily increasing, had an average accuracy error of 20.0%, while the error in forecasts made in September, a month with low COVID-19 activity, was 39.7%. Across health care use categories, state-level forecasts were more accurate than those at the regional level. Although the accuracy declined as the forecast was projected further into the future, the stated uncertainty of the prediction improved. Forecasts were within 5% of their stated uncertainty at the 50% and 90% prediction intervals at the 3- to 4-week forecast horizon for state-level inpatient and ICU needs. However, uncertainty intervals were too narrow for forecasts of state-level ventilator need and all regional health care resource needs. Conclusions: Real-time forecasting of the burden imposed by a spreading infectious disease is a crucial component of decision support during a public health emergency. Our proposed methodology demonstrated utility in providing near-term forecasts, particularly at the state level. This tool can aid other stakeholders as they face COVID-19 population impacts now and in the future.

25 May 2021 in Journal of Medical Internet Research
Verified
Journal Article
Open access
ADAshlynn R Daughton
Ashlynn R Daughton
CSCourtney D Shelley
Courtney D Shelley
MBMartha Barnard
Martha Barnard
DGDax Gerts
Dax Gerts
CRChrysm Watson Ross
Chrysm Watson Ross
GFGeoffrey Fairchild
Geoffrey Fairchild
Background: Health authorities can minimize the impact of an emergent infectious disease outbreak through effective and timely risk communication, which can build trust and adherence to subsequent behavioral messaging. Monitoring the psychological impacts of an outbreak, as well as public adherence to such messaging, is also important for minimizing long-term effects of an outbreak. Objective: We used social media data from Twitter to identify human behaviors relevant to COVID-19 transmission, as well as the perceived impacts of COVID-19 on individuals, as a first step toward real-time monitoring of public perceptions to inform public health communications. Methods: We developed a coding schema for 6 categories and 11 subcategories, which included both a wide number of behaviors as well codes focused on the impacts of the pandemic (eg, economic and mental health impacts). We used this to develop training data and develop supervised learning classifiers for classes with sufficient labels. Classifiers that performed adequately were applied to our remaining corpus, and temporal and geospatial trends were assessed. We compared the classified patterns to ground truth mobility data and actual COVID-19 confirmed cases to assess the signal achieved here. Results: We applied our labeling schema to approximately 7200 tweets. The worst-performing classifiers had F1 scores of only 0.18 to 0.28 when trying to identify tweets about monitoring symptoms and testing. Classifiers about social distancing, however, were much stronger, with F1 scores of 0.64 to 0.66. We applied the social distancing classifiers to over 228 million tweets. We showed temporal patterns consistent with real-world events, and we showed correlations of up to –0.5 between social distancing signals on Twitter and ground truth mobility throughout the United States. Conclusions: Behaviors discussed on Twitter are exceptionally varied. Twitter can provide useful information for parameterizing models that incorporate human behavior, as well as for informing public health communication strategies by describing awareness of and compliance with suggested behaviors.

11 September 2020
Verified
Report
Closed access
PDF file
CSCourtney Shelley
Courtney Shelley
The U.S. Department of Energy's Office of Scientific and Technical Information

11 January 2021 in JMIR Preprints
Verified
Preprint
Open access
ADAshlynn R Daughton
Ashlynn R Daughton
CSCourtney D Shelley
Courtney D Shelley
MBMartha Barnard
Martha Barnard
DGDax Gerts
Dax Gerts
CRChrysm Watson Ross
Chrysm Watson Ross
GFGeoffrey Fairchild
Geoffrey Fairchild
BACKGROUND Health authorities can minimize the impact of an emergent infectious disease outbreak through effective and timely risk communication, which can build trust and adherence to subsequent behavioral messaging. Monitoring the psychological impacts of an outbreak, as well as public adherence to such messaging, is also important for minimizing long-term effects of an outbreak. OBJECTIVE We used social media data from Twitter to identify human behaviors relevant to COVID-19 transmission, as well as the perceived impacts of COVID-19 on individuals, as a first step toward real-time monitoring of public perceptions to inform public health communications. METHODS We developed a coding schema for 6 categories and 11 subcategories, which included both a wide number of behaviors as well codes focused on the impacts of the pandemic (eg, economic and mental health impacts). We used this to develop training data and develop supervised learning classifiers for classes with sufficient labels. Classifiers that performed adequately were applied to our remaining corpus, and temporal and geospatial trends were assessed. We compared the classified patterns to ground truth mobility data and actual COVID-19 confirmed cases to assess the signal achieved here. RESULTS We applied our labeling schema to approximately 7200 tweets. The worst-performing classifiers had F1 scores of only 0.18 to 0.28 when trying to identify tweets about monitoring symptoms and testing. Classifiers about social distancing, however, were much stronger, with F1 scores of 0.64 to 0.66. We applied the social distancing classifiers to over 228 million tweets. We showed temporal patterns consistent with real-world events, and we showed correlations of up to –0.5 between social distancing signals on Twitter and ground truth mobility throughout the United States. CONCLUSIONS Behaviors discussed on Twitter are exceptionally varied. Twitter can provide useful information for parameterizing models that incorporate human behavior, as well as for informing public health communication strategies by describing awareness of and compliance with suggested behaviors.

12 October 2020 in medRxiv
Verified
Preprint
Open access
PDF file
CSCourtney D. Shelley
Courtney D. Shelley
PCPhilippa S. Chadwick
Philippa S. Chadwick
CMCarrie Manore
Carrie Manore
SVSara Y. Del Valle
Sara Y. Del Valle
Early school closures were a consistent, nationwide response to the COVID-19 pandemic in mid-March due to the role that children play in spreading influenza. This left us with limited understanding of COVID-19 transmission in children until several states reopened schools for the 2020-2021 school year. While early school closures were likely beneficial in protecting children in the initial stages of the pandemic in the U.S., long-term closures pose significant cumulative effects in children who rely on schools for instruction and additional social services, and for parents who need to balance work and childcare obligations. Reopening schools safely is a high priority for many interested stakeholders. Proposed in-person school reopening plans include traditional, 100% school capacity, five days per week instruction, hybrid scenarios with reduced in-person instruction and virtual learning, and various reduced school capacity schedules with non-pharmaceutical interventions in place. To assess the potential impacts of different reopening plans, we created a modified SIR-type transmission model that captures multiple known pathways of COVID-19 transmission in a 100,000-person community. Our results show that plans that utilize consecutive days in school and divide students into separated smaller cohorts who attend school together, as well as plans that emphasize distance learning, are better able to suppress disease spread and reduce risk from an introduced infective into the community. Plans with more consecutive school days are protective for both the schoolchildren and surrounding community by acting to separate the larger intermixing population into smaller intermixing subpopulations. The “Five-Day Switch” plan, which separates students into two cohorts, each of whom attend in-person learning for five consecutive days followed by five days of distance learning, best captures these protective attributes. All modeled plans assumed initially disease-free communities and that children’s interactions with the community are greatly reduced during instructional days, both for in-person and distance learning.