We study the effect of sampling windows on derived shock and associated energetic storm particle (ESP) properties in 296 fast-forward interplanetary shocks using Advanced Composition Explorer measurements at 1 au between 1998 February and 2013 August. We vary the time windows from 2 minutes to 20 minutes for the shock properties and from 2 minutes to 540 minutes for ESP properties. Variability is quantified by the median absolute deviation statistic. We find that the magnetic, density, and temperature compression ratios vary from their median values by 17.03%, 20.05%, and 25.91%, respectively; shock speed by 16.26%; speed jump by 45.46%; Alfvénic Mach number by 31.53%; and shock obliquity by 24.25%. Spectral indices in the 2 minute–540 minute windows downstream of the shock vary from the median value of 1.79 by 26.05% and by 30.53% from the 1.70 median value upstream of the shock. Similarity of ESP spectral indices upstream and downstream of the shock suggest that these ESP populations are likely locally accelerated at the shock. Furthermore, we find that for a moving sampling window around the shock, values for the density ratio hold for ∼10 minutes; the magnetic ratio and shock speed jump hold for ∼30 minutes and ∼60 minutes, respectively. Fixing the upstream window to 2 minutes and moving only in the downstream direction, the density ratio holds for ∼60 minutes downstream, magnetic ratio holds for ∼30 minutes, and the shock speed jump holds for ∼110 minutes. Beyond these time windows, derived shock properties are no longer representative of shock properties. These results provide constraints for modeling and forecasting efforts of shock and ESP-associated properties.
We introduce a new multivariate data set that utilizes multiple spacecraft collecting in‐situ and remote sensing heliospheric measurements shown to be linked to physical processes responsible for generating solar energetic particles (SEPs). Using the Geostationary Operational Environmental Satellites (GOES) flare event list from Solar Cycle (SC) 23 and part of SC 24 (1998–2013), we identify 252 solar events (>C‐class flares) that produce SEPs and 17,542 events that do not. For each identified event, we acquire the local plasma properties at 1 au, such as energetic proton and electron data, upstream solar wind conditions, and the interplanetary magnetic field vector quantities using various instruments onboard GOES and the Advanced Composition Explorer spacecraft. We also collect remote sensing data from instruments onboard the Solar Dynamic Observatory, Solar and Heliospheric Observatory, and the Wind solar radio instrument WAVES. The data set is designed to allow for variations of the inputs and feature sets for machine learning (ML) in heliophysics and has a specific purpose for forecasting the occurrence of SEP events and their subsequent properties. This paper describes a data set created from multiple publicly available observation sources that is validated, cleaned, and carefully curated for our ML pipeline. The data set has been used to drive the newly‐developed Multivariate Ensemble of Models for Probabilistic Forecast of SEPs (MEMPSEP; see MEMPSEP‐I (Chatterjee et al., 2024, https://doi.org/10.1029/2023SW003568) and MEMPSEP‐II (Dayeh et al., 2024, https://doi.org/10.1029/2023SW003697) for accompanying papers).
1 September 2023 in The Astrophysical Journal Supplement Series
Extreme-ultraviolet (EUV) images of the Sun are becoming an integral part of space weather prediction tasks. However, having different surveys requires the development of instrument-specific prediction algorithms. As an alternative, it is possible to combine multiple surveys to create a homogeneous data set. In this study, we utilize the temporal overlap of Solar and Heliospheric Observatory Extreme ultraviolet Imaging Telescope and Solar Dynamics Observatory Atmospheric Imaging Assembly 171 Å surveys to train an ensemble of deep-learning models for creating a single homogeneous survey of EUV images for two solar cycles. Prior applications of deep learning have focused on validating the homogeneity of the output while overlooking the systematic estimation of uncertainty. We use an approach called “approximate Bayesian ensembling” to generate an ensemble of models whose uncertainty mimics that of a fully Bayesian neural network at a fraction of the cost. We find that ensemble uncertainty goes down as the training set size increases. Additionally, we show that the model ensemble adds immense value to the prediction by showing higher uncertainty in test data that are not well represented in the training data.
Whitepaper #236 in the Decadal Survey for Solar and Space Physics (Heliophysics) 2024-2033. Main topics: basic research; infrastructure/workforce/other programmatic. Additional topics: fundamental space plasma theory; state of the profession; laboratory space plasma […]
The CLEAR Space Weather Center of Excellence's solar energetic particle (SEP) model, SOlar wind with FIeld lines and Energetic particles (SOFIE), was run and evaluated on‐site during the Space Weather Prediction Testbed (SWPT) exercise at the National Oceanic and Atmospheric Administration's Space Weather Prediction Center (NOAA/SWPC) in May 2025. As a physics‐based SEP model, SOFIE simulates the acceleration and transport of energetic particles by the coronal mass ejection (CME)‐driven shock in the solar corona and inner heliosphere, and has been validated against historical events. However, questions remain regarding whether a physics‐based model, traditionally considered computationally expensive, could meet operational needs. The SWPT exercise offered a valuable opportunity to evaluate SOFIE under simulated operational conditions. On‐site interactive feedback from SWPC forecasters, Space Radiation Analysis Group (SRAG) console operators, Community Coordinated Modeling Center (CCMC) personnel, and Moon‐to‐Mars Space Weather Analysis Office (M2M SWAO) analysts led to significant strategic improvements in the model configuration. The simulation grid was optimized by combining a coarser background grid with higher‐resolution regions along the CME path and toward Earth, reducing computational cost without compromising accuracy. In this work, we present the simulated operational performance of SOFIE and its capability to predict SEP fluxes significantly faster than real time. During the SWPT exercise, SOFIE completed a 4‐day SEP simulation within 5 hr using 1,000 central processing unit cores, although the earliest SEP forecast was obtained a few hours after CME onset. This marks a milestone in demonstrating SOFIE's operational usefulness and robustness to support future human space exploration.
Whitepaper #099 in the Decadal Survey for Solar and Space Physics (Heliophysics) 2024-2033. Main topics: basic research; infrastructure/workforce/other programmatic. Additional topics: ground-based missions/projects; laboratory space plasma physics; research tools and […]