Accelerator physics relies on numerical algorithms to solve optimization problems in online accelerator control and tasks such as experimental design and model calibration in simulations. The effectiveness of optimization algorithms in discovering ideal solutions for complex challenges with limited resources often determines the problem complexity these methods can address. The accelerator physics community has recognized the advantages of Bayesian optimization algorithms, which leverage statistical surrogate models of objective functions to effectively address complex optimization challenges, especially in the presence of noise during accelerator operation and in resource-intensive physics simulations. In this review article, we offer a conceptual overview of applying Bayesian optimization techniques toward solving optimization problems in accelerator physics. We begin by providing a straightforward explanation of the essential components that make up Bayesian optimization techniques. We then give an overview of current and previous work applying and modifying these techniques to solve accelerator physics challenges. Finally, we explore practical implementation strategies for Bayesian optimization algorithms to maximize their performance, enabling users to effectively address complex optimization challenges in real-time beam control and accelerator design. Published by the American Physical Society 2024

Particle accelerators require constant tuning during operation to meet beam quality, total charge and particle energy requirements for use in a wide variety of physics, chemistry and biology experiments. Maximizing the performance of an accelerator facility often necessitates multiobjective optimization, where operators must balance trade-offs between multiple competing objectives simultaneously, often using limited, temporally expensive beam observations. Usually, accelerator optimization problems are solved off-line, prior to actual operation, with advanced beam line simulations and parallelized optimization methods (NSGA-II, swarm optimization). Unfortunately, it is not feasible to use these methods for online multiobjective optimization, since beam measurements can only be done in a serial fashion, and these optimization methods require a large number of measurements to converge to a useful solution. Here, we introduce a multiobjective Bayesian optimization scheme, which finds the full Pareto front of an accelerator optimization problem efficiently in a serialized manner and is thus a critical step towards practical online multiobjective optimization in accelerators. This method uses a set of Gaussian process surrogate models, along with a multiobjective acquisition function, to reduce the number of observations needed to converge by at least an order of magnitude over current methods. We demonstrate how this method can be modified to specifically solve optimization challenges posed by the tuning of accelerators. This includes the addition of optimization constraints, objective preferences and costs related to changing accelerator parameters.

Characterizing the phase space distribution of particle beams in accelerators is a central part of understanding beam dynamics and improving accelerator performance. However, conventional analysis methods either use simplifying assumptions or require specialized diagnostics to infer high-dimensional ($>2\mathrm{D}$) beam properties. In this Letter, we introduce a general-purpose algorithm that combines neural networks with differentiable particle tracking to efficiently reconstruct high-dimensional phase space distributions without using specialized beam diagnostics or beam manipulations. We demonstrate that our algorithm accurately reconstructs detailed 4D phase space distributions with corresponding confidence intervals in both simulation and experiment using a limited number of measurements from a single focusing quadrupole and diagnostic screen. This technique allows for the measurement of multiple correlated phase spaces simultaneously, which will enable simplified 6D phase space distribution reconstructions in the future.

Plasma wakefields can enable very high accelerating gradients for frontier high energy particle accelerators, in excess of $10\mathrm{GeV}/\mathrm{m}$. To overcome limits on single stage acceleration, specially shaped drive beams can be used in both linear and nonlinear plasma wakefield accelerators (PWFA), to increase the transformer ratio, implying that the drive beam deceleration is minimized relative to acceleration obtained in the wake. In this Letter, we report the results of a nonlinear PWFA, high transformer ratio experiment using high-charge, longitudinally asymmetric drive beams in a plasma cell. An emittance exchange process is used to generate variable drive current profiles, in conjunction with a long (multiple plasma wavelength) witness beam. The witness beam is energy modulated by the wakefield, yielding a response that contains detailed spectral information in a single-shot measurement. Using these methods, we generate a variety of beam profiles and characterize the wakefields, directly observing transformer ratios up to $\mathcal{R}=7.8$. Furthermore, a spectrally based reconstruction technique, validated by 3D particle-in-cell simulations, is introduced to obtain the drive beam current profile from the decelerating wake data.

Particle accelerators are invaluable discovery engines in the chemical, biological and physical sciences. Characterization of the accelerated beam response to accelerator input parameters is often the first step when conducting accelerator-based experiments. Currently used techniques for characterization, such as grid-like parameter sampling scans, become impractical when extended to higher dimensional input spaces, when complicated measurement constraints are present, or prior information known about the beam response is scarce. Here in this work, we describe an adaptation of the popular Bayesian optimization algorithm, which enables a turn-key exploration of input parameter spaces. Our algorithm replaces the need for parameter scans while minimizing prior information needed about the measurement’s behavior and associated measurement constraints. We experimentally demonstrate that our algorithm autonomously conducts an adaptive, multi-parameter exploration of input parameter space, potentially orders of magnitude faster than conventional grid-like parameter scans, while making highly constrained, single-shot beam phase-space measurements and accounts for costs associated with changing input parameters. In addition to applications in accelerator-based scientific experiments, this algorithm addresses challenges shared by many scientific disciplines, and is thus applicable to autonomously conducting experiments over a broad range of research topics.

Future improvements in particle accelerator performance are predicated on increasingly accurate online modeling of accelerators. Hysteresis effects in magnetic, mechanical, and material components of accelerators are often neglected in online accelerator models used to inform control algorithms, even though reproducibility errors from systems exhibiting hysteresis are not negligible in high precision accelerators. In this Letter, we combine the classical Preisach model of hysteresis with machine learning techniques to efficiently create nonparametric, high-fidelity models of arbitrary systems exhibiting hysteresis. We experimentally demonstrate how these methods can be used in situ, where a hysteresis model of an accelerator magnet is combined with a Bayesian statistical model of the beam response, allowing characterization of magnetic hysteresis solely from beam-based measurements. Finally, we explore how using these joint hysteresis-Bayesian statistical models allows us to overcome optimization performance limitations that arise when hysteresis effects are ignored.