Information Physics: Multiparameter models, which can emerge in biology and other disciplines, are often sensitive to only a small number of parameters and robust to changes in the rest; approaches from information theory can be used to distinguish between the two parameter groups. In physics, on the other hand, one does not need to know the details at smaller length and time scales in order to understand the behavior on large scales. This hierarchy has been recognized for a long time and formalized within the renormalization group (RG) approach.Machtaet al.(p.604) explored the connection between two scales by using an information-theoretical approach based on the Fisher Information Matrix to analyze two commonly used physics models—diffusion in one dimension and the Ising model of magnetism—as the time and length scales, respectively, were progressively coarsened. The expected “stiff” parameters emerged, in agreement with RG intuition.
Large scale models of physical phenomena demand the development of new statistical and computational tools in order to be effective. Many such models are “sloppy,” i.e., exhibit behavior controlled by a relatively small number of parameter combinations. We review an information theoretic framework for analyzing sloppy models. This formalism is based on the Fisher information matrix, which is interpreted as a Riemannian metric on a parameterized space of models. Distance in this space is a measure of how distinguishable two models are based on their predictions. Sloppy model manifolds are bounded with a hierarchy of widths and extrinsic curvatures. The manifold boundary approximation can extract the simple, hidden theory from complicated sloppy models. We attribute the success of simple effective models in physics as likewise emerging from complicated processes exhibiting a low effective dimensionality. We discuss the ramifications and consequences of sloppy models for biochemistry and science more generally. We suggest that the reason our complex world is understandable is due to the same fundamental reason: simple theories of macroscopic behavior are hidden inside complicated microscopic processes.
Fitting model parameters to experimental data is a common yet often challenging task, especially if the model contains many parameters. Typically, algorithms get lost in regions of parameter space in which the model is unresponsive to changes in parameters, and one is left to make adjustments by hand. We explain this difficulty by interpreting the fitting process as a generalized interpolation procedure. By considering the manifold of all model predictions in data space, we find that cross sections have a hierarchy of widths and are typically very narrow. Algorithms become stuck as they move near the boundaries. We observe that the model manifold, in addition to being tightly bounded, has low extrinsic curvature, leading to the use of geodesics in the fitting process. We improve the convergence of the Levenberg-Marquardt algorithm by adding geodesic acceleration to the usual step.
For a long time, it has been known that the power spectrum of Barkhausen noise had a power-law decay at high frequencies. Up to now, the theoretical predictions for this decay have been incorrect, or have only applied to a small set of models. In this paper, we describe a careful derivation of the power spectrum exponent in avalanche models, and in particular, in variations of the zero-temperature random-field Ising model. We find that the naive exponent, which has been derived in several other papers, is in general incorrect for small when large avalanches are common. is the exponent describing the distribution of avalanche sizes, and is the exponent describing the relationship between avalanche size and avalanche duration.) We find that for a large class of avalanche models, including several models of Barkhausen noise, the correct exponent for is We explicitly derive the mean-field exponent of In the process, we calculate the average avalanche shape for avalanches of fixed duration and scaling forms for a number of physical properties.
3 July 2017 in Annual Review of Materials Research
We give a bird's-eye view of the plastic deformation of crystals aimed at the statistical physics community, as well as a broad introduction to the statistical theories of forced rigid systems aimed at the plasticity community. Memory effects in magnets, spin glasses, charge density waves, and dilute colloidal suspensions are discussed in relation to the onset of plastic yielding in crystals. Dislocation avalanches and complex dislocation tangles are discussed via a brief introduction to the renormalization group and scaling. Analogies to emergent scale invariance in fracture, jamming, coarsening, and a variety of depinning transitions are explored. Dislocation dynamics in crystals challenge nonequilibrium statistical physics. Statistical physics provides both cautionary tales of subtle memory effects in nonequilibrium systems and systematic tools designed to address complex scale-invariant behavior on multiple length scales and timescales.