Large scale models of physical phenomena demand the development of new statistical and computational tools in order to be effective. Many such models are “sloppy,” i.e., exhibit behavior controlled by a relatively small number of parameter combinations. We review an information theoretic framework for analyzing sloppy models. This formalism is based on the Fisher information matrix, which is interpreted as a Riemannian metric on a parameterized space of models. Distance in this space is a measure of how distinguishable two models are based on their predictions. Sloppy model manifolds are bounded with a hierarchy of widths and extrinsic curvatures. The manifold boundary approximation can extract the simple, hidden theory from complicated sloppy models. We attribute the success of simple effective models in physics as likewise emerging from complicated processes exhibiting a low effective dimensionality. We discuss the ramifications and consequences of sloppy models for biochemistry and science more generally. We suggest that the reason our complex world is understandable is due to the same fundamental reason: simple theories of macroscopic behavior are hidden inside complicated microscopic processes.
Dynamics of complex systems is often driven by large and intricate networks of microscopic interactions, whose sheer size obfuscates understanding. With limited experimental data, many parameters of such dynamics are unknown, and thus detailed, mechanistic models risk overfitting and making faulty predictions. At the other extreme, simplead hocmodels often miss defining features of the underlying systems. Here we develop an approach that instead constructs phenomenological, coarse-grained models of network dynamics that automatically adapt their complexity to the available data. Such adaptive models produce accurate predictions even when microscopic details are unknown. The approach is computationally tractable, even for a relatively large number of dynamical variables. Using simulated data, it correctly infers the phase space structure for planetary motion, avoids overfitting in a biological signalling system and produces accurate predictions for yeast glycolysis with tens of data points and over half of the interacting species unobserved.
The response of single DNA molecules to externally applied forces and torques was directly measured using an angular optical trap. Upon overwinding, DNA buckled abruptly as revealed by a sharp extension drop followed by a torque plateau. When the DNA was held at the buckling transition, its extension hopped rapidly between two distinct states. Furthermore, the initial plectonemic loop absorbed approximately twice as much extension as was absorbed into the plectoneme upon each additional turn. The observed extension change after buckling and the postbuckling torque support a recent DNA elasticity model.
23 September 2019 in Proceedings of the National Academy of Sciences
Significance: Many biological systems exhibit an emergent ability to process information about their environment. This collective cognition emerges as a result of both the behavior of system components and their interactions, yet the relative importance of the two is often hard to disentangle. Here, we combined experiments and modeling to examine how fish schools collectively encode information about the external environment. We demonstrate that risk is predominantly encoded in the physical structure of groups, which individuals modulate in a way that augments or dampens behavioral cascades. We show that this modulation is necessary for behavioral cascades to spread and that it allows collective systems to be responsive to their environments even without changes in individual computation.
The hypothesis that many living systems should exhibit near-critical behavior is well motivated theoretically, and an increasing number of cases have been demonstrated empirically. However, a systematic analysis across biological networks, which would enable identification of the network properties that drive criticality, has not yet been realized. Here, we provide a first comprehensive survey of criticality across a diverse sample of biological networks, leveraging a publicly available database of 67 Boolean models of regulatory circuits. We find all 67 networks to be near critical. By comparing to ensembles of random networks with similar topological and logical properties, we show that criticality in biological networks is not predictable solely from macroscale properties such as mean degree and mean bias in the logic functions , as previously emphasized in theories of random Boolean networks. Instead, the ensemble of real biological circuits is jointly constrained by the local causal structure and logic of each node. In this way, biological regulatory networks are more distinguished from random networks by their criticality than by other macroscale network properties such as degree distribution, edge density, or fraction of activating conditions.