We propose new measures of shared information, unique information and synergistic information that can be used to decompose the mutual information of a pair of random variables (Y, Z) with a third random variable X. Our measures are motivated by an operational idea of unique information, which suggests that shared information and unique information should depend only on the marginal distributions of the pairs (X, Y) and (X,Z). Although this invariance property has not been studied before, it is satisfied by other proposed measures of shared information. The invariance property does not uniquely determine our new measures, but it implies that the functions that we define are bounds to any other measures satisfying the same invariance property. We study properties of our measures and compare them to other candidate measures.

Sleep encompasses approximately a third of our lifetime, yet its purpose and biological function are not well understood. Without sleep optimal brain functioning such as responsiveness to stimuli, information processing, or learning may be impaired. Such observations suggest that sleep plays a crucial role in organizing or reorganizing neuronal networks of the brain toward states where information processing is optimized.Increasing evidence suggests that cortical neuronal networks operate near a critical state characterized by balanced activity patterns, which supports optimal information processing. However, it remains unknown whether critical dynamics is affected in the course of wake and sleep, which would also impact information processing. Here, we show that signatures of criticality are progressively disturbed during wake and restored by sleep. We demonstrate that the precise power-laws governing the cascading activity of neuronal avalanches and the distribution of phase-lock intervals in human electroencephalographic recordings are increasingly disarranged during sustained wakefulness. These changes are accompanied by a decrease in variability of synchronization. Interpreted in the context of a critical branching process, these seemingly different findings indicate a decline of balanced activity and progressive distance from criticality toward states characterized by an imbalance toward excitation where larger events prevail dynamics. Conversely, sleep restores the critical state resulting in recovered power-law characteristics in activity and variability of synchronization. These findings support the intriguing hypothesis that sleep may be important to reorganize cortical network dynamics to a critical state thereby assuring optimal computational capabilities for the following time awake.

Measures of complexity are of immediate interest for the field of autonomous robots both as a means to classify the behavior and as an objective function for the autonomous development of robot behavior. In the present paper we consider predictive information in sensor space as a measure for the behavioral complexity of a two-wheel embodied robot moving in a rectangular arena with several obstacles. The mutual information (MI) between past and future sensor values is found empirically to have a maximum for a behavior which is both explorative and sensitive to the environment. This makes predictive information a prospective candidate as an objective function for the autonomous development of such behaviors. We derive theoretical expressions for the MI in order to obtain an explicit update rule for the gradient ascent dynamics. Interestingly, in the case of a linear or linearized model of the sensorimotor dynamics the structure of the learning rule derived depends only on the dynamical properties while the value of the MI influences only the learning rate. In this way the problem of the prohibitively large sampling times for information theoretic measures can be circumvented. This result can be generalized and may help to derive explicit learning rules from complexity theoretic measures.

We explore a new mechanism to explain polarization phenomena in opinion dynamics in which agents evaluate alternative views on the basis of the social feedback obtained on expressing them. High support of the favored opinion in the social environment is treated as a positive feedback which reinforces the value associated to this opinion. In connected networks of sufficiently high modularity, different groups of agents can form strong convictions of competing opinions. Linking the social feedback process to standard equilibrium concepts we analytically characterize sufficient conditions for the stability of bi-polarization. While previous models have emphasized the polarization effects of deliberative argument-based communication, our model highlights an affective experience-based route to polarization, without assumptions about negative influence or bounded confidence.

Despite the near universal assumption of individuality in biology, there is little agreement about what individuals are and few rigorous quantitative methods for their identification. Here, we propose that individuals are aggregates that preserve a measure of temporal integrity, i.e., “propagate” information from their past into their futures. We formalize this idea using information theory and graphical models. This mathematical formulation yields three principled and distinct forms of individuality—an organismal, a colonial, and a driven form—each of which varies in the degree of environmental dependence and inherited information. This approach can be thought of as a Gestalt approach to evolution where selection makes figure-ground (agent–environment) distinctions using suitable information-theoretic lenses. A benefit of the approach is that it expands the scope of allowable individuals to include adaptive aggregations in systems that are multi-scale, highly distributed, and do not necessarily have physical boundaries such as cell walls or clonal somatic tissue. Such individuals might be visible to selection but hard to detect by observers without suitable measurement principles. The information theory of individuality allows for the identification of individuals at all levels of organization from molecular to cultural and provides a basis for testing assumptions about the natural scales of a system and argues for the importance of uncertainty reduction through coarse-graining in adaptive systems.

In experiments, the dynamical behavior of systems is reflected in time series. Due to the finiteness of the observational data set, it is not possible to reconstruct the invariant measure up to an arbitrarily fine resolution and an arbitrarily high embedding dimension. These restrictions limit our ability to distinguish between signals generated by different systems, such as regular, chaotic, or stochastic ones, when analyzed from a time series point of view. We propose to classify the signal behavior, without referring to any specific model, as stochastic or deterministic on a certain scale of the resolution $\epsilon ,$ according to the dependence of the $(\epsilon ,\tau )$ entropy, $h(\epsilon ,\tau ),$ and the finite size Lyapunov exponent $\lambda \left(\epsilon \right)$ on $\epsilon .$