The spiking activity of neuronal networks follows laws that are not time-reversal symmetric; the notion of pre-synaptic and post-synaptic neurons, stimulus correlations and noise correlations have a clear time order. Therefore, a biologically realistic statistical model for the spiking activity should be able to capture some degree of time irreversibility. We use the thermodynamic formalism to build a framework in the context maximum entropy models to quantify the degree of time irreversibility, providing an explicit formula for the information entropy production of the inferred maximum entropy Markov chain. We provide examples to illustrate our results and discuss the importance of time irreversibility for modeling the spike train statistics.

We study the diffusion of an ensemble of overdamped particles sliding over a tilted random potential (produced by the interaction of a particle with a random polymer) with long-range correlations. We found that the diffusion properties of such a system are closely related to the correlation function of the corresponding potential. We model the substrate as a symbolic trajectory of a shift space which enables us to obtain a general formula for the diffusion coefficient when normal diffusion occurs. The total time that the particle takes to travel through $n$ monomers can be seen as an ergodic sum to which we can apply the central limit theorem. The latter can be implemented if the correlations decay fast enough in order for the central limit theorem to be valid. On the other hand, we presume that when the central limit theorem breaks down the system give rise to anomalous diffusion. We give two examples exhibiting a transition from normal to anomalous diffusion due to this mechanism. We also give analytical expressions for the diffusion exponents in both cases by assuming convergence to a stable law. Finally we test our predictions by means of numerical simulations. DOI: http://dx.doi.org/10.1103/PhysRevE.88.062143 ©2013 American Physical Society

In this work, we introduce a method for estimating the entropy rate and the entropy production rate from a finite symbolic time series. From the point of view of statistics, estimating entropy from a finite series can be interpreted as a problem of estimating parameters of a distribution with a censored or truncated sample. We use this point of view to give estimations of the entropy rate and the entropy production rate, assuming that they are parameters of a (limit) distribution. The last statement is actually a consequence of the fact that the distribution of estimations obtained from recurrence-time statistics satisfies the central limit theorem. We test our method using a time series coming from Markov chain models, discrete-time chaotic maps, and a real DNA sequence from the human genome.

We obtain bounds on fluctuations of two entropy estimators for a class of one-dimensional Gibbs measures on the full shift. They are the consequence of a general exponential inequality for Lipschitz functions of n variables. The first estimator is based on empirical frequencies of blocks scaling logarithmically with the sample length. The second one is based on the first appearance of blocks within typical samples.

We consider the maximum entropy Markov chain inference approach to characterize the collective statistics of neuronal spike trains, focusing on the statistical properties of the inferred model. We review large deviations techniques useful in this context to describe properties of accuracy and convergence in terms of sampling size. We use these results to study the statistical fluctuation of correlations, distinguishability and irreversibility of maximum entropy Markov chains. We illustrate these applications using simple examples where the large deviation rate function is explicitly obtained for maximum entropy models of relevance in this field.