The statistical analysis of data stemming from dynamical systems, including, but not limited to, time series, routinely relies on the estimation of information theoretical quantities, most notably Shannon entropy. To this purpose, possibly the most widespread tool is provided by the so-called plug-in estimator, whose statistical properties in terms of bias and variance were investigated since the first decade after the publication of Shannon's seminal works. In the case of an underlying multinomial distribution, while the bias can be evaluated by knowing support and data set size, variance is far more elusive. The aim of the present work is to investigate, in the multinomial case, the statistical properties of an estimator of a parameter that describes the variance of the plug-in estimator of Shannon entropy. We then exactly determine the probability distributions that maximize that parameter. The results presented here allow one to set upper limits to the uncertainty of entropy assessments under the hypothesis of memoryless underlying stochastic processes.
25 September 2021 in International Journal of Bifurcation and Chaos
Detection of chaos in experimental data is a crucial issue in nonlinear science. Historically, one of the first evidences of a chaotic behavior in experimental recordings came from laser physics. In a recent work, a Minimal Universal Model of chaos was developed by revisiting the model of laser with feedback, and a first electronic implementation was discussed. Here, we propose an upgraded electronic implementation of the Minimal Universal Model, which allows for a precise and reproducible analysis of the model’s parameters space. As a marker of a possible chaotic behavior the variability of the spiking activity that characterizes one of the system’s coordinates was used. Relying on a numerical characterization of the relationship between spiking activity and maximum Lyapunov exponent at different parameter combinations, several potentially chaotic settings were selected. The analysis via divergence exponent method of experimental time series acquired by using those settings confirmed a robust chaotic behavior and provided values of the maximum Lyapunov exponent that are in very good agreement with the theoretical predictions. The results of this work further uphold the reliability of the Minimal Universal Model. In addition, the upgraded electronic implementation provides an easily controllable setup that allows for further developments aiming at coupling multiple chaotic systems and investigating synchronization processes.
1 December 2019 in Chaos: An Interdisciplinary Journal of Nonlinear Science
The study of many dynamical systems relies on the analysis of experimentally-recorded sequences of events for which information is encoded in the sequence of interevent intervals. A correct interpretation of the results of the application of analytical techniques to these sequences requires the assessment of statistical significance. In most cases, the corresponding null-hypothesis distribution is unknown, thus forbidding an evaluation of the significance. An alternative solution, which is efficient in the case of continuous signals, is provided by the generation of surrogate data that share statistical and spectral properties with the original dataset. However, in the case of event sequences, the available algorithms for the generation of surrogate data can become cumbersome and computationally demanding. In this work, we present a new method for the generation of surrogate event sequences that relies on the joint distribution of successive interevent intervals. Our method, which was tested on both synthetic and experimental sequences, performs equally well or even better than conventional methods in terms of interevent interval distribution and autocorrelation while abating the computational time by at least one order of magnitude.
1 July 2021 in Chaos: An Interdisciplinary Journal of Nonlinear Science
The task of identifying and characterizing network structures out of experimentally observed time series is tackled by implementing different solutions, ranging from entropy-based techniques to the evaluation of the significance of observed correlation estimators. Among the metrics that belong to the first class, mutual information is of major importance due to the relative simplicity of implementation and its relying on the crucial concept of entropy. With regard to the second class, a method that allows us to assess the connectivity strength of a link in terms of a time scale of its observability via the significance estimate of measured cross correlation was recently shown to provide a reliable tool to study network structures. In this paper, we investigate the relationship between this last metric and mutual information by simultaneously assessing both metrics on large sets of data extracted from three experimental contexts, human brain magnetoencephalography, human brain electroencephalography, and surface wind measurements carried out on a small regional scale, as well as on simulated coupled, auto-regressive processes. We show that the relationship is well described by a power law and provide a theoretical explanation based on a simple noise and signal model. Besides further upholding the reliability of cross-correlation time scale of observability, the results show that the combined use of this metric and mutual information can be used as a valuable tool to identify and characterize connectivity links in a wide range of experimental contexts.
1 July 2020 in Chaos: An Interdisciplinary Journal of Nonlinear Science
Many studies in nonlinear science heavily rely on surrogate-based hypothesis testing to provide significance estimations of analysis results. Among the complex data produced by nonlinear systems, spike trains are a class of sequences requiring algorithms for surrogate generation that are typically more sophisticated and computationally demanding than methods developed for continuous signals. Although algorithms to specifically generate surrogate spike trains exist, the availability of open-source, portable implementations is still incomplete. In this paper, we introduce the SpiSeMe (Spike Sequence Mime) software package that implements four algorithms for the generation of surrogate data out of spike trains and more generally out of any sequence of discrete events. The purpose of the package is to provide a unified and portable toolbox to carry out surrogate generation on point-process data. Code is provided in three languages, namely, C++, Matlab, and Python, thus allowing straightforward integration of package functions into most analysis pipelines.
Generalized synchronization, in which a nontrivial interdependence is established between the trajectories of two or more coupled units, has been observed in a wide range of simulated and physical systems. Although several numerical methods are available for its detection, visualization techniques have not been reported, and bidirectional coupling remains challenging, especially for experimental data. This paper introduces a simple empirical method for approximating the functional relation, based on expressing the current value of one system variable as a function of the state variable of the other system, reconstructed by time-delay embedding, along with suitable nonlinearities. Two strongly parametrically mismatched Rössler systems with weak bidirectional coupling have been considered. The proposed method allows the computation of a time series, namely, a “proxy signal,” which shows significantly stronger phase synchronization compared to the original system variables. The underlying approximated functional is visualized through regression coefficients, and its relationship with the Lyapunov exponents is demonstrated by simulated parameter sweeps in two dimensions. The results are validated via tunable analog electronic realization of the coupled systems. The effects of nonidealities in the physical apparatus are also investigated, demonstrating the robustness of the proposed method.