This article presents an approach to stochastic analysis of disease dynamics. We develop an explicit semi-Markovian model that accounts for spatial dependence, operating in discrete time over a finite state space. The model allowed us to have a propagation model conditioned by neighboring states and quantifies two key characteristics : spatial propagation timescales and propagation law in a region dependent on neighboring states. The model is inferred from data collected on the spread of Covid’19 in Madagascar’s 22 regions, using the Bayesian approach to get a better idea of model parameter values. The result has demonstrated the effect of neighborhoods on the propagation dynamics of diseases. We conclude with a discussion of potential future theoretical developments.
This article presents a Markov chain variant that explicitly incorporates spatial effects. It is an extension of the Markovian class allowing a more complete analysis of the spatial dimensions of transitional dynamics. The aim is to have an explicit model that allows analysis of spatial dimensions. Here, the question is to study and quantify whether neighborhood context affects transitional dynamics. Rather than estimating a homogeneous law, the model requires the estimation of k transition laws, each dependent on spatial neighbor state. Consequently, this article used published data on confirmed cases of COVID19 in the 22 regions of Madagascar. These data were discretized to obtain a discrete state of propagation intensity. The analysis gave us the transition probabilities between Covid19 intensity states knowing the context of neighboring regions, and the propagation time laws knowing the spatial contexts. The results showed that neighboring regions had an effect on the propagation of Covid19 in Madagascar. After analysis, we can say that there is spatial dependency according to these spatial transition matrices.
Trajectory-level data is widely considered indispensable for recovering global dynamical quantities in stochastic control and reinforcement learning. This paper challenges that assumption by asking: are trajectories fundamentally necessary? We study controlled absorbing Markov processes under an extreme observational regime where each trajectory is reduced to a single transition, revealing only an initial state and its immediate successor, with no temporal links connecting observations. Despite this severe information constraint, we prove that the expected hitting time a central quantity in stochastic shortest-path problems remains identifiable at the population level from aggregated one-step observations under suitable coverage and persistence conditions. Our main contribution is a unified theoretical framework establishing four interlocking results: (i) identifiability of expected hitting times from first-order statistics alone; (ii) Lipschitz stability with explicit constants depending only on estimable quantities; (iii) structural bounds revealing how persistence and drift jointly control global dynamics; and (iv) a concentration phenomenon showing that hitting times are dominated by high-persistence states, uncovering a persistence bottleneck structure. The framework naturally extends to absorption probabilities and discounted value functions, suggesting a broader class of trajectory-free identifiable quantities.These results demonstrate that certain global dynamical quantities remain recoverable under substantially weaker temporal information than traditionally assumed, with implications for stochastic shortest-path problems, model-based reinforcement learning, and learning under severe observational constraints.
This article presents a Markov chain variant that explicitly incorporates spatial effects. It is an extension of the Markovian class allowing a more complete analysis of the spatial dimensions of transitional dynamics. The aim is to have an explicit model that allows analysis of spatial dimensions. Here, the question is to study and quantify whether neighborhood context affects transitional dynamics. Rather than estimating a homogeneous law, the model requires the estimation of k transition laws, each dependent on spatial neighbor state. Consequently, this article used published data on confirmed cases of COVID19 in the 22 regions of Madagascar. These data were discretized to obtain a discrete state of propagation intensity. The analysis gave us the transition probabilities between Covid19 intensity states knowing the context of neighboring regions, and the propagation time laws knowing the spatial contexts. The results showed that neighboring regions had an effect on the propagation of Covid19 in Madagascar.