Coordinating with others is part of our everyday experience. Previous studies using sensorimotor coordination games suggest that human dyads develop coordination strategies that can be interpreted as Nash equilibria. However, if the players are uncertain about what their partner is doing, they develop coordination strategies which are robust to the actual partner’s actions. This has suggested that humans select their actions based on an explicit prediction of what the partner will be doing—a partner model—which is probabilistic by nature. However, the mechanisms underlying the development of a joint coordination over repeated trials remain unknown. Very much like sensorimotor adaptation of individuals to external perturbations (eg force fields or visual rotations), dynamical models may help to understand how joint coordination develops over repeated trials. Here we present a general computational model—based on game theory and Bayesian estimation—designed to understand the mechanisms underlying the development of a joint coordination over repeated trials. Joint tasks are modeled as quadratic games, where each participant’s task is expressed as a quadratic cost function. Each participant predicts their partner’s next move (partner model) by optimally combining predictions and sensory observations, and selects their actions through a stochastic optimization of its expected cost, given the partner model. The model parameters include perceptual uncertainty (sensory noise), partner representation (retention rate and internale noise), uncertainty in action selection and its rate of decay (which can be interpreted as the action’s learning rate). The model can be used in two ways: (i) to simulate interactive behaviors, thus helping to make specific predictions in the context of a given joint action scenario; and (ii) to analyze the action time series in actual experiments, thus providing quantitative metrics that describe individual behaviors during an actual joint action. We demonstrate the model in a variety of joint action scenarios. In a sensorimotor version of the Stag Hunt game, the model predicts that different representations of the partner lead to different Nash equilibria. In a joint two via-point (2-VP) reaching task, in which the actions consist of complex trajectories, the model captures well the observed temporal evolution of performance. For this task we also estimated the model parameters from experimental observations, which provided a comprehensive characterization of individual dyad participants. Computational models of joint action may help identifying the factors preventing or facilitating the development of coordination. They can be used in clinical settings, to interpret the observed behaviors in individuals with impaired interaction capabilities. They may also provide a theoretical basis to devise artificial agents that establish forms of coordination that facilitate neuromotor recovery.
11 May 2022 in Phenomenology and the Cognitive Sciences
The sense of agency – the subjective feeling of being in control of our own actions – is one central aspect of the phenomenology of action. Computational models provided important contributions toward unveiling the mechanisms underlying the sense of agency in individual action. In particular, the sense of agency is believed to be related to the match between the actual and predicted consequences of our own actions (comparator model). In the study of joint action, models are even more necessary to understand the mechanisms underlying the development of coordination strategies and how the subjective experiences of control emerge during the interaction. In a joint action, we not only need to predict the consequences of our own actions; we also need to predict the actions and intentions of our partner, and to integrate these predictions to infer their joint consequences. Understanding our partner and developing mutually satisfactory coordination strategies are key components of joint action and in the development of the sense of joint agency. Here we discuss a computational architecture which addresses the sense of agency during intentional, real-time joint action. We first reformulate previous accounts of the sense of agency in probabilistic terms, as the combination of prior beliefs about the action goals and constraints, and the likelihood of the predicted movement outcomes. To look at the sense of joint agency, we extend classical computational motor control concepts - optimal estimation and optimal control. Regarding estimation, we argue that in joint action the players not only need to predict the consequences of their own actions, but also need to predict partner’s actions and intentions (a ‘partner model’) and to integrate these predictions to infer their joint consequences. As regards action selection, we use differential game theory – in which actions develop in continuous space and time - to formulate the problem of establishing a stable form of coordination and as a natural extension of optimal control to joint action. The resulting model posits two concurrent observer-controller loops, accounting for ‘joint’ and ‘self’ action control. The two observers quantify the likelihoods of being in control alone or jointly. Combined with prior beliefs, they provide weighing signals which are used to modulate the ‘joint’ and ‘self’ motor commands. We argue that these signals can be interpreted as the subjective sense of joint and self agency. We demonstrate the model predictions by simulating a sensorimotor interactive task where two players are mechanically coupled and are instructed to perform planar movements to reach a shared final target by crossing two differently located intermediate targets. In particular, we explore the relation between self and joint agency and the information available to each player about their partner. The proposed model provides a coherent picture of the inter-relation of prediction, control, and the sense of agency in a broader range of joint actions.
18 May 2022 in IEEE Transactions on Neural Systems and Rehabilitation Engineering
In the last years, artificial partners have been proposed as tools to study joint action, as they would allow to address joint behaviors in more controlled experimental conditions. Here we present an artificial partner architecture which is capable of integrating all the available information about its human counterpart and to develop efficient and natural forms of coordination. The model uses an extended state observer which combines prior information, motor commands and sensory observations to infer the partner’s ongoing actions (partner model). Over trials, these estimates are gradually incorporated into action selection. Using a joint planar task in which the partners are required to perform reaching movements while mechanically coupled, we demonstrate that the artificial partner develops an internal representation of its human counterpart, whose accuracy depends on the degree of mechanical coupling and on the reliability of the sensory information. We also show that human-artificial dyads develop coordination strategies which closely resemble those observed in human-human dyads and can be interpreted as Nash equilibria. The proposed approach may provide insights for the understanding of the mechanisms underlying human-human interaction. Further, it may inform the development of novel neuro-rehabilitative solutions and more efficient human-machine interfaces.
Coordinating with others is part of our everyday experience. Previous studies using sensorimotor coordination games suggest that human dyads develop coordination strategies that can be interpreted as Nash equilibria. However, if the players are uncertain about what their partner is doing, they develop coordination strategies which are robust to the actual partner’s actions. This has suggested that humans select their actions based on an explicit prediction of what the partner will be doing – a partner model – which is probabilistic by nature. However, the mechanisms underlying the development of a joint coordination over repeated trials remain unknown. Very much like sensorimotor adaptation of individuals to external perturbations (eg force fields or visual rotations), dynamical models may help to understand how joint coordination develops over repeated trials. Here we present a general computational model – based on game theory and Bayesian estimation – designed to understand the mechanisms underlying the development of a joint coordination over repeated trials. Joint tasks are modeled as quadratic games, where each participant’s task is expressed as a quadratic cost function. Each participant predicts their partner’s next move (partner model) by optimally combining predictions and sensory observations, and selects their actions through a stochastic optimization of its expected cost, given the partner model. The model parameters include perceptual uncertainty (sensory noise), partner representation (retention rate and process noise), uncertainty in action selection and its rate of decay (which can be interpreted as the action’s learning rate). The model can be used in two ways: (i) to simulate interactive behaviors, thus helping to make specific predictions in the context of a given joint action scenario; and (ii) to analyze the action time series in actual experiments, thus providing quantitative metrics that describe individual behaviors during an actual joint action. We demonstrate the model in a variety of joint action scenarios. In a sensorimotor version of the Stag Hunt game, the model predicts that different representations of the partner lead to different Nash equilibria. In a joint two via-point (2-VP) reaching task, in which the actions consist of complex trajectories, the model captures well the observed temporal evolution of performance. For this task we also estimated the model parameters from experimental observations, which provided a comprehensive characterization of individual dyad participants. Computational models of joint action may help identifying the factors preventing or facilitating the development of coordination. They can be used in clinical settings, to interpret the observed behaviors in individuals with impaired interaction capabilities. They may also provide a theoretical basis to devise artificial agents that establish forms of coordination that facilitate neuromotor recovery. Author summary Acting together (joint action) is part of everyday experience. But, how do we learn to coordinate with others and collaborate? Using a combination of experiments and computational models we show that through multiple repetitions of the same joint task we select the action which represents the ‘best response’ to what we believe our opponent will do. Such a belief about our partner (partner model) is developed gradually, by optimally combining prior assumptions (how repeatable or how erratic our opponent behaves) with sensory information about our opponent’s past actions. Rooted in game theory and Bayesian estimation, the model accounts for the development of the mutual ‘trust’ among partners which is essential for establishing a mutually advantageous collaboration, and explains how we combine decisions and movements in complex coordination scenarios. The model can be used as a generative tool, to simulate the development of coordination in a specific joint action scenario, and as an analytic tool to characterize the individual traits or defects in the ability to establish collaborations.
Objective. In this study, we present a novel computational framework that combines the Hindmarsh–Rose (HR) neuronal model with evolutionary game theory on networks to simulate and interpret synaptic-level interactions within neuronal populations. Our approach preserves the features of the HR model—capable of generating both spiking and bursting dynamics—while integrating game-theoretic principles that govern the balance between emulative and non-emulative behaviors across neurons. Approach. Neurons were modeled as strategic agents whose interactions evolve according to game-theoretic principles, allowing us to capture emergent network dynamics beyond classical electrophysiological analyses. A key innovation of our work is the formulation of a parameter estimation method based on adaptive observers, which enables the recovery of game-theoretic parameters solely from partial state observations. The proposed framework is validated through numerical simulations, demonstrating its ability to recover hidden parameters and accurately predict system behavior under diverse conditions. Main results. By applying the devised approach to synthetic datasets mimicking real electrophysiological recordings, we highlight its applicability in distinguishing neuronal populations based on their strategic interactions. In this context, the model is shown to faithfully reproduce both spiking and bursting behaviors, capturing the diverse electrophysiological patterns observed in in vitro experimental settings. Furthermore, we explore the potential of this model in experimental data analysis by suggesting that the estimated parameters may serve as discriminative markers for different neuronal types and structural characteristics. Significance. The integration of dynamical systems theory, game-theoretic modeling, and adaptive estimation provides a robust quantitative tool for investigating complex neuronal network dynamics. Our results quantitatively demonstrate the scalability and accuracy of the method in parameter estimation, reinforcing its value for systematic analysis of synaptic interactions and advancing our understanding of neuronal network dynamics.
5 March 2026 in IEEE Transactions on Neural Systems and Rehabilitation Engineering
Haptic coupling is integral to everyday life, enabling humans to collaborate on tasks without the need for verbal agreement of every detail. However, collaborative partners often have differing plans and use haptic coupling to negotiate a common strategy. While previous studies have focused on tasks where partners share the same plan, little is known about haptic negotiation when plans diverge. This study investigates how the motion plans of two mechanically connected partners evolve during repeating a via-points arm-reaching task when they start from differing initial plans. In one group, partners had plans requiring similar effort, while in another group, plans were unbalanced, requiring different levels of effort. The analysis of shape and movement metrics shows that all dyads coordinated their plans through practice, influencing subsequent movements even when disconnected. For symmetric plans, partners exhibited slight mutual adaptation toward each other. In contrast, for asymmetric plans, the partner with the simpler plan tended to lead the movement, while the partner with the more complex plan complied and relaxed their plan. These findings suggest that, during collaboration, partners leverage mechanical interaction to simplify tasks and minimize effort.