1 October 2011 in Human Movement Science
4 May 2020 in IEEE Transactions on Cognitive and Developmental Systems
Many of our sequential activities require that behaviors must be both precisely timed and put in the proper order. This paper presents a neuro-computational model based on the theoretical framework of Dynamic Neural Fields that supports the rapid learning and flexible adaptation of coupled order-timing representations of sequential events. A key assumption is that elapsed time is encoded in the monotonic buildup of self-stabilized neural population activity representing event memory. A stable activation gradient over subpopulations carries the information of an entire sequence. With robotics applications in mind, we test the model in simulations of a learning by observation paradigm, in which the cognitive agent first memorizes the order and relative timing of observed events and, subsequently, recalls the information from memory taking potential speed constraints into account. Model robustness is tested by systematically varying sequence complexity along the temporal and the ordinal dimension. Furthermore, an adaptation rule is proposed that allows the agent to adjust in a single trial a learned timing pattern to a changing temporal context. The simulation results are discussed with respect to our goal to endow autonomous robots with the capacity to efficiently learn complex sequences with time constraints, supporting more natural human-robot interactions.
10 October 2016 in Adaptive Behavior
We report on our approach towards creating socially intelligent robots, which is heavily inspired by recent experimental findings about the neurocognitive mechanisms underlying action and emotion understanding in humans. Our approach uses neuro-dynamics as a theoretical language to model cognition, emotional states, decision making and action. The control architecture is formalized by a coupled system of dynamic neural fields representing a distributed network of local but connected neural populations. Different pools of neurons encode relevant information in the form of self-sustained activation patterns, which are triggered by input from connected populations and evolve continuously in time. The architecture implements a dynamic and flexible context-dependent mapping from observed hand and facial actions of the human onto adequate complementary behaviors of the robot that take into account the inferred goal and inferred emotional state of the co-actor. The dynamic control architecture was validated in multiple scenarios in which an anthropomorphic robot and a human operator assemble a toy object from its components. The scenarios focus on the robot’s capacity to understand the human’s actions, and emotional states, detect errors and adapt its behavior accordingly by adjusting its decisions and movements during the execution of the task.