Hazem Toutounji

Dr. Hazem Toutounji

School of Psychology, University of Nottingham, Nottingham NG7 2RD, UK
orcid

Research Focus & Metrics

Academic Career Length

8Years (2019-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
21 August 2019 in PLOS Computational Biology
Verified
Journal Article
Open access
PDF file
GKGeorgia Koppe
Georgia Koppe
HTHazem Toutounji
Hazem Toutounji
PKPeter Kirsch
Peter Kirsch
SLStefanie Lis
Stefanie Lis
DDDaniel Durstewitz
Daniel Durstewitz
A major tenet in theoretical neuroscience is that cognitive and behavioral processes are ultimately implemented in terms of the neural system dynamics. Accordingly, a major aim for the analysis of neurophysiological measurements should lie in the identification of the computational dynamics underlying task processing. Here we advance a state space model (SSM) based on generative piecewise-linear recurrent neural networks (PLRNN) to assess dynamics from neuroimaging data. In contrast to many other nonlinear time series models which have been proposed for reconstructing latent dynamics, our model is easily interpretable in neural terms, amenable to systematic dynamical systems analysis of the resulting set of equations, and can straightforwardly be transformed into an equivalent continuous-time dynamical system. The major contributions of this paper are the introduction of a new observation model suitable for functional magnetic resonance imaging (fMRI) coupled to the latent PLRNN, an efficient stepwise training procedure that forces the latent model to capture the ‘true’ underlying dynamics rather than just fitting (or predicting) the observations, and of an empirical measure based on the Kullback-Leibler divergence to evaluate from empirical time series how well this goal of approximating the underlying dynamics has been achieved. We validate and illustrate the power of our approach on simulated ‘ground-truth’ dynamical systems as well as on experimental fMRI time series, and demonstrate that the learnt dynamics harbors task-related nonlinear structure that a linear dynamical model fails to capture. Given that fMRI is one of the most common techniques for measuring brain activity non-invasively in human subjects, this approach may provide a novel step toward analyzing aberrant (nonlinear) dynamics for clinical assessment or neuroscientific research. Computational processes in the brain are often assumed to be implemented in terms of nonlinear neural network dynamics. However, experimentally we usually do not have direct access to this underlying dynamical process that generated the observed time series, but have to infer it from a sample of noisy and mixed measurements like fMRI data. Here we combine a dynamically universal recurrent neural network (RNN) model for approximating the unknown system dynamics with an observation model that links this dynamics to experimental measurements, taking fMRI data as an example. We develop a new stepwise optimization algorithm, within the statistical framework of state space models, that forces the latent RNN model toward the true data-generating dynamical process, and demonstrate its power on benchmark systems like the chaotic Lorenz attractor. We also introduce a novel, fast-to-compute measure for assessing how well this worked out in any empirical situation for which the ground truth dynamical system is not known. RNN models trained on human fMRI data this way can generate new data with the same temporal structure and properties, and exhibit interesting nonlinear dynamical phenomena related to experimental task conditions and behavioral performance. This approach can easily be generalized to many other recording modalities.

2 February 2021 in Journal of Neuroscience
Verified
Journal Article
Open access
PDF file
EREleonora Russo
Eleonora Russo
TMTianyang Ma
Tianyang Ma
Rainer SpanagelRainer Spanagel
Rainer Spanagel
DDDaniel Durstewitz
Daniel Durstewitz
HTHazem Toutounji
Hazem Toutounji
GKGeorg Köhr
Georg Köhr
Extinction learning suppresses conditioned reward responses and is thus fundamental to adapt to changing environmental demands and to control excessive reward seeking. The medial prefrontal cortex (mPFC) monitors and controls conditioned reward responses. Abrupt transitions in mPFC activity anticipate changes in conditioned responses to altered contingencies. It remains, however, unknown whether such transitions are driven by the extinction of old behavioral strategies or by the acquisition of new competing ones. Usingin vivomultiple single-unit recordings of mPFC in male rats, we studied the relationship between single-unit and population dynamics during extinction learning, using alcohol as a positive reinforcer in an operant conditioning paradigm. To examine the fine temporal relation between neural activity and behavior, we developed a novel behavioral model that allowed us to identify the number, onset, and duration of extinction-learning episodes in the behavior of each animal. We found that single-unit responses to conditioned stimuli changed even under stable experimental conditions and behavior. However, when behavioral responses to task contingencies had to be updated, unit-specific modulations became coordinated across the whole population, pushing the network into a new stable attractor state. Thus, extinction learning is not associated with suppressed mPFC responses to conditioned stimuli, but is anticipated by single-unit coordination into population-wide transitions of the internal state of the animal.SIGNIFICANCE STATEMENTThe ability to suppress conditioned behaviors when no longer beneficial is fundamental for the survival of any organism. While pharmacological and optogenetic interventions have shown a critical involvement of the mPFC in the suppression of conditioned responses, the neural dynamics underlying such a process are still largely unknown. Combining novel analysis tools to describe behavior, single-neuron response, and population activity, we found that widespread changes in neuronal firing temporally coordinate across the whole mPFC population in anticipation of behavioral extinction. This coordination leads to a global transition in the internal state of the network, driving extinction of conditioned behavior.

25 June 2025 in Nature Communications
Verified
Journal Article
Open access
PDF file
FBFlorian Bähner
Florian Bähner
TPTzvetan Popov
Tzvetan Popov
NBNico Boehme
Nico Boehme
SHSelina Hermann
Selina Hermann
TMTom Merten
Tom Merten
DDDaniel Durstewitz
Daniel Durstewitz
Rapid learning in complex and changing environments is a hallmark of intelligent behavior. Humans achieve this in part through abstract concepts applicable to multiple, related situations. It is unclear, however, whether the computational mechanisms underlying rapid learning are unique to humans or also exist in other species. We combined behavioral, computational and electrophysiological analyses of a multidimensional rule-learning paradigm in male rats and in humans. We report that both species infer task rules by sequentially testing different hypotheses, rather than learning the correct action for all possible cue combinations. Neural substrates of hypothetical rules were detected in prefrontal network activity of both species. This species-conserved mechanism reduces task dimensionality and explains key experimental observations: sudden behavioral transitions and facilitated learning after prior experience. Our findings help to narrow the explanatory gap between human macroscopic and rodent microcircuit levels and provide a foundation for the translational investigation of impaired cognitive flexibility.

29 March 2024 in Science Advances
Verified
Journal Article
Open access
HTHazem Toutounji
Hazem Toutounji
AZAnja Tamara Zai
Anja Tamara Zai
OTOfer Tchernichovski
Ofer Tchernichovski
RHRichard H.R. Hahnloser
Richard H.R. Hahnloser
DLDina Lipkind
Dina Lipkind
Reinforcement learning (RL) is thought to underlie the acquisition of vocal skills like birdsong and speech, where sounding like one’s “tutor” is rewarding. However, what RL strategy generates the rich sound inventories for song or speech? We find that the standard actor-critic model of birdsong learning fails to explain juvenile zebra finches’ efficient learning of multiple syllables. However, when we replace a single actor with multiple independent actors that jointly maximize a common intrinsic reward, then birds’ empirical learning trajectories are accurately reproduced. The influence of each actor (syllable) on the magnitude of global reward is competitively determined by its acoustic similarity to target syllables. This leads to each actor matching the target it is closest to and, occasionally, to the competitive exclusion of an actor from the learning process (i.e., the learned song). We propose that a competitive-cooperative multi-actor RL (MARL) algorithm is key for the efficient learning of the action inventory of a complex skill.

1 July 2024 in Journal of Experimental Psychology: Animal Learning and Cognition
Verified
Journal Article
Open access
GUGonzalo P. Urcelay
Gonzalo P. Urcelay
KSKadell Symmons
Kadell Symmons
BABethany Amos
Bethany Amos
HTHazem Toutounji
Hazem Toutounji
APArthur Prével
Arthur Prével
The ABA renewal effect occurs when behavior is trained in one context (A), extinguished in a second context (B), and the test occurs in the training context (A). Two mechanisms that explain ABA renewal are context summation at the test and contextual modulation of extinction learning, with the former being unlikely if both contexts have a similar associative history. In two experiments, we used within-subjects designs in which participants learned to avoid a loud noise (unconditioned stimulus) signaled by discrete visual stimuli (conditioned stimuli [CSs]), by pressing the space bar on the computer keyboard. The training was conducted in two contexts, with a different pair of CSs (CS+ and CS-) trained in each context. During extinction, CS+ and CS- stimuli were presented in the alternative context from that of training, and participants were allowed to freely respond, but no loud noise was presented. Finally, all CSs were tested in both contexts, resulting in a within-subjects ABA versus ABB comparison. Across experiments, participants increased avoidance responses during training and decreased them during extinction, although Experiment 2 revealed less extinction. During the test, responding was higher when CS+ were tested in the training context (ABA) versus the extinction context (ABB), revealing the renewal of instrumental avoidance. Experiment 2 also measured expectancy after the avoidance test and revealed a remarkable similarity between avoidance responses and expectancy ratings. This study shows the renewal of instrumental avoidance in humans, and the results suggest the operation of a modulatory role for the context in renewal, similar to the occasion setting of extinction learning by the context. (PsycInfo Database Record (c) 2024 APA, all rights reserved).

28 August 2019 in PsyArXiv
Verified
Preprint
Open access
GUGonzalo Pablo Urcelay
Gonzalo Pablo Urcelay
KSKadell Symmons
Kadell Symmons
BABethany Amos
Bethany Amos
HTHazem Toutounji
Hazem Toutounji
APArthur Prével
Arthur Prével
The renewal effect, which occurs when extinguished behaviour is tested outside of the extinction context, has been proposed as a model of contextual control that has relevance for the understanding of relapse following exposure therapy. Notably, there are multiple mechanisms by which the renewal effect can be explained. In two experiments, we used within-subjects designs in which participants learned to avoid a loud noise signalled by two discrete visual stimuli (CSs+), by pressing the space bar on the computer keyboard. Each CS+ was trained along with a CS- in a different context. During extinction, CS+ and CS- stimuli were presented in the alternative context from that of training, and participants were allowed to freely respond, but no loud noise was presented. Finally, all CSs were tested in both contexts, resulting in a within-subjects ABA vs ABB comparison. In both experiments, participants increased avoidance responses during training, and decreased responding during extinction, although Experiment 2 revealed less extinction. During test, responding was higher when CS+ stimuli were tested in the training (ABA) vs the extinction context (ABB), thus showing renewal of instrumental avoidance in humans. Additional analyses in Experiment 2 showed a remarkable similarity between avoidance responses and expectancy ratings. This study shows renewal of instrumental avoidance in humans, and the results suggest the operation of a modulatory role for the context in renewal, similar to occasion setting of extinction learning by the context.