Kshitij Dwivedi

Kshitij Dwivedi

Auto-generated profile, based on publicly available information

Kshitij Dwivedi

Department of Education and Psychology, Freie Universität Berlin, Berlin, Germany

Research Focus & Metrics

Academic Career Length

9Years (2018-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
13 August 2021 in PLOS Computational Biology
Verified
Journal Article
Open access
PDF file
KDKshitij Dwivedi
Kshitij Dwivedi
MBMichael F. Bonner
Michael F. Bonner
RCRadoslaw Martin Cichy
Radoslaw Martin Cichy
GRGemma Roig
Gemma Roig
The human visual cortex enables visual perception through a cascade of hierarchical computations in cortical regions with distinct functionalities. Here, we introduce an AI-driven approach to discover the functional mapping of the visual cortex. We related human brain responses to scene images measured with functional MRI (fMRI) systematically to a diverse set of deep neural networks (DNNs) optimized to perform different scene perception tasks. We found a structured mapping between DNN tasks and brain regions along the ventral and dorsal visual streams. Low-level visual tasks mapped onto early brain regions, 3-dimensional scene perception tasks mapped onto the dorsal stream, and semantic tasks mapped onto the ventral stream. This mapping was of high fidelity, with more than 60% of the explainable variance in nine key regions being explained. Together, our results provide a novel functional mapping of the human visual cortex and demonstrate the power of the computational approach.

24 February 2022 in Nature Human Behaviour
Verified
Journal Article
Open access
PDF file
MGMonika Graumann
Monika Graumann
CCCaterina Ciuffi
Caterina Ciuffi
KDKshitij Dwivedi
Kshitij Dwivedi
GRGemma Roig
Gemma Roig
RCRadoslaw M. Cichy
Radoslaw M. Cichy
To interact with objects in complex environments, we must know what they are and where they are in spite of challenging viewing conditions. Here, we investigated where, how and when representations of object location and category emerge in the human brain when objects appear on cluttered natural scene images using a combination of functional magnetic resonance imaging, electroencephalography and computational models. We found location representations to emerge along the ventral visual stream towards lateral occipital complex, mirrored by gradual emergence in deep neural networks. Time-resolved analysis suggested that computing object location representations involves recurrent processing in high-level visual cortex. Object category representations also emerged gradually along the ventral visual stream, with evidence for recurrent computations. These results resolve the spatiotemporal dynamics of the ventral visual stream that give rise to representations of where and what objects are present in a scene under challenging viewing conditions.

24 July 2024 in Nature Communications
Verified
Journal Article
Open access
PDF file
BLBenjamin Lahner
Benjamin Lahner
KDKshitij Dwivedi
Kshitij Dwivedi
PIPolina Iamshchinina
Polina Iamshchinina
MGMonika Graumann
Monika Graumann
ALAlex Lascelles
Alex Lascelles
RCRadoslaw Cichy
Radoslaw Cichy
Studying the neural basis of human dynamic visual perception requires extensive experimental data to evaluate the large swathes of functionally diverse brain neural networks driven by perceiving visual events. Here, we introduce the BOLD Moments Dataset (BMD), a repository of whole-brain fMRI responses to over 1000 short (3 s) naturalistic video clips of visual events across ten human subjects. We use the videos’ extensive metadata to show how the brain represents word- and sentence-level descriptions of visual events and identify correlates of video memorability scores extending into the parietal cortex. Furthermore, we reveal a match in hierarchical processing between cortical regions of interest and video-computable deep neural networks, and we showcase that BMD successfully captures temporal dynamics of visual events at second resolution. With its rich metadata, BMD offers new perspectives and accelerates research on the human brain basis of visual event perception.


15 February 2021 in OSF Preprints
Verified
Preprint
Open access
BHBernard Marius 'T Hart
Bernard Marius 'T Hart
TATitipat Achakulvisut
Titipat Achakulvisut
AAAthena Akrami
Athena Akrami
BABradly Alicea
Bradly Alicea
UBUlrik Beierholm
Ulrik Beierholm
BWBrad Wyble
Brad Wyble
Neuromatch Academy (https://neuromatch.io/academy) was designed as an online summer school to cover the basics of computational neuroscience in three weeks. The materials cover dominant and emerging computational neuroscience tools, how they complement one another, and specifically focus on how they can help us to better understand how the brain functions. An original component of the materials is its focus on modeling choices, i.e. how do we choose the right approach, how do we build models, and how can we evaluate models to determine if they provide real (meaningful) insight. This meta-modeling component of the instructional materials asks what questions can be answered by different techniques, and how to apply them meaningfully to get insight about brain function.

15 March 2022 in bioRxiv
Verified
Preprint
Open access
PDF file
AGAlessandro T. Gifford
Alessandro T. Gifford
KDKshitij Dwivedi
Kshitij Dwivedi
GRGemma Roig
Gemma Roig
RCRadoslaw M. Cichy
Radoslaw M. Cichy
The human brain achieves visual object recognition through multiple stages of nonlinear transformations operating at a millisecond scale. To predict and explain these rapid transformations, computational neuroscientists employ machine learning modeling techniques. However, state-of-the-art models require massive amounts of data to properly train, and to the present day there is a lack of vast brain datasets which extensively sample the temporal dynamics of visual object recognition. Here we collected a large and rich dataset of high temporal resolution EEG responses to images of objects on a natural background. This dataset includes 10 participants, each with 82,160 trials spanning 16,740 image conditions. Through computational modeling we established the quality of this dataset in five ways. First, we trained linearizing encoding models that successfully synthesized the EEG responses to arbitrary images. Second, we correctly identified the recorded EEG data image conditions in a zero-shot fashion, using EEG synthesized responses to hundreds of thousands of candidate image conditions. Third, we show that both the high number of conditions as well as the trial repetitions of the EEG dataset contribute to the trained models’ prediction accuracy. Fourth, we built encoding models whose predictions well generalize to novel participants. Fifth, we demonstrate full end-to-end training of randomly initialized DNNs that output M/EEG responses for arbitrary input images. We release this dataset as a tool to foster research in visual neuroscience and computer vision.