6 December 2021 in Human Brain Mapping
Dynamic functional connectivity (dFC) has been increasingly used to characterize the brain transient temporal functional patterns and their alterations in diseased brains. Meanwhile, naturalistic neuroimaging paradigms have been an emerging approach for cognitive neuroscience with high ecological validity. However, the test–retest reliability of dFC in naturalistic paradigm neuroimaging is largely unknown. To address this issue, we examined the test–retest reliability of dFC in functional magnetic resonance imaging (fMRI) under natural viewing condition. The intraclass correlation coefficients (ICC) of four dFC statistics including standard deviation (Std), coefficient of variation (COV), amplitude of low frequency fluctuation (ALFF), and excursion (Excursion) were used to measure the test–retest reliability. The test–retest reliability of dFC in naturalistic viewing condition was then compared with that under resting state. Our experimental results showed that: (a) Global test–retest reliability of dFC was much lower than that of static functional connectivity (sFC) in both resting‐state and naturalistic viewing conditions; (b) Both global and local (including visual, limbic and default mode networks) test–retest reliability of dFC could be significantly improved in naturalistic viewing condition compared to that in resting state; (c) There existed strong negative correlation between sFC and dFC, weak negative correlation between dFC and dFC‐ICC (i.e., ICC of dFC), as well as weak positive correlation between dFC‐ICC and sFC‐ICC (i.e., ICC of sFC). The present study provides novel evidence for the promotion of naturalistic paradigm fMRI in functional brain network studies.
6 December 2023 in IEEE Transactions on Biomedical Engineering
Objective: Electroencephalography (EEG) is among the most widely used and inexpensive neuroimaging techniques. Compared to the CNN or RNN based models, Transformer can better capture the temporal information in EEG signals and focus more on global features of the brain's functional activities. Importantly, according to the multiscale nature of EEG signals, it is crucial to consider the multi-band concept into the design of EEG Transformer architecture. Methods: We propose a novel M ulti-band EE G T ransformer (MEET) to represent and analyze the multiscale temporal time series of human brain EEG signals. MEET mainly includes three parts: 1) transform the EEG signals into multi-band images, and preserve the 3D spatial information between electrodes; 2) design a Band Attention Block to compute the attention maps of the stacked multi-band images and infer the fused feature maps; 3) apply the Temporal Self-Attention and Spatial Self-Attention modules to extract the spatiotemporal features for the characterization and differentiation of multi-frame dynamic brain states. Results: The experimental results show that: 1) MEET outperforms state-of-the-art methods on multiple open EEG datasets (SEED, SEED-IV, WM) for brain states classification; 2) MEET demonstrates that 5-bands fusion is the best integration strategy; and 3) MEET identifies interpretable brain attention regions. Significance: MEET is an interpretable and universal model based on the multiband-multiscale characteristics of EEG. Conclusion: The innovative combination of band attention and temporal/spatial self-attention mechanisms in MEET achieves promising data-driven learning of the temporal dependencies and spatial relationships of EEG signals across the entire brain in a holistic and comprehensive fashion.
1 March 2026 in IEEE Transactions on Biomedical Engineering
Achieving clinical level performance and widespread deployment for generating radiology impressions encounters a giant challenge for conventional artificial intelligence models tailored to specific diseases and organs. Concurrent with the increasing accessibility of radiology reports and advancements in modern general AI techniques, the emergence and potential of deployable radiology AI exploration have been bolstered. Here, we present ChatRadio-Valuer, the first general radiology diagnosis large language model for localized deployment within hospitals and being close to clinical use for multi-institution and multi-system diseases. ChatRadio-Valuer achieved 15 state-of-the-art results across five human systems and six institutions in clinical-level events (n = 332,673) through rigorous and full-spectrum assessment, including engineering metrics, clinical validation, and efficiency evaluation. Notably, it exceeded OpenAI's GPT-3.5 and GPT-4 models, achieving superior performance in comprehensive disease diagnosis compared to the average level of radiology experts. Besides, ChatRadio-Valuer supports zero-shot transfer learning, greatly boosting its effectiveness as a radiology assistant, while ensuring adherence to privacy standards and being readily utilized for large-scale patient populations. Our expeditions suggest the development of localized LLMs would become an imperative avenue in hospital applications.
8 August 2023 in NeuroImage
Emotional arousal is a complex state recruiting distributed cortical and subcortical structures, in which the amygdala and insula play an important role. Although previous neuroimaging studies have showed that the amygdala and insula manifest reciprocal connectivity, the effective connectivities and modulatory patterns on the amygdala-insula interactions underpinning arousal are still largely unknown. One of the reasons may be attributed to static and discrete laboratory brain imaging paradigms used in most existing studies. In this study, by integrating naturalistic-paradigm (i.e., movie watching) functional magnetic resonance imaging (fMRI) with a computational affective model that predicts dynamic arousal for the movie stimuli, we investigated the effective amygdala-insula interactions and the modulatory effect of the input arousal on the effective connections. Specifically, the predicted dynamic arousal of the movie served as regressors in general linear model (GLM) analysis and brain activations were identified accordingly. The regions of interest (i.e., the bilateral amygdala and insula) were localized according to the GLM activation map. The effective connectivity and modulatory effect were then inferred by using dynamic causal modeling (DCM). Our experimental results demonstrated that amygdala was the site of driving arousal input and arousal had a modulatory effect on the reciprocal connections between amygdala and insula. Our study provides novel evidence to the underlying neural mechanisms of arousal in a dynamical naturalistic setting.
13 July 2023 in Medical Image Analysis