The explorations of brain functional connectivity (FC) network using resting-state functional magnetic resonance imaging (rs-fMRI) can provide crucial insights into discriminative analysis of neuropsychiatric disorders such as schizophrenia (SZ). Graph attention network (GAT), which could capture the local stationary on the network topology and aggregate the features of neighboring nodes, has advantages in learning the feature representation of brain regions. However, GAT only can obtain the node-level features that reflect local information, ignoring the spatial information within the connectivity-based features that proved to be important for SZ diagnosis. In addition, existing graph learning techniques usually rely on a single graph topology to represent neighborhood information, and only consider a single correlation measure for connectivity features. Comprehensive analysis of multiple graph topologies and multiple measures of FC can leverage their complementary information that may contribute to identifying patients. In this paper, we propose a multi-graph attention network (MGAT) with bilinear convolution (BC) neural network framework for SZ diagnosis and functional connectivity analysis. Besides multiple correlation measures to construct connectivity networks from different perspectives, we further propose two different graph construction methods to capture both the low- and high-level graph topologies, respectively. Especially, the MGAT module is developed to learn multiple node interaction features on each graph topology, and the BC module is utilized to learn the spatial connectivity features of the brain network for disease prediction. Importantly, the rationality and advantages of our proposed method can be validated by the experiments on SZ identification. Therefore, we speculate that this framework may also be potentially used as a diagnostic tool for other neuropsychiatric disorders.

Object detection in remote sensing images has received significant attention for a wide range of applications. However, traditional unimodal remote sensing images, whether based on visible light or infrared, have limitations that cannot be ignored. Visible light images are susceptible to ambient lighting conditions, and their detection accuracy can be greatly reduced. Infrared images often lack rich texture information, resulting in a high false-detection rate during target identification and classification. To address these challenges, we propose a novel multimodal fusion network detection model, named ACDF-YOLO, basedon the lightweight and efficient YOLOv5 structure, which aims to amalgamate synergistic data from both visible and infrared imagery, thereby enhancing the efficiency of target identification in remote sensing imagery. Firstly, a novel efficient shuffle attention module is designed to assist in extracting the features of various modalities. Secondly, deeper multimodal information fusion is achieved by introducing a new cross-modal difference module to fuse the features that have been acquired. Finally, we combine the two modules mentioned above in an effective manner to achieve ACDF. The ACDF not only enhances the characterization ability for the fused features but also further refines the capture and reinforcement of important channel features. Experimental validation was performed using several publicly available multimodal real-world and remote sensing datasets. Compared with other advanced unimodal and multimodal methods, ACDF-YOLO separately achieved a 95.87% and 78.10% mAP0.5 on the LLVIP and VEDAI datasets, demonstrating that the deep fusion of different modal information can effectively improve the accuracy of object detection.

In the past decade, deep learning methods have proven to be highly effective in the classification of hyperspectral images (HSI), consistently outperforming traditional approaches. However, the large number of spectral bands in HSI data can lead to interference during the learning process. To address this issue, dimensionality reduction techniques can be employed to minimize data redundancy and improve HSI classification performance. Hence, we have developed an efficient lightweight learning framework consisting of two main components. Firstly, we utilized band selection and principal component analysis to reduce the dimensionality of HSI data, thereby reducing redundancy while retaining essential features. Subsequently, the pre-processed data was input into a modified VGG-based learning network for HSI classification. This method incorporates an improved dynamic activation function for the multi-layer perceptron to enhance non-linearity, and reduces the number of nodes in the fully connected layers of the original VGG architecture to improve speed while maintaining accuracy. This modified network structure, referred to as lightweight-VGG (LVGG), was specifically designed for HSI classification. Comprehensive experiments conducted on three publicly available HSI datasets consistently demonstrated that the LVGG method exhibited similar or better performance compared to other typical methods in the field of HSI classification. Our approach not only addresses the challenge of interference in deep learning methods for HSI classification, but also offers a lightweight and efficient solution for achieving high classification accuracy.

It is quite challenging to establish a prompt and reliable prognosis assessment for acquired brain injury (ABI) patients with persistent severe disorders of consciousness (DOC) like unconscious comatose and unresponsive wakefulness syndrome (a.k.a., vegetative state). Recent advances in brain functional imaging and functional net-work analysis have demonstrated its potential in determining the consciousness level and prognostic outcome for ABI patients with DOC. However, the diagnostic and prognostic usefulness of the whole-brain functional connectome based on advanced machine learning techniques has not been fully evaluated. The first aim of this study is to predict the outcome of individual unconscious ABI patients during a three-month follow-up. The second aim is to conduct precise individualized differentiation among different consciousness levels for exploring the neurobiological mechanisms underlying DOC. Based on resting-state fMRI, we construct large-scale functional networks by using a weighted sparse model, which ensures sparsity and interpretability by preserving strong functional connections. The functional connection strengths are exploited as features for outcome prediction and consciousness level differentiation. We achieve significantly improved consciousness level classification (accuracy: 84.78%) and recovery outcome prediction (accuracy: 89.74%) compared to other network construction methods. More importantly, we reveal the contributive connections across the entire brain in both tasks. These connections could serve as the potential biomarkers for better understanding of consciousness and further provide new insight into the development of diagnostic, prognostic, and effective therapeutic guidelines for ABI patients with DOC.