Colonoscopy is considered the best diagnostic tool for early detection and resection of polyps, which can effectively prevent consequential colorectal cancer. In clinical practice, segmenting and classifying polyps from colonoscopic images have a great significance since they provide precious information for diagnosis and treatment. In this study, we propose an efficient multi-task synergetic network (EMTS-Net) for concurrent polyp segmentation and classification, and we introduce a polyp classification benchmark for exploring the potential correlations of the above-mentioned two tasks. This framework is composed of an enhanced multi-scale network (EMS-Net) for coarse-grained polyp segmentation, an EMTS-Net (Class) for accurate polyp classification, and an EMTS-Net (Seg) for fine-grained polyp segmentation. Specifically, we first obtain coarse segmentation masks by using EMS-Net. Then, we concatenate these rough masks with colonoscopic images to assist EMTS-Net (Class) in locating and classifying polyps precisely. To further enhance the segmentation performance of polyps, we propose a random multi-scale (RMS) training strategy to eliminate the interference caused by redundant information. In addition, we design an offline dynamic class activation mapping (OFLD CAM) generated by the combined effect of EMTS-Net (Class) and RMS strategy, which optimizes bottlenecks between multi-task networks efficiently and elegantly and helps EMTS-Net (Seg) to perform more accurate polyp segmentation. We evaluate the proposed EMTS-Net on the polyp segmentation and classification benchmarks, and it achieves an average mDice of 0.864 in polyp segmentation and an average AUC of 0.913 with an average accuracy of 0.924 in polyp classification. Quantitative and qualitative evaluations on the polyp segmentation and classification benchmarks demonstrate that our EMTS-Net achieves the best performance and outperforms previous state-of-the-art methods in terms of both efficiency and generalization.

Objective: Serum hormone deficiencies during menopause transition may affect spontaneous brain activity and global cognition. The purpose of this study was to explore the differences in spontaneous brain activity between premenopausal and perimenopausal women, and to investigate the associations between spontaneous brain activity, serum hormone levels and global cognition. Methods: Thirty-two premenopausal women (47.75 ± 1.55 years) and twenty-five perimenopausal women (51.60 ± 1.63 years) underwent resting-state functional MRI (fMRI) scan. Clinical information including Mini-Mental State Examination (MMSE), levels of estradiol (E2), free testosterone, progesterone, prolactin, follicle-stimulating hormone and luteinizing hormone were measured. Regional homogeneity (ReHo) was used to evaluate spontaneous brain activity alterations between perimenopausal and premenopausal women. Correlation analysis was used to investigate the associations between brain functional alterations and clinical measures in perimenopausal group. Results: The results demonstrated increased ReHo value in the right lingual gyrus (LG) and decreased ReHo value in the right superior frontal gyrus (SFG) in perimenopausal women compared with premenopausal women. In perimenopausal group, ReHo of the right LG showed a negative correlation with level of E2 (r = -0.586, p = 0.002), ReHo of the right SFG showed a positive correlation with level of E2 (r = 0.470, p = 0.018) and MMSE (r = 0.614, p = 0.001). Conclusions: The results demonstrated that women approaching menopause suffered from altered functions in brain regions related to cognitive function, working memory, the results also revealed a direct association between levels of E2 and brain functions in perimenopausal women.

Silent speech recognition breaks the limitations of automatic speech recognition when acoustic signals cannot be produced or captured clearly, but still has a long way to go before being ready for any real-life applications. To address this issue, we propose a novel silent speech recognition framework based on surface electromyography (sEMG) signals. In our approach, a new deep learning architecture Parallel Inception Convolutional Neural Network (PICNN) is proposed and implemented in our silent speech recognition system, with six inception modules processing six channels of sEMG data, separately and simultaneously. Meanwhile, Mel Frequency Spectral Coefficients (MFSCs) are employed to extract speech-related sEMG features for the first time. We further design and generate a 100-class dataset containing daily life assistance demands for the elderly and disabled individuals. The experimental results obtained from 28 subjects confirm that our silent speech recognition method outperforms state-of-the-art machine learning algorithms and deep learning architectures, achieving the best recognition accuracy of 90.76%. With sEMG data collected from four new subjects, efficient steps of subject-based transfer learning are conducted to further improve the cross-subject recognition ability of the proposed model. Promising results prove that our sEMG-based silent speech recognition system could have high recognition accuracy and steady performance in practical applications.

Resting-state functional magnetic resonance imaging (rs-fMRI) has been widely used in the identification of mild cognitive impairment (MCI) research, MCI patients are relatively at a higher risk of progression to Alzheimer’s disease (AD). However, almost machine learning and deep learning methods are rarely analyzed from the perspective of spatial structure and temporal dimension. In order to make full use of rs-fMRI data, this study constructed a dynamic spatiotemporal graph neural network model, which mainly includes three modules: temporal block, spatial block, and graph pooling block. Our proposed model can extract the BOLD signal of the subject’s fMRI data and the spatial structure of functional connections between different brain regions, and improve the decision-making results of the model. In the study of AD, MCI and NC, the classification accuracy reached 83.78% outperforming previously reported, which manifested that our model could effectively learn spatiotemporal, and dynamic spatio-temporal method plays an important role in identifying different groups of subjects. In summary, this paper proposed an end-to-end dynamic spatio-temporal graph neural network model, which uses the information of the temporal dimension and spatial structure in rs-fMRI data, and achieves the improvement of the three classification performance among AD, MCI and NC.

Motor imagery (MI) is widely employed in stroke rehabilitation due to the event-related desynchronization (ERD) phenomenon in sensorimotor cortex induced by MI is similar to actual movement. However, the traditional BCI paradigm, in which the patient imagines the movement of affected hand (AH-MI) with a weak ERD caused by the damaged brain regions, retards motor relearning process. In this work, we applied a novel MI paradigm based on the “sixth-finger” (SF-MI) in stroke patients and systematically uncovered the ERD pattern enhancement of novel MI paradigm compared to traditional MI paradigm. Twenty stroke patients were recruited for this experiment. Event-related spectral perturbation was adopted to supply details about ERD. Brain activation region, intensity and functional connectivity were compared between SF-MI and AH-MI to reveal the ERD enhancement performance of novel MI paradigm. A “wider range, stronger intensity, greater connection” ERD activation pattern was induced in stroke patients by novel SF-MI paradigm compared to traditional AH-MI paradigm. The bilateral sensorimotor and prefrontal modulation was found in SF-MI, which was different in AH-MI only weak sensorimotor modulation was exhibited. The ERD enhancement is mainly concentrated in mu rhythm. More synchronized and intimate neural activity between different brain regions was found during SF-MI tasks compared to AH-MI tasks. Classification results (> 80% in SF-MI vs. REST) also indicated the feasibility of applying novel MI paradigm to clinical stroke rehabilitation. This work provides a novel MI paradigm and demonstrates its neural activation-enhancing performance, helping to develop more effective MI-based BCI system for stroke rehabilitation.