For multimodal magnetic resonance (MR) brain tumor segmentation, current methods usually directly extract the discriminative features from input images for the tumor subregion category. However, information aliasing caused by the mutual inclusion of tumor subregions is often ignored. Moreover, existing methods usually do not take tailored efforts to highlight the single tumor subregion features. To this end, a multimodal MR brain tumor segmentation method with tumor prototype-driven and multiexpert integration is proposed. It could highlight the features of each tumor subregion under the guidance of tumor prototypes. Specifically, to obtain the prototypes with complete information, we propose a mutual transmission mechanism to transfer different modal features to each other. Furthermore, we devise a prototype-driven feature representation and fusion (PFRF) method, which implants the learned prototypes into tumor features and generates corresponding activation maps. With the activation maps, the subregion features consistent with the prototype category can be highlighted. A key information enhancement and fusion strategy with multiexpert integration is designed to further improve the segmentation performance. The strategy can integrate the features from different layers of the extra feature extraction network and the features highlighted by the prototypes. Experimental results on three competition datasets prove the superiority of the proposed method. The source code can be available at https://github.com/Linzy0227/PDMINet .
Accurate prediction of solar irradiance holds significant value for renewable energy usage and power grid management. However, traditional forecasting methods often overlook the time dependence of solar irradiance sequences and the varying importance of different influencing factors. To address this issue, this study proposes a dual-path information fusion and twin attention-driven solar irradiance forecasting model. The proposed framework comprises three components: a residual attention temporal convolution block (RACB), a dual-path information fusion module (DIFM), and a twin self-attention module (TSAM). These components collectively enhance the performance of multi-step solar irradiance forecasting. First, the RACB is designed to enable the network to adaptively learn important features while suppressing irrelevant ones. Second, the DIFM is implemented to reinforce the model’s robustness against input data variations and integrate multi-scale features. Lastly, the TSAM is introduced to extract long-term temporal dependencies from the sequence and facilitate multi-step prediction. In the solar irradiance forecasting experiments, the proposed model is compared with six benchmark models across four datasets. In the one-step predictions, the average performance metrics RMSE, MAE, and MAPE of the four datasets decreased within the ranges of 0.463–2.390 /, 0.439–2.005 /, and 1.3–9.2%, respectively. Additionally, the average value across the four datasets increased by 0.008 to 0.059. The experimental results indicate that the model proposed in this study exhibits enhanced accuracy and robustness in predictive performance, making it a reliable alternative for solar irradiance forecasting.
For multi-modal magnetic resonance (MR) brain tumor image segmentation, current methods usually directly extract the discriminative features from input images for tumor sub-region category determination and localization. However, the impact of information aliasing caused by the mutual inclusion of tumor sub-regions is often ignored. Moreover, existing methods usually do not take tailored efforts to highlight the single tumor sub-region features. To this end, a multi-modal MR brain tumor segmentation method with tumor prototype-driven and multi-expert integration is proposed. It could highlight the features of each tumor sub-region under the guidance of tumor prototypes. Specifically, to obtain the prototypes with complete information, we propose a mutual transmission mechanism to transfer different modal features to each other to address the issues raised by insufficient information on single-modal features. Furthermore, we devise a prototype-driven feature representation and fusion method with the learned prototypes, which implants the prototypes into tumor features and generates corresponding activation maps. With the activation maps, the sub-region features consistent with the prototype category can be highlighted. A key information enhancement and fusion strategy with multi-expert integration is designed to further improve the segmentation performance. The strategy can integrate the features from different layers of the extra feature extraction network and the features highlighted by the prototypes. Experimental results on three competition brain tumor segmentation datasets prove the superiority of the proposed method.