Infrared and visible image fusion aims to generate a composite image that concurrently retains the thermal radiation information from infrared images and the fine texture details from visible images. However, existing approaches often neglect the detrimental effects of degraded visible information, leading to suboptimal fusion quality. To address the challenges posed by scene degradation, we propose a novel degradation-correctable fusion framework, MSFusion, that integrates multiple degradation-restoration tasks directly into the fusion process. Specifically, a diffusion-based model is first employed to generate high-quality pseudo-labels for degraded visible images. To effectively extract features under complex and diverse degradation conditions, we introduce a degradation removal backbone (DBPM), designed based on prior knowledge and a mixture-of-experts architecture, achieving a balance between restoration quality and computational efficiency. Furthermore, to alleviate semantic loss in extreme environments, a Semantic Deconstruction Segmentation Module (SDSM) is proposed to preserve semantic consistency during fusion. Extensive experiments on LLVIP, M3FD, and RoadScene datasets demonstrate that MSFusion achieves state-of-the-art performance under various degradation scenarios, exhibiting strong robustness to degradation and superior semantic preservation.
As a national intangible cultural heritage in China, traditional Miao batik has encountered obstacles in contemporary dissemination and design due to its reliance on manual craftsmanship and other reasons. Existing generative models are difficult to fully capture the complex semantic and stylistic attributes in Miao batik patterns, which limits their application in digital creativity. To address this issue, we construct the structured CMBP-9 dataset to facilitate semantic-aware image generation. Based on stable diffusion v1.5, Low-Rank Adaptation (LoRA) is used to effectively transfer the structure, sign, and texture features that are unique to the Miao people, and the Latent Consistency model (LCM) is integrated to improve the inference efficiency. In addition, a Style-Conditioned Linear Fusion (SCLF) strategy is proposed to dynamically adjust the fusion of LoRA and LCM outputs according to the semantic complexity of input prompts, thereby overcoming the limitation of static weighting in existing frameworks. Extensive quantitative evaluations using LPIPS, SSIM, PSNR, FID metrics, and human evaluations show that the proposed Batik-MPDM framework achieves superior performance in terms of style fidelity and generation efficiency compared to baseline methods.
Accurate building instance segmentation from high-resolution remote sensing images remains challenging due to complex urban scenes featuring occlusions, irregular building shapes, and heterogeneous textures. To address these issues, we propose a novel Multi-Scale Hybrid Dual-Attention Network (MS-HDAN), which integrates a dual-stream encoder, multi-scale feature extraction, and a hybrid attention mechanism. Specifically, the encoder is designed with a Local Feature Extraction Pathway (LFEP) and a Global Context Modeling Pathway (GCMP), enabling simultaneous capture of structural details and long-range semantic dependencies. A Local-Global Collaborative Perception Enhancement Module (LG-CPEM) is introduced to fuse the outputs from both streams, enhancing contextual representation. The decoder adopts a hierarchical up-sampling structure with skip connections and incorporates a dual-attention module to refine boundary-level details and suppress background noise. Extensive experiments on benchmark urban building datasets demonstrate that MS-HDAN significantly outperforms existing state-of-the-art methods, particularly in handling densely distributed and structurally complex buildings. The proposed framework offers a robust and scalable solution for real-world applications, such as urban planning, where precise building segmentation is crucial.
Speech is one of the most efficient methods of communication among humans, inspiring advancements in machine speech processing under Natural Language Processing (NLP). This field aims to enable computers to analyze, comprehend, and generate human language naturally. Speech processing, as a subset of artificial intelligence, is rapidly expanding due to its applications in emotion recognition, human-computer interaction, and sentiment analysis. This study introduces a novel algorithm for emotion recognition from speech using deep learning techniques. The proposed model achieves up to a 15% improvement compared to state-of-the-art deep learning methods in speech emotion recognition. It employs advanced supervised learning algorithms and deep neural network architectures, including Convolutional Neural Networks (CNNs) and Recurrent Neural Networks (RNNs) with Long Short-Term Memory (LSTM) units. These models are trained on labeled datasets to accurately classify emotions such as happiness, sadness, anger, fear, surprise, and neutrality. The research highlights the system’s real-time application potential, such as analyzing audience emotional responses during live television broadcasts. By leveraging advancements in deep learning, the model achieves high accuracy in understanding and predicting emotional states, offering valuable insights into user behavior. This approach contributes to diverse domains, including media analysis, customer feedback systems, and human-machine interaction, showcasing the transformative potential of combining speech processing with neural networks.
Recent advancements in decoding electroencephalogram (EEG) signals for motor imagery tasks have shown significant potential. However, the intricate time–frequency dynamics and inter-channel redundancy of EEG signals remain key challenges, often limiting the effectiveness of single-scale feature extraction methods. To address this issue, we propose the Dual-Branch Blocked-Integration Self-Attention Network (DB-BISAN), a novel deep learning framework for EEG motor imagery classification. The proposed method includes a Dual-Branch Feature Extraction Module designed to capture both temporal features and spatial patterns across different scales. Additionally, a novel Blocked-Integration Self-Attention Mechanism is employed to selectively highlight important features while minimizing the impact of redundant information. The experimental results show that DB-BISAN achieves state-of-the-art performance. Also, ablation studies confirm that the Dual-Branch Feature Extraction and Blocked-Integration Self-Attention Mechanism are critical to the model’s performance. Our approach offers an effective solution for motor imagery decoding, with significant potential for the development of efficient and accurate brain–computer interfaces.
To address the challenges of photovoltaic (PV) power prediction in highly dynamic environments. We propose an improved Long Short-Term Memory (ILSTM) model. The model uses Principal Component Analysis (PCA) and Particle Swarm Optimization (PSO) for feature selection, ensuring key information is preserved while reducing dimensionality. The Depthwise Separable Convolution (DSC) module extracts spatial features, while the Channel-Spatial Attention Mechanism (CBAM) focuses on important time-dependent patterns. Finally, Bidirectional Long Short-Term Memory (BiLSTM) captures nonlinear dynamics and long-term dependencies, boosting prediction performance. The model is called DSC-CBAM-BiLSTM. It selects important features adaptively. It captures key spatial-temporal patterns and improves forecasting performance based on RMSE, MAE, and . Extensive experiments using real-world PV datasets under varied meteorological scenarios show the proposed model significantly outperforms traditional approaches. Specifically, RMSE and MAE are reduced by over 70%, and the coefficient of determination () is improved by 8.5%. These results confirm the framework’s effectiveness for real-time, short-term PV forecasting and its applicability in energy dispatching and smart grid operations.