In this work, we investigate online multi-view learning according to the multi-view complementarity and consistency principles to memorably process online multi-view data when fused across views. Online diverse features through different deep feature extractors under different views are used as input to an online learning method to privately and memorably optimize in each view for the discovery and memorization of the view-specific information. More specifically, according to the multi-view complementarity principle, a softmax-weighted reducible (SWR) loss is proposed to selectively retain credible views and neglect incredible ones for the online model’s cross-view complementarity fusion. According to the multi-view consistency principle, we design a cross-view embedding consistency (CVEC) loss and a cross-view Kullback–Leibler (CVKL) divergence loss to maintain the cross-view consistency of the online model. Since the online multi-view learning setup needs to avoid repeatedly accessing online data to handle the knowledge forgetting in each view, we propose a knowledge registration unit (KRU) based on dictionary learning to incrementally register newly view-specific knowledge of online unlabeled data to the learnable and adjustable dictionary. Finally, by using the above strategies, we propose an online multi-view KRU approach and evaluate it with comprehensive experiments, thereby showing its superiority in online multi-view learning.
Deep convolutional neural networks have demonstrated significant performance improvements in face super-resolution tasks. However, many deep learning-based approaches tend to overlook the inherent structural information and feature correlation across different scales in face images, making the accurate recovery of face structure in low-resolution cases challenging. To address this, this paper proposes a method that fuses multi-scale features while preserving the facial structure. It introduces a novel multi-scale residual block (MSRB) to reconstruct key facial parts and structures from spatial and channel dimensions, and utilizes pyramid attention (PA) to exploit non-local self-similarity, improving the details of the reconstructed face. Feature Enhancement Modules (FEM) are employed in the upscale stage to refine and enhance current features using multi-scale features from previous stages. The experimental results on CelebA, Helen and LFW datasets provide evidence that our method achieves superior quantitative metrics compared to the baseline, the Peak Signal-to-Noise Ratio (PSNR) outperforms the baseline by 0.282 dB, 0.343 dB, and 0.336 dB. Furthermore, our method demonstrates improved visual performance on two additional no-reference datasets, Widerface and Webface.
It is highly significant from a research standpoint and a valuable practice to identify diseases, symptoms, drugs, examinations, and other medical entities in medical text data to support knowledge maps, question and answer systems, and other downstream tasks that can provide the public with knowledgeable answers. However, when contrasted with other languages like English, Chinese words lack a distinct dividing line, and medical entities have problems such as long length and multiple entity types nesting. Therefore, to address these issues, this study suggests a medical named entity recognition (NER) approach that combines part-of-speech and stroke features. First, the text is fed into the BERT pre-training model to get the semantic representation of the text, while the part-of-speech feature vector is obtained using the part-of-speech dictionary, and the stroke feature of the text is extracted through a convolution neural network (CNN). The word vector is then joined with the part-of-speech and stroke feature vectors, respectively, and input into the BiLSTM and CRF layer for training. Additionally, to balance the disparity in data volume across several types of entities, the class-weighted loss function is included in the loss function. According to the experimental findings, our model’s F1 score on the CCKS2019 dataset reaches 78.65%, and the recognition performance exceeds many existing algorithms.
Accurate crowd flow prediction is essential for traffic guidance and traffic control. However, the high nonlinearity, temporal complexity, and spatial complexity that crowd flow data have makes this problem challenging. This research proposes a dynamic graph convolutional network model (Res-DGCN) based on the residual network structure for crowd inflow and outflow prediction in urban areas. Firstly, as the attention layer, the spatio-temporal attention module (SA) is employed for capturing the spatial relationship between the target node and the multi-order adjacent nodes by processing the features of the human flow data. Secondly, a conditional convolution module (SCondConv) is used to enhance the model’s capacity for learning about the shifting characteristics of crowd flow to obtain spatial dependence. Finally, we train the model with the Huber loss function to lower the model’s sensitivity to outliers and achieve optimal convergence. In two public datasets, the mean absolute error (MAE) of the proposed model is improved by 5.2% and 9.4%, respectively, compared to the baseline models, and the root mean square error (RMSE) is improved by 4.8% and 8.8%, confirming the model’s usefulness for crowd flow prediction tasks.
1 January 2025 in IEEE Journal of Biomedical and Health Informatics
Accurate segmentation of skin lesions remains a key challenge for early cancer diagnosis due to complex morphological variations such as irregular shape, heterogeneous texture and low contrast. To address these limitations, we propose SVMB-Net, a dual-architecture framework that integrates SwinTransformer and CNN with the following innovations: first, the Super ViT-CNN (SViT-C) hybrid encoder employs a special global restoration module for extracting high-level semantics, whereas the dual-branch fusion module combines CNN's local feature extraction with SwinTransformer's global context modelling synergy. Second, our multi-branch deep cross-feature attention decoder introduces a multi-scale attention mechanism. Comprehensive evaluations on three clinical datasets show significant improvements: on ISIC2018, SVMB-Net improves $DSC$ by 7.67% to 93.88% and $ACC$ by 2.21% to 96.97% against the current state-of-the-art segmentation method DINOv2. Experiments conducted at ISIC2017 and $PH^{2}$ show an $IoU$ of 83.45% and an $ACC$ of 97.08%, which largely outperforms 16 existing methods such as SAM2-UNet and VM-UNet. The architecture provides a powerful solution for automated lesion analysis in real-world clinical settings. Early detection and surgical treatment are crucial for the successful cure of skin cancer. However, the accuracy of detecting skin cancer is challenged due to its variations in shape, size, color, texture, hair, contrast difference, brightness, and irregular boundaries. To address these issues, a new skin cancer image segmentation method, SVMB-Net, is proposed in this paper. Our code will be open sourced at https://github.com/Sleepearlyy/SVMB-Net.git.