30 November 2023 in IEEE Access
Cross-modal retrieval, which aims to search for semantically relevant data across different modalities, has received increasing attention in recent years. Deep learning, with its ability to extract high-level representations from multimodal data, has become a popular approach for cross-modal retrieval. In this paper, we present a comprehensive survey of deep learning techniques for cross-modal retrieval including 35 papers published in recent years. The review is organized into four main sections, covering traditional subspace learning methods, deep learning, and machine learning-based approaches, techniques based on large multi-modal models, and an analysis of datasets used in the field of cross-modal retrieval. We compare and analyze the performance of different deep learning methods on benchmark datasets, the result shows that although a large number of innovative methods have been proposed, there are still some problems that need to be solved, such as multi-modal feature alignment, multi-modal feature fusion, and subspace learning, as well as specialized datasets.
10 August 2021 in Signal, Image and Video Processing
17 December 2025 in Expert Systems with Applications
15 July 2025 in Journal of Visualized Experiments
Artificial neural network-based computer image processing technology has rapidly developed in recent years and found widespread applications across multiple fields. In medical image processing, UNet and its variants have shown great success in lesion detection, cell segmentation, and polyp segmentation tasks. This research presents a modified U-shaped network with reduced network parameters achieved by decreasing the network depth and increasing the network channels to enhance the model's learning ability. To counteract the reduction in learning capacity caused by depth compression, a hybrid-channel convolutional module is introduced to replace the original network's convolutional module. The model introduces a channel attention mechanism between the layer and the point convolution layer to improve the practical channel feature extraction ability. The article also concludes that using mixed-depth convolution can effectively solve the size span of the segmentation target, making it difficult for one model to be fit for multiple data sets. The proposed model achieves state-of-the-art results on two popular public datasets, MoNuseg and GlaS, with a mean dice increase of 1.0% and 1.37%, respectively. The total parameters of the modified model are reduced to 1.71M, representing a 38.6x reduction compared to UCtransNet, with 65.6M parameters.