As one type of object detection, small object detection has been widely used in daily-life-related applications with many real-time requirements, such as autopilot and navigation. Although deep-learning-based object detection methods have achieved great success in recent years, they are not effective in small object detection and most of them cannot achieve real-time processing. Therefore, this paper proposes a single-stage small object detection network (SODNet) that integrates the specialized feature extraction and information fusion techniques. An adaptively spatial parallel convolution module (ASPConv) is proposed to alleviate the lack of spatial information for target objects and adaptively obtain the corresponding spatial information through multi-scale receptive fields, thereby improving the feature extraction ability. Additionally, a split-fusion sub-module (SF) is proposed to effectively reduce the time complexity of ASPConv. A fast multi-scale fusion module (FMF) is proposed to alleviate the insufficient fusion of both semantic and spatial information. FMF uses two fast upsampling operators to first unify the resolution of the multi-scale feature maps extracted by the network and then fuse them, thereby effectively improving the small object detection ability. Comparative experimental results prove that the proposed method considerably improves the accuracy of small object detection on multiple benchmark datasets and achieves a high real-time performance.
Medical image fusion techniques can fuse medical images from different morphologies to make the medical diagnosis more reliable and accurate, which play an increasingly important role in many clinical applications. To obtain a fused image with high visual quality and clear structure details, this paper proposes a convolutional neural network (CNN) based medical image fusion algorithm. The proposed algorithm uses the trained Siamese convolutional network to fuse the pixel activity information of source images to realize the generation of weight map. Meanwhile, a contrast pyramid is implemented to decompose the source image. According to different spatial frequency bands and a weighted fusion operator, source images are integrated. The results of comparative experiments show that the proposed fusion algorithm can effectively preserve the detailed structure information of source images and achieve good human visual effects.
Sparse-representation based approaches have been integrated into image fusion methods in the past few years and show great performance in image fusion. Training an informative and compact dictionary is a key step for a sparsity-based image fusion method. However, it is difficult to balance “informative” and “compact”. In order to obtain sufficient information for sparse representation in dictionary construction, this paper classifies image patches from source images into different groups based on morphological similarities. Stochastic coordinate coding (SCC) is used to extract corresponding image-patch information for dictionary construction. According to the constructed dictionary, image patches of source images are converted to sparse coefficients by the simultaneous orthogonal matching pursuit (SOMP) algorithm. At last, the sparse coefficients are fused by the Max-L1 fusion rule and inverted to a fused image. The comparison experimentations are simulated to evaluate the fused image in image features, information, structure similarity, and visual perception. The results confirm the feasibility and effectiveness of the proposed image fusion solution.
This paper is devoted to the problem of uncertainty in fractional-order Chaotic systems implemented by means of standard electronic components. The fractional order element (FOE) is typically substituted by one complex impedance network containing a huge number of discrete resistors and capacitors. In order to balance the complexity and accuracy of the circuit, a sparse optimization based parameter selection method is proposed. The random error and the uncertainty of system implementation are analyzed through numerical simulations. The effectiveness of the method is verified by numerical and circuit simulations, tested experimentally with electronic circuit implementations. The simulations and experiments show that the proposed method reduces the order of circuit systems and finds a minimum number for the combination of commercially available standard components.
11 May 2023 in EURASIP Journal on Audio, Speech, and Music Processing
Recent years have witnessed a great progress in single-channel speech separation by applying self-attention based networks. Despite the excellent performance in mining relevant long-sequence contextual information, self-attention networks cannot perfectly focus on subtle details in speech signals, such as temporal or spectral continuity, spectral structure, and timbre. To tackle this problem, we proposed a time-domain adaptive attention network (TAANet) with local and global attention network. Channel and spatial attention are introduced in local attention networks to focus on subtle details of the speech signals (frame-level features). In the global attention networks, a self-attention mechanism is used to explore the global associations of the speech contexts (utterance-level features). Moreover, we model the speech signal serially using multiple local and global attention blocks. This cascade structure enables our model to focus on local and global features adaptively, compared with other speech separation feature extraction methods, further boosting the separation performance. Versus other end-to-end speech separation methods, extensive experiments on benchmark datasets demonstrate that our approach obtains a superior result. (20.7 dB of SI-SNRi and 20.9 dB of SDRi on WSJ0-2mix).
Object detection is one of the main tasks in computer vision and has made great progress in recent years. However, the performance of target detectors is significantly dropped by the differences between existing datasets and application scenarios, leading to the so‐called domain shift problem. To address such an issue, a novel co‐teaching based pseudo label refinery framework for cross‐domain object detection is developed, which cooperates with two models to select data from target domain for each other. This strategy can effectively purify the predicted pseudo labels and resist noisy labels. Specifically, the framework consists of two encoders (i.e. structure encoder and global encoder), two classifiers and one discriminator, in which structure encoder is used to extract structural features that are not disturbed by colour, and the global encoder is used to extract the complete discriminant features. The two encoders are each followed by a classifier. In training, the structure and global encoder with labelled source samples are first trained, so that it has the initial recognition ability. Then the samples assigned are used with pseudo labels by the classifier following the structure encoder to fine‐tune the global encoder which pre‐trained on the labelled source domain and obtain the refined labels for the target data. With the refined labels, the structure encoder is further optimised on the target domain. During this process, the proposal is to cross use the two classifiers to promote the mutual transfer of complementary capabilities of the two encoders. Moreover, a novel residual channel attention block (RCA) embedded with salient features is designed to pay more attention to the target regions. Extensive experiments demonstrate that the developed framework can generate clean labels for unlabelled target data and boost the performance of cross domain object detection. The code is available at http://www.msp‐lab.cn:1436/msp/cbplr‐master .