Radar waveform design is of great importance for radar system performances and has drawn considerable attention recently. Constant modulus is an important waveform design consideration, both from the point of view of hardware realization and to allow for full utilization of the transmitter’s power. In this paper, we consider the problem of constant-modulus waveform design for extended target detection with prior information about the extended target and clutter. At first, we propose an arbitrary-phase unimodular waveform design method via joint transmitter-receiver optimization. We exploit a semi-definite relaxation technique to transform an intractable non-convex problem into a convex problem, which can then be efficiently solved. Furthermore, quadrature phase shift keying waveform is designed, which is easier to implement than arbitrary-phase waveforms. Numerical results demonstrate the effectiveness of the proposed methods.
Audio-visual semantic segmentation (AVSS) aims to segment and classify sounding objects in videos with acoustic cues. However, most approaches operate on the close-set assumption and only identify pre-defined categories from training data, lacking the generalization ability to detect novel categories in practical applications. In this paper, we introduce a new task: open-vocabulary audio-visual semantic segmentation, extending AVSS task to open-world scenarios beyond the annotated label space. This is a more challenging task that requires recognizing all categories, even those that have never been seen nor heard during training. Moreover, we propose the first open-vocabulary AVSS framework, OV-AVSS, which mainly consists of two parts: 1) a universal sound source localization module to perform audio-visual fusion and locate all potential sounding objects and 2) an open-vocabulary classification module to predict categories with the help of the prior knowledge from large-scale pre-trained vision-language models. To properly evaluate the open-vocabulary AVSS, we split zero-shot training and testing subsets based on the AVSBench-semantic benchmark, namely AVSBench-OV. Extensive experiments demonstrate the strong segmentation and zero-shot generalization ability of our model on all categories. On the AVSBench-OV dataset, OV-AVSS achieves 55.43% mIoU on base categories and 29.14% mIoU on novel categories, exceeding the state-of-the-art zero-shot method by 41.88%/20.61% and open-vocabulary method by 10.2%/11.6%. The code is available at https://github.com/ruohaoguo/ovavss.
The high-resolution range (HRR) profile is an important target signature in many applications (e.g., automatic target recognition), and the radar HRR profiling performance is highly dependent on radar transmitted waveforms. In this paper, we consider the constant-modulus (CM) waveform optimization problem to improve HRR profiling performance for stationary targets. Firstly, several fundamental bounds regarding the profiling ambiguity, stability, and accuracy are derived. Further investigation reveals that the stability and accuracy of HRR profiling are unified in the white noise case. Aimed at improving the profiling stability and accuracy, we design two types of CM radar waveforms—the arbitrary-phase and QPSK waveforms—through a customized Gaussian randomization method. The performance of LFM waveforms is also discussed. Numerical experiments show that the optimized CM waveforms can dramatically enhance the profiling performance over the unoptimized ones.
A simple and effective quadrature phase shift keying (QPSK) signal design for a given correlation matrix is presented. The method exploits the correlation properties generated by memoryless nonlinear transformation of a Gaussian process. The correlation matrix of the designed QPSK signal is compared to the given matrix and good approximation is achieved.
Panoramic audio-visual saliency detection is to segment the most attention-attractive regions in 360° panoramic videos with sound. To meticulously delineate the detected salient regions and effectively model human attention shift, we extend this task to more fine-grained instance scenarios: identifying salient object instances and inferring their saliency ranks. In this paper, we propose the first instance-level framework that can simultaneously be applied to segmentation and ranking of multiple salient objects in panoramic videos. Specifically, it consists of a distortion-aware pixel decoder to overcome panoramic distortions, a sequential audio-visual fusion module to integrate audio-visual information, and a spatio-temporal object decoder to separate individual instances and predict their saliency scores. Moreover, owing to the absence of such annotations, we create the ground-truth saliency ranks for the PAVS10K benchmark. Extensive experiments demonstrate that our model is capable of achieving state-of-the-art performance on the PAVS10K for both saliency detection and ranking tasks. The code is available at https://github.com/ruohaoguo/pavsodr.