10 November 2017 in IEEE Transactions on Circuits and Systems I: Regular Papers
This paper proposes a new optimization framework for the joint optimization of sparsity and filter order (JOSFO) for FIR filter design. Since the cost function for JOSFO involves ℓ 0 and non-uniform overlapped group ℓ 0 norms, which are not convex, a global optimal solution is difficult to obtain. To find an approximate solution of the non-convex problem, existing approaches repeat the following steps: 1) approximate the cost function; 2) find candidates of zero coefficients by minimizing the cost function; and 3) set them to zero. On the other hand, this paper directly solves the optimization problem, without any approximation to the cost function, by using the alternating direction method of multipliers with the pseudo-proximity operators of ℓ 0 and non-uniform non-overlapped group ℓ 0 norms. Experimental results show that resulting filters designed by the proposed method have sparser coefficients and lower orders, while satisfying filter specifications, such as an error from a desired frequency response.
3 February 2021 in IEEE Transactions on Signal Processing
This paper proposes an epigraphical relaxation (ERx) technique for non-proximable mixed norm minimization. Mixed norm regularization methods play a central role in signal reconstruction and processing, where their optimization relies on the fact that the proximity operators of the mixed norms can be computed efficiently. To bring out the power of regularization, sophisticated layered modeling of mixed norms that can capture inherent signal structure is a key ingredient, but the proximity operator of such a mixed norm is often unavailable (non-proximable). Our ERx decouples a layered non-proximable mixed norm into a norm and multiple epigraphical constraints. This enables us to handle a wide range of non-proximable mixed norms in optimization, as long as both the proximal operator of the outermost norm and the projection onto each epigraphical constraint are efficiently computable. Moreover, under mild conditions, we prove that ERx does not change the minimizer of the original problem despite relaxing equality constraints into inequality ones. We also develop new regularizers based on ERx:one is decorrelated structure-tensor total variation for color image restoration, and the other is amplitude-spectrum nuclear norm for low-rank amplitude recovery. We examine the power of these regularizers through experiments, which illustrates the utility of ERx.
23 May 2014 in IEEE Transactions on Signal Processing
Complex-valued conjugate-symmetric Hadamard transforms (C-CSHT) are variants of complex Hadamard transforms and found applications in signal processing. In addition, their real-valued transform counterparts (R-CSHTs) perform comparably with Hadamard transforms (HTs) despite their lower computational complexity. Closed-form factorizations of C-CSHTs and R-CSHTs have recently been proposed to make calculations more efficient. However, there is still room to find effective and general factorizations. This paper presents a simple closed-form complete factorization of C-CSHTs based on that of R-CSHTs. The proposed factorization can be applied to both C- and R-CSHTs with one factorization and it provides several benefits: 1) It can save total implementation costs for both C-CSHTs and R-CSHTs; 2) the generalized R-CSHT factorization significantly reduces its computational cost; 3) memory-saved local orientation detection of images can be achieved; 4) a fast direction-aware transform can be attained; 5) it clarifies that C- and R-CSHTs are closely related to common block transforms, such as the discrete Fourier transform (DFT), binDCT, and HT; and 6) it achieves a new integer complex-valued transform, which can approximate the DFT better than the original C-CSHT. The image orientation estimation and performance in image coding of our R-CSHTs were evaluated through examples of practical applications based on the proposed factorization.
9 November 2017 in IEEE Transactions on Circuits and Systems for Video Technology
We present a novel image boundary extension, mean value extension (MVE), for directional lapped transforms, particularly cosine-sine modulated lapped transforms (CSMLTs). Lapped transforms are usually used with an extension technique, such as periodic extension (PE) or symmetric extension (SE), for nonexpansive convolution at signal boundaries. When directional textures (oblique lines and curves) appear at the 2D signal (image) boundaries, both PE and SE produce directional discontinuities, which degrade the sparsity of the transformed coefficients, especially in the case of directional lapped transforms. MVE reduces the discontinuities for directional textures better than PE or SE do; it thus improves the efficiency of the sparse representation based on directional lapped transforms. Moreover, to reduce computational costs compared with those of directional lapped transforms, we introduce new directional block transforms, called cosine-sine modulated block transforms (CSMBTs). These new transforms are derived from a minimum tile processing (tiling) of M-band CSMLTs with 2M filter lengths and nonexpansive convolutions. The resulting directional block transforms, particularly in the case of the MVE, have richer directional selectivity and have higher performance compared with a discrete Fourier transform (DFT) as shown in experiments.