In this paper, we propose an approach to the transient and steady-state analysis of the affine combination of one fast and one slow adaptive filters. The theoretical models are based on expressions for the excess mean-square error (EMSE) and cross-EMSE of the component filters, which allows their application to different combinations of algorithms, such as least mean-squares (LMS), normalized LMS (NLMS), and constant modulus algorithm (CMA), considering white or colored inputs and stationary or nonstationary environments. Since the desired universal behavior of the combination depends on the correct estimation of the mixing parameter at every instant, its adaptation is also taken into account in the transient analysis. Furthermore, we propose normalized algorithms for the adaptation of the mixing parameter that exhibit good performance. Good agreement between analysis and simulation results is always observed.
1 January 2021 in IEEE Transactions on Signal Processing
Distributed signal processing has attracted widespread attention in the scientific community due to its several advantages over centralized approaches. Recently, graph signal processing has risen to prominence, and adaptive distributed solutions have also been proposed in the area. Both in the classical framework and in graph signal processing, sampling and censoring techniques have been topics of intense research, since the cost associated with measuring, processing and/or transmitting data throughout the entire network may be prohibitive in certain applications. In this paper, we propose a low-cost adaptive mechanism for sampling and censoring over diffusion networks that uses information from more nodes when the error in the network is high and from less nodes otherwise. It presents fast convergence during transient and a significant reduction in computational cost and energy consumption in steady state. As a censoring technique, we show that it is able to noticeably outperform other solutions. We also present a theoretical analysis to give insights about its operation, and to help the choice of suitable values for its parameters.
Combination schemes are gaining attention as an interesting way to improve adaptive filter performance. In this paper we pay attention to a particular convex combination scheme with nonlinear adaptation that has recently been shown to be universal -i.e., to perform at least as the best component filter- in steady-state; however, no theoretical model for the transient has been provided yet. By relying on Taylor Series approximations of the nonlinearities, we propose a theoretical model for the transient behavior of such convex combinations. In particular, we provide expressions for the time evolution of the mean and the variance of the mixing parameter, as well as for the mean square overall filter convergence. The accuracy of the model is analyzed for the particular case of a combination of two LMS filters with different step sizes, explaining also how our results can help the designer to adjust the free parameters of the scheme.
We propose a normalized least mean squares algorithm with variable step size. Unlike other solutions, it has low computational cost, only three parameters that are simple to choose, and its steady-state performance can be easily predicted. Simulations show a competitive performance in comparison with other solutions, and validate our theoretical analysis.
We extend the analysis presented in for the affine combination of two least mean-square (LMS) filters to allow for colored inputs and nonstationary environments. Our theoretical model deals, in a unified way, with any combinations based on the following algorithms: LMS, normalized LMS (NLMS), and recursive-least squares (RLS). Through the analysis, we observe that the affine combination of two algorithms of the same family with close adaptation parameters (step-sizes or forgetting factors) provides a 3 dB gain in relation to its best component filter. We study this behavior in stationary and nonstationary environments. Good agreement between analytical and simulation results is always observed. Furthermore, a simple geometrical interpretation of the affine combination is investigated. A model for the transient and steady-state behavior of two possible algorithms for estimation of the mixing parameter is proposed. The model explains situations in which adaptive combination algorithms may achieve good performance.