The unscented Kalman filter (UKF) provides a powerful tool for power system forecasting-aided state estimation (FASE). However, when the power systems are affected by the abnormal operating situations, i.e., the non-Gaussian communication noises, sudden loads or state changes, instrument failures, the original UKF based on the minimum mean square error (MMSE) criterion may suffer from performance degradation. In contrast to the MMSE criterion, the minimum error entropy (MEE) exhibits the robustness with respect to complex non- Gaussian disturbances. In the present paper, we develop a new unscented Kalman-type filter based on the MEE criterion, termed minimum error entropy unscented Kalman filter (MEE-UKF). To derive the MEE-UKF, a statistical linearization approach is adopted in the augmented model such that the state and measurement errors are combined in the MEE cost function simultaneously. Then, a fixed-point iteration algorithm is used to recursively update the posterior estimates and covariance matrix. Apart from the impulsive noises, the MEE-UKF can deal with complex multimodal distribution noises in both process and measurement. The high accuracy and strong robustness of MEEUKF are confirmed by the simulation results on IEEE 14, 30, and 57 bus test systems under different non-Gaussian disturbances.
24 May 2019 in IEEE Transactions on Systems, Man, and Cybernetics: Systems
The hyperbolic cosine function with high-order errors can be utilized to improve the accuracy of adaptive filters. However, when initial weight errors are large, the hyperbolic cosine-based adaptive filter (HCAF) may be unstable. In this paper, a novel normalization based on the logarithmic hyperbolic cosine function is proposed to achieve the stabilization for the case of large initial weight errors, which generates a logarithmic HCAF (LHCAF). Actually, the cost function of LHCAF is the logarithmic hyperbolic cosine function that is robust to large errors and smooth to small errors. The transient and steady-state analyses of LHCAF in terms of the mean-square deviation (MSD) are performed for a stationary white input with an even probability density function in a stationary zero-mean white noise. The convergence and stability of LHCAF can be therefore guaranteed as long as the filtering parameters satisfy certain conditions. The theoretical results based on the MSD are supported by the simulations. In addition, a variable scaling factor and step-size LHCAF (VSS-LHCAF) is proposed to improve the filtering accuracy of LHCAF further. The proposed LHCAF and VSS-LHCAF are superior to HCAF and other robust adaptive filters in terms of filtering accuracy and stability.
24 July 2020 in IEEE Transactions on Neural Networks and Learning Systems
As an effective and efficient discriminative learning method, broad learning system (BLS) has received increasing attention due to its outstanding performance in various regression and classification problems. However, the standard BLS is derived under the minimum mean square error (MMSE) criterion, which is, of course, not always a good choice due to its sensitivity to outliers. To enhance the robustness of BLS, we propose in this work to adopt the maximum correntropy criterion (MCC) to train the output weights, obtaining a correntropy-based BLS (C-BLS). Due to the inherent superiorities of MCC, the proposed C-BLS is expected to achieve excellent robustness to outliers while maintaining the original performance of the standard BLS in the Gaussian or noise-free environment. In addition, three alternative incremental learning algorithms, derived from a weighted regularized least-squares solution rather than pseudoinverse formula, for C-BLS are developed. With the incremental learning algorithms, the system can be updated quickly without the entire retraining process from the beginning when some new samples arrive or the network deems to be expanded. Experiments on various regression and classification data sets are reported to demonstrate the desirable performance of the new methods.
24 April 2018 in IEEE Transactions on Circuits and Systems I: Regular Papers
Random Fourier adaptive filters (RFAFs) project the original data into a high-dimensional random Fourier feature space (RFFS) such that the network structure of filters is fixed while achieving similar performance with kernel adaptive filters. The commonly used error criterion in RFAFs is the well-known minimum mean-square error (MMSE) criterion, which is optimal only under the Gaussian noise assumption. However, the MMSE criterion suffers from instability and performance deterioration in the presence of non-Gaussian noises. To improve the robustness of RFAFs against large outliers, the maximum correntropy criterion (MCC) is applied to RFFS, generating a novel robust random Fourier filter under maximum correntropy (RFFMC). To further improve the filtering accuracy, a random-batch RFFMC (RB-RFFMC) is also presented. In addition, a theoretical analysis on the convergence characteristics and steady-state excess mean-square error of RFFMC and RB-RFFMC is provided to validate their superior performance. Simulation results illustrate that RFFMC and its extension provide desirable filtering performance from the aspects of filtering accuracy and robustness, especially in the presence of impulsive noises.
1 January 2019 in Journal of the Franklin Institute
Kernel-based extreme learning machine (KELM), as a natural extension of ELM to kernel learning, has achieved outstanding performance in addressing various regression and classification problems. Compared with the basic ELM, KELM has a better generalization ability owing to no needs of the number of hidden nodes given beforehand and random projection mechanism. Since KELM is derived under the minimum mean square error (MMSE) criterion for the Gaussian assumption of noise, its performance may deteriorate under the non-Gaussian cases, seriously. To improve the robustness of KELM, this article proposes a mixture correntropy-based KELM (MC-KELM), which adopts the recently proposed maximum mixture correntropy criterion as the optimization criterion, instead of using the MMSE criterion. In addition, an online sequential version of MC-KELM (MCOS-KELM) is developed to deal with the case that the data arrive sequentially (one-by-one or chunk-by-chunk). Experimental results on regression and classification data sets are reported to validate the performance superiorities of the new methods.