The dynamic behaviours of an artificial neural network (ANN) system are strongly dependent on its network structure. Thus, the output of ANNs has long suffered from a lack of interpretability and variation. This has severely limited the practical usability of the logical rule in the ANN. The work presents an integrated representation of k-satisfiability (kSAT) in a mutation hopfield neural network (MHNN). Neuron states of the hopfield neural network converge to minimum energy, but the solution produced is confined to the limited number of solution spaces. The MHNN is incorporated with the global search capability of the estimation of distribution algorithms (EDAs), which typically explore various solution spaces. The main purpose is to estimate other possible neuron states that lead to global minimum energy through available output measurements. Furthermore, it is shown that the MHNN can retrieve various neuron states with the lowest minimum energy. Subsequent simulations performed on the MHNN reveal that the approach yields a result that surpasses the conventional hybrid HNN. Furthermore, this study provides a new paradigm in the field of neural networks by overcoming the overfitting issue.
Election Algorithm (EA) is a novel variant of the socio-political metaheuristic algorithm, inspired by the presidential election model conducted globally. In this research, we will investigate the effect of Bipolar EA in enhancing the learning processes of a Hopfield Neural Network (HNN) to generate global solutions for Random k Satisfiability (RANkSAT) logical representation. Specifically, this paper utilizes a bipolar EA incorporated with the HNN in optimizing RANkSAT representation. The main goal of the learning processes in our study is to ensure the cost function of RANkSAT converges to zero, indicating the logic function is satisfied. The effective learning phase will affect the final states of RANkSAT and determine whether the final energy is a global minimum or local minimum. The comparison will be made by adopting the same network and logical rule with the conventional learning algorithm, namely, exhaustive search (ES) and genetic algorithm (GA), respectively. Performance evaluation analysis is conducted on our proposed hybrid model and the existing models based on the Root Mean Square Error (RMSE), Mean Absolute Error (MAE), Sum of Squared Error (SSE), and Mean Absolute Error (MAPE). The result demonstrates the capability of EA in terms of accuracy and effectiveness as the learning algorithm in HNN for RANkSAT with a different number of neurons compared to ES and GA.
Synaptic weights for neurons in logic programming can be calculated either by using Hebbian learning or by Wan Abdullah’s method. In other words, Hebbian learning for governing events corresponding to some respective program clauses is equivalent with learning using Wan Abdullah’s method for the same respective program clauses. In this paper we will evaluate experimentally the equivalence between these two types of learning through computer simulations.