13 December 2024 in Proceedings of the National Academy of Sciences
Physical neural networks (PNN) using physical materials and devices to mimic synapses and neurons offer an energy-efficient way to implement artificial neural networks. Yet, training PNN is difficult and heavily relies on external computing resources. An emerging concept to solve this issue is called physical self-learning that uses intrinsic physical parameters as trainable weights. Under external inputs (i.e., training data), training is achieved by the natural evolution of physical parameters that intrinsically adapt modern learning rules via an autonomous physical process, eliminating the requirements on external computation resources. Here, we demonstrate a real spintronic system that mimics Hopfield neural networks (HNN), and unsupervised learning is intrinsically performed via the evolution of the physical process. Using magnetic texture–defined conductance matrix as trainable weights, we illustrate that under external voltage inputs, the conductance matrix naturally evolves and adapts Oja’s learning algorithm in a gradient descent manner. The self-learning HNN is scalable and can achieve associative memories on patterns with high similarities. The fast spin dynamics and reconfigurability of magnetic textures offer an advantageous platform toward efficient autonomous training directly in materials.
15 November 2021 in Applied Physics Letters
We report an experimental implementation of width-tunable neurons to train a binary neural network. The angle-dependent magnetic behavior in an oxide thin film highly mimics neurons with width-controllable activation window, providing an opportunity to train the activation functions and weights toward binary values. We apply this feature to train the MNIST dataset using a 684-800-10 fully connected network and achieve a high accuracy of 97.4%, thus opening an implementation strategy toward training neural networks.