Spiking neural networks are able to control with high precision the rotation and force of single-joint robotic arms when shape memory alloy wires are used for actuation. Bio-inspired robotic arms such as anthropomorphic fingers include more junctions that are actuated simultaneously. Starting from the hypothesis that the motor cortex groups the control of multiple muscles into neural synergies, this work presents for the first time an SNN structure that is able to control a series of finger motions by activation of groups of neurons that drive the corresponding actuators in sequence. The initial motion starts when a command signal is received, while the subsequent ones are initiated based on the sensors’ output. In order to increase the biological plausibility of the control system, the finger is flexed and extended by four SMA wires connected to the phalanges as the main tendons. The results show that the artificial finger that is controlled by the SNN is able to smoothly perform several motions of the human index finger while the command signal is active. To evaluate the advantages of using SNN, we compared the finger behaviours when the SMA actuators are driven by SNN, and by a microcontroller, respectively. In addition, we designed an electronic circuit that models the sensor’s output in concordance with the SNN output.
A new approach is introduced to address the subject dependency problem in P300-based brain-computer interfaces (BCI) by using transfer learning. The occurrence of P300, an event-related potential, is primarily associated with changes in natural neuron activity and elicited in response to infrequent stimuli, which can be monitored non-invasively through an electroencephalogram. However, implementing P300-based BCI in real-time requires many training samples and time-consuming calibration, making it challenging to use in practical applications. To tackle these challenges, the proposed approach harnesses the high-level feature extraction capability of a deep neural network, achieved through fine-tuning. To ensure similar distributions of feature extraction data, the approach of aligning data in Euclidean space is employed, which is then applied to a discriminatively restricted Boltzmann machine with a single layer for P300 detection. The performance of the proposed method on the BCI Competition III dataset II and the BCI competition II dataset II, the state-of-the-art dataset, was evaluated and compared with previous studies. The results showed that robust performance could be achieved using a small number of training samples, demonstrating the effectiveness of the transfer learning approach in P300-based BCI applications.
Anthropomorphic hands that mimic the smoothness of human hand motions should be controlled by artificial units of high biological plausibility. Adaptability is among the characteristics of such control units, which provides the anthropomorphic hand with the ability to learn motions. This paper presents a simple structure of an adaptive spiking neural network implemented in analogue hardware that can be trained using Hebbian learning mechanisms to rotate the metacarpophalangeal joint of a robotic finger towards targeted angle intervals. Being bioinspired, the spiking neural network drives actuators made of shape memory alloy and receives feedback from neuromorphic sensors that convert the joint rotation angle and compression force into the spiking frequency. The adaptive SNN activates independent neural paths that correspond to angle intervals and learns in which of these intervals the rotation the finger rotation is stopped by an external force. Learning occurs when angle-specific neural paths are stimulated concurrently with the supraliminar stimulus that activates all the neurons that inhibit the SNN output stopping the finger. The results showed that after learning, the finger stopped in the angle interval in which the angle-specific neural path was active, without the activation of the supraliminar stimulus. The proposed concept can be used to implement control units for anthropomorphic robots that are able to learn motions unsupervised, based on principles of high biological plausibility.
Recently, neuromorphic sensors, which convert analogue signals to spiking frequencies, have been reported for neurorobotics. In bio-inspired systems these sensors are connected to the main neural unit to perform post-processing of the sensor data. The performance of spiking neural networks has been improved using optical synapses, which offer parallel communications between the distanced neural areas but are sensitive to the intensity variations of the optical signal. For systems with several neuromorphic sensors, which are connected optically to the main unit, the use of optical synapses is not an advantage. To address this, in this paper we propose and experimentally verify optical axons with synapses activated optically using digital signals. The synaptic weights are encoded by the energy of the stimuli, which are then optically transmitted independently. We show that the optical intensity fluctuations and link’s misalignment result in delay in activation of the synapses. For the proposed optical axon, we have demonstrated line of sight transmission over a maximum link length of 190 cm with a delay of 8 μs. Furthermore, we show the axon delay as a function of the illuminance using a fitted model for which the root mean square error (RMS) similarity is 0.95.
14 December 2022 in International Journal of Humanoid Robotics