Their findings were published in Science Advances on Oct. 20.
Previous studies proved that self-backpropagation (SBP) is caused by the rapid retrograde axonal transport of molecular signals. It is considered to be the key for efficient and flexible learning of biological neural networks.
The backpropagation (BP) algorithm in artificial neural networks uses a global strategy for optimization, which can achieve excellent performance but, at the same time, take too much computational cost during learning.
The researchers introduced biologically plausible SBP into a three-layer SNN. They found an elevated accuracy of network performance in three standard benchmark tasks, MNIST, NETtalk, and DvsGesture.
“The computational cost in terms of the product of mean epochs and algorithmic complexity per epoch was markedly reduced,” said XU. Similar results were obtained by further applying SBP on Restricted Boltzmann Machine.
According to the study, SBP is a special mesoscale biological plasticity mechanism, indicating a similar important role of SBP in SNNs compared to its counterpart BP in ANNs.
This will attract attention in the field of machine learning because training SNNs with pure biologically plausible algorithms (e.g., spike-timing-dependent plasticity) is difficult, in which the information is spatio-temporal and carried by discontinuous spikes.
The study has paved a way towards biologically plausible effective learning on both SNNs and ANNs, with high accuracy and low computational cost for learning different tasks.
Full text:
https://www.science.org/doi/10.1126/sciadv.abh0146
Contact:
ZHANG Xiaohan, PIO, Institute of Automation, Chinese Academy of Sciences
Email: xiaohan.zhang@ia.ac.cn