Voltage-dependent synaptic plasticity: Unsupervised probabilistic Hebbian plasticity rule based on neurons membrane potential

Archive ouverte : Article de revue

Garg, Nikhil | Balafrej, Ismael | Stewart, Terrence | Portal, Jean-Michel | Bocquet, Marc | Querlioz, D. | Drouin, Dominique | Rouat, Jean | Beilliard, Yann | Alibart, Fabien

Edité par HAL CCSD ; Frontiers

International audience. This study proposes voltage-dependent-synaptic plasticity (VDSP), a novel brain-inspired unsupervised local learning rule for the online implementation of Hebb’s plasticity mechanism on neuromorphic hardware. The proposed VDSP learning rule updates the synaptic conductance on the spike of the postsynaptic neuron only, which reduces by a factor of two the number of updates with respect to standard spike timing dependent plasticity (STDP). This update is dependent on the membrane potential of the presynaptic neuron, which is readily available as part of neuron implementation and hence does not require additional memory for storage. Moreover, the update is also regularized on synaptic weight and prevents explosion or vanishing of weights on repeated stimulation. Rigorous mathematical analysis is performed to draw an equivalence between VDSP and STDP. To validate the system-level performance of VDSP, we train a single-layer spiking neural network (SNN) for the recognition of handwritten digits. We report 85.01 ± 0.76% (Mean ± SD) accuracy for a network of 100 output neurons on the MNIST dataset. The performance improves when scaling the network size (89.93 ± 0.41% for 400 output neurons, 90.56 ± 0.27 for 500 neurons), which validates the applicability of the proposed learning rule for spatial pattern recognition tasks. Future work will consider more complicated tasks. Interestingly, the learning rule better adapts than STDP to the frequency of input signal and does not require hand-tuning of hyperparameters.

Consulter en ligne

Suggestions

Du même auteur

Fully CMOS-compatible passive TiO2-based memristor crossbars for in-memory computing | El Mesoudy, Abdelouadoud

Fully CMOS-compatible passive TiO2-based memristor crossbars for in-memory ...

Archive ouverte: Article de revue

El Mesoudy, Abdelouadoud | 2022-02

International audience. Brain-inspired computing and neuromorphic hardware are promising approaches that offer great potential to overcome limitations faced by current computing paradigms based on traditional von-Ne...

Oxygen vacancy engineering of TaO x -based resistive memories by Zr doping for improved variability and synaptic behavior | Palhares, João

Oxygen vacancy engineering of TaO x -based resistive memories by Zr doping ...

Archive ouverte: Article de revue

Palhares, João | 2021-07-12

International audience. Resistive switching (RS) devices are promising forms of non-volatile memory. However, one of the biggest challenges for RS memory applications is the device-to-device (D2D) variability, which...

Band gap narrowing induced by oxygen vacancies in reactively sputtered TiO2 thin films | Mesoudy, Abdelouadoud El

Band gap narrowing induced by oxygen vacancies in reactively sputtered TiO2...

Archive ouverte: Article de revue

Mesoudy, Abdelouadoud El | 2023-03-31

International audience

Du même sujet

10. Incremental learning of convolutional neural networks in bioinformatics | Mousser, Wafa

10. Incremental learning of convolutional neural networks in bioinformatics

Archive ouverte: Type de document indéfini

Mousser, Wafa | 2022

International audience. In recent years, convolutional neural networks (CNNs) have been widely used in various computer visual recognition tasks and then extensively applied for medical images, particularly for comp...

[Invited] Neuromorphic computing: a bridge between artificial neural networks and bio-computing. [Invited] Neuromorphic computing: a bridge between artificial neural networks and bio-computing: [Invited] | Alibart, F.

[Invited] Neuromorphic computing: a bridge between artificial neural networ...

Archive ouverte: Communication dans un congrès

Alibart, F. | 2022-05-13

National audience

Distributed clique-based neural networks for data fusion at the edge | Larras, Benoit

Distributed clique-based neural networks for data fusion at the edge

Archive ouverte: Communication dans un congrès

Larras, Benoit | 2020-02-12

International audience. Distributed smart sensors are more and more used in applications such as biomedical or domestic monitoring. However, each sensor broadcasts data wirelessly to the others or to an aggregator, ...

Subthreshold neuromorphic devices for spiking neural networks applied to embedded artificial intelligence | Loyez, Christophe

Subthreshold neuromorphic devices for spiking neural networks applied to em...

Archive ouverte: Communication dans un congrès

Loyez, Christophe | 2021-09-30

opening ceremony. International audience

Subthreshold neuromorphic devices for spiking neural networks applied to embedded A.I | Loyez, Christophe

Subthreshold neuromorphic devices for spiking neural networks applied to em...

Archive ouverte: Communication dans un congrès

Loyez, Christophe | 2021-06-13

International audience. Energy autonomy is one of the major challenges of embedded Artificial Intelligence. Among the candidate technologies likely to take up such a challenge, spiking neural networks are the most p...

Securing Deep Spiking Neural Networks against Adversarial Attacks through Inherent Structural Parameters | El-Allami, R.

Securing Deep Spiking Neural Networks against Adversarial Attacks through I...

Archive ouverte: Communication dans un congrès

El-Allami, R. | 2021-02-01

International audience. Deep Learning (DL) algorithms have gained popularity owing to their practical problem-solving capacity. However, they suffer from a serious integrity threat, i.e., their vulnerability to adve...

Chargement des enrichissements...