scispace - formally typeset
Open AccessJournal ArticleDOI

Deep learning in spiking neural networks

Reads0
Chats0
TLDR
The emerging picture is that SNNs still lag behind ANNs in terms of accuracy, but the gap is decreasing, and can even vanish on some tasks, while SNN's typically require many fewer operations and are the better candidates to process spatio-temporal data.
About
This article is published in Neural Networks.The article was published on 2019-03-01 and is currently open access. It has received 756 citations till now. The article focuses on the topics: Spiking neural network & Artificial neural network.

read more

Citations
More filters
Journal ArticleDOI

An adaptive threshold mechanism for accurate and efficient deep spiking convolutional neural networks

TL;DR: In this article , an adaptive threshold mechanism for improved balance between weight and threshold of SNNs is proposed, which makes it possible to obtain as small a threshold as possible while distinguishing inputs, so as to generate sufficient firing to drive higher layers.
Journal ArticleDOI

E-prop on SpiNNaker 2: Exploring online learning in spiking RNNs on neuromorphic hardware

TL;DR: In this article , a biologically-inspired E-prop approach for training Spiking Recurrent Neural Networks (SRNNs) was proposed to solve the back propagation through time (BPTT) problem.
Journal ArticleDOI

Robust trajectory generation for robotic control on the neuromorphic research chip Loihi

TL;DR: In this article, the authors exploit a biologically-inspired spiking neural network model, the so-called anisotropic network, to generate complex robotic movements as a building block for robotic control using state of the art neuromorphic hardware.
Journal ArticleDOI

Neuromorphic device based on silicon nanosheets

TL;DR: In this paper , the authors presented neuromorphic devices based on silicon nanosheets that are chemically exfoliated and surface modified, enabling self-assembly into hierarchical stacking structures, which can be switched between a unipolar memristor and a feasibly reset-able synaptic device.
References
More filters
Proceedings ArticleDOI

Deep Residual Learning for Image Recognition

TL;DR: In this article, the authors proposed a residual learning framework to ease the training of networks that are substantially deeper than those used previously, which won the 1st place on the ILSVRC 2015 classification task.
Proceedings Article

ImageNet Classification with Deep Convolutional Neural Networks

TL;DR: The state-of-the-art performance of CNNs was achieved by Deep Convolutional Neural Networks (DCNNs) as discussed by the authors, which consists of five convolutional layers, some of which are followed by max-pooling layers, and three fully-connected layers with a final 1000-way softmax.
Journal ArticleDOI

Long short-term memory

TL;DR: A novel, efficient, gradient based method called long short-term memory (LSTM) is introduced, which can learn to bridge minimal time lags in excess of 1000 discrete-time steps by enforcing constant error flow through constant error carousels within special units.
Proceedings Article

Very Deep Convolutional Networks for Large-Scale Image Recognition

TL;DR: This work investigates the effect of the convolutional network depth on its accuracy in the large-scale image recognition setting using an architecture with very small convolution filters, which shows that a significant improvement on the prior-art configurations can be achieved by pushing the depth to 16-19 weight layers.
Proceedings Article

Very Deep Convolutional Networks for Large-Scale Image Recognition

TL;DR: In this paper, the authors investigated the effect of the convolutional network depth on its accuracy in the large-scale image recognition setting and showed that a significant improvement on the prior-art configurations can be achieved by pushing the depth to 16-19 layers.
Related Papers (5)
Trending Questions (1)
What is the relationship between spiking neural networks and neuromorphics?

The paper mentions that spiking neural networks (SNNs) are more biologically realistic than artificial neural networks (ANNs) and are the better candidates to process spatio-temporal data. Additionally, SNNs combined with bio-plausible local learning rules make it easier to build low-power, neuromorphic hardware. Therefore, the relationship between SNNs and neuromorphics is that SNNs are a suitable approach for implementing neuromorphic hardware.