Convolutional networks for fast, energy-efficient neuromorphic computing

Steven K. Esser(IBM (United States)), Paul Merolla(IBM (United States)), John V. Arthur(IBM (United States)), Andrew S. Cassidy(IBM (United States)), Rathinakumar Appuswamy(IBM (United States)), Alexander Andreopoulos(IBM (United States)), David Van Den Berg(IBM (United States)), Jeffrey L. McKinstry(IBM (United States)), Timothy Melano(IBM (United States)), Davis Barch(IBM (United States)), Carmelo di Nolfo(IBM (United States)), Pallab Datta(IBM (United States)), Arnon Amir(IBM (United States)), Brian Taba(IBM (United States)), Myron Flickner(IBM (United States)), Dharmendra S. Modha(IBM (United States))
Proceedings of the National Academy of Sciences
September 20, 2016
Cited by 789Open Access
Full Text

Abstract

Deep networks are now able to achieve human-level performance on a broad spectrum of recognition tasks. Independently, neuromorphic computing has now demonstrated unprecedented energy-efficiency through a new chip architecture based on spiking neurons, low precision synapses, and a scalable communication network. Here, we demonstrate that neuromorphic computing, despite its novel architectural primitives, can implement deep convolution networks that (i) approach state-of-the-art classification accuracy across eight standard datasets encompassing vision and speech, (ii) perform inference while preserving the hardware's underlying energy-efficiency and high throughput, running on the aforementioned datasets at between 1,200 and 2,600 frames/s and using between 25 and 275 mW (effectively >6,000 frames/s per Watt), and (iii) can be specified and trained using backpropagation with the same ease-of-use as contemporary deep learning. This approach allows the algorithmic power of deep learning to be merged with the efficiency of neuromorphic processors, bringing the promise of embedded, intelligent, brain-inspired computing one step closer.


Related Papers

No related papers found

Powered by citation graph analysis