Powering the next-generation IoT applications: New tools and emerging technologies for the development of Neuromorphic System of Systems

28.3K
views
31
authors
6
articles
Cover image for research topic "Powering the next-generation IoT applications: New tools and emerging technologies for the development of Neuromorphic System of Systems"
Editors
5
Impact
Loading...
Original Research
11 November 2022

Spatio-temporal pattern recognition is a fundamental ability of the brain which is required for numerous real-world activities. Recent deep learning approaches have reached outstanding accuracies in such tasks, but their implementation on conventional embedded solutions is still very computationally and energy expensive. Tactile sensing in robotic applications is a representative example where real-time processing and energy efficiency are required. Following a brain-inspired computing approach, we propose a new benchmark for spatio-temporal tactile pattern recognition at the edge through Braille letter reading. We recorded a new Braille letters dataset based on the capacitive tactile sensors of the iCub robot's fingertip. We then investigated the importance of spatial and temporal information as well as the impact of event-based encoding on spike-based computation. Afterward, we trained and compared feedforward and recurrent Spiking Neural Networks (SNNs) offline using Backpropagation Through Time (BPTT) with surrogate gradients, then we deployed them on the Intel Loihi neuromorphic chip for fast and efficient inference. We compared our approach to standard classifiers, in particular to the Long Short-Term Memory (LSTM) deployed on the embedded NVIDIA Jetson GPU, in terms of classification accuracy, power, and energy consumption together with computational delay. Our results show that the LSTM reaches ~97% of accuracy, outperforming the recurrent SNN by ~17% when using continuous frame-based data instead of event-based inputs. However, the recurrent SNN on Loihi with event-based inputs is ~500 times more energy-efficient than the LSTM on Jetson, requiring a total power of only ~30 mW. This work proposes a new benchmark for tactile sensing and highlights the challenges and opportunities of event-based encoding, neuromorphic hardware, and spike-based computing for spatio-temporal pattern recognition at the edge.

6,442 views
37 citations
3,450 views
16 citations
Recommended Research Topics
Frontiers Logo

Frontiers in Neuroscience

Recent Advances of Deep Spiking Neural Networks and Neuromorphic Computation for Computer Vision
Edited by Nikola K Kasabov, Maryam Doborjeh, Zeng-Guang Hou, WEIQI YAN, Jie Yang
36.8K
views
14
authors
6
articles
Frontiers Logo

Frontiers in Neuroscience

Digital Neuromorphic System with Online Learning: Algorithms, Implementation, and Large-scale Design
Edited by Shuangming Yang, Mostafa Rahimi Azghadi, Jungong Han
16.3K
views
36
authors
5
articles
Frontiers Logo

Frontiers in Neurorobotics

Neuromorphic Engineering for Robotics
Edited by Zhenshan Bing, Alois C Knoll, Chenguang Yang
25.1K
views
23
authors
5
articles
Frontiers Logo

Frontiers in Neuroscience

Neuromorphic Engineering Integration from Materials and Devices to System and Algorithm
Edited by Joon Young Kwak, SangBum Kim
10K
views
12
authors
4
articles
Frontiers Logo

Frontiers in Neuroscience

Emerging Talents in Neuromorphic Engineering
Edited by Horacio Rostro Gonzalez, Juan Pedro Dominguez-Morales, Fernando Perez-Peña, Bernard GIRAU
11.6K
views
15
authors
5
articles