<?xml version="1.0" encoding="UTF-8" standalone="no"?>
<!DOCTYPE article PUBLIC "-//NLM//DTD Journal Publishing DTD v2.3 20070202//EN" "journalpublishing.dtd">
<article xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink" article-type="editorial">
<front>
<journal-meta>
<journal-id journal-id-type="publisher-id">Front. Neurosci.</journal-id>
<journal-title>Frontiers in Neuroscience</journal-title>
<abbrev-journal-title abbrev-type="pubmed">Front. Neurosci.</abbrev-journal-title>
<issn pub-type="epub">1662-453X</issn>
<publisher>
<publisher-name>Frontiers Media S.A.</publisher-name>
</publisher>
</journal-meta>
<article-meta>
<article-id pub-id-type="doi">10.3389/fnins.2016.00214</article-id>
<article-categories>
<subj-group subj-group-type="heading">
<subject>Neuroscience</subject>
<subj-group>
<subject>Editorial</subject>
</subj-group>
</subj-group>
</article-categories>
<title-group>
<article-title>Editorial: Synaptic Plasticity for Neuromorphic Systems</article-title>
</title-group>
<contrib-group>
<contrib contrib-type="author" corresp="yes">
<name><surname>Mayr</surname> <given-names>Christian G.</given-names></name>
<xref ref-type="aff" rid="aff1"><sup>1</sup></xref>
<xref ref-type="author-notes" rid="fn001"><sup>&#x0002A;</sup></xref>
<uri xlink:href="http://loop.frontiersin.org/people/10753/overview"/>
</contrib>
<contrib contrib-type="author">
<name><surname>Sheik</surname> <given-names>Sadique</given-names></name>
<xref ref-type="aff" rid="aff2"><sup>2</sup></xref>
<uri xlink:href="http://loop.frontiersin.org/people/26862/overview"/>
</contrib>
<contrib contrib-type="author">
<name><surname>Bartolozzi</surname> <given-names>Chiara</given-names></name>
<xref ref-type="aff" rid="aff3"><sup>3</sup></xref>
<uri xlink:href="http://loop.frontiersin.org/people/21102/overview"/>
</contrib>
<contrib contrib-type="author">
<name><surname>Chicca</surname> <given-names>Elisabetta</given-names></name>
<xref ref-type="aff" rid="aff4"><sup>4</sup></xref>
<uri xlink:href="http://loop.frontiersin.org/people/21489/overview"/>
</contrib>
</contrib-group>
<aff id="aff1"><sup>1</sup><institution>Chair of Highly-Parallel VLSI-Systems and Neuromorphic Circuits, Technische Universit&#x000E4;t Dresden</institution> <country>Dresden, Germany</country></aff>
<aff id="aff2"><sup>2</sup><institution>BioCircuits Institute, University of California, San Diego</institution> <country>San Diego, CA, USA</country></aff>
<aff id="aff3"><sup>3</sup><institution>iCub Facility, Istituto Italiano di Tecnologia</institution> <country>Genova, Italy</country></aff>
<aff id="aff4"><sup>4</sup><institution>Cognitive Interaction Technology - Center of Excellence, Faculty of Technology, Bielefeld University</institution> <country>Bielefeld, Germany</country></aff>
<author-notes>
<fn fn-type="edited-by"><p>Edited by: Timothy K. Horiuchi, The University of Maryland, USA</p></fn>
<fn fn-type="edited-by"><p>Reviewed by: Theodore Yu, Texas Instruments Inc., USA</p></fn>
<fn fn-type="corresp" id="fn001"><p>&#x0002A;Correspondence: Christian Mayr <email>christian.mayr&#x00040;tu-dresden.de</email></p></fn>
<fn fn-type="other" id="fn002"><p>This article was submitted to Neuromorphic Engineering, a section of the journal Frontiers in Neuroscience</p></fn>
</author-notes>
<pub-date pub-type="epub">
<day>19</day>
<month>05</month>
<year>2016</year>
</pub-date>
<pub-date pub-type="collection">
<year>2016</year>
</pub-date>
<volume>10</volume>
<elocation-id>214</elocation-id>
<history>
<date date-type="received">
<day>27</day>
<month>01</month>
<year>2016</year>
</date>
<date date-type="accepted">
<day>27</day>
<month>04</month>
<year>2016</year>
</date>
</history>
<permissions>
<copyright-statement>Copyright &#x000A9; 2016 Mayr, Sheik, Bartolozzi and Chicca.</copyright-statement>
<copyright-year>2016</copyright-year>
<copyright-holder>Mayr, Sheik, Bartolozzi and Chicca</copyright-holder>
<license xlink:href="http://creativecommons.org/licenses/by/4.0/"><p>This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) or licensor are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.</p></license>
</permissions>
<related-article id="RA1" related-article-type="commentary-article" xlink:href="http://journal.frontiersin.org/researchtopic/2040/synaptic-plasticity-for-neuromorphic-systems" ext-link-type="uri">The Editorial on the Research Topic <article-title>Synaptic Plasticity for Neuromorphic Systems</article-title></related-article>
<kwd-group>
<kwd>synaptic plasticity</kwd>
<kwd>neuromorphic engineering</kwd>
<kwd>memristive plasticity</kwd>
<kwd>plasticity circuits</kwd>
<kwd>digital plasticity</kwd>
<kwd>high-density plasticity</kwd>
<kwd>plasticity for sensor data</kwd>
<kwd>learning feature extraction</kwd>
</kwd-group>
<counts>
<fig-count count="0"/>
<table-count count="0"/>
<equation-count count="0"/>
<ref-count count="5"/>
<page-count count="3"/>
<word-count count="1567"/>
</counts>
</article-meta>
</front>
<body>
<p>Brain plasticity serves animals in a wide range of vital functions. It assists them in adapting their behavior to the surroundings, in learning new strategies for optimizing a certain reward-seeking policy for their survival or in adjusting motor activity through sensory feedback. Thus, plasticity is an essential ingredient for building artificial autonomous systems that can cope with the real world. In order to build these systems, neuromorphic design labs actively investigate and develop various circuit implementations of plasticity. This research topic collects a comprehensive snapshot of this work. A number of manuscripts published in this topic study the interplay between stochasticity and plasticity (<ext-link ext-link-type="uri" xlink:href="http://dx.doi.org/10.3389/fnins.2014.00377">Afshar et al.</ext-link>; <ext-link ext-link-type="uri" xlink:href="http://dx.doi.org/10.3389/fnins.2014.00412">Bill and Legenstein</ext-link>; <ext-link ext-link-type="uri" xlink:href="http://dx.doi.org/10.3389/fnins.2015.00046">Lagorce et al.</ext-link>; <ext-link ext-link-type="uri" xlink:href="http://dx.doi.org/10.3389/fnins.2015.00141">Qiao et al.</ext-link>). Plasticity here acts in a stochastic fashion or extracts features from stochastic sensor data. The current push toward higher complexity/scale in neuromorphic devices can also be observed in plasticity implementations (<ext-link ext-link-type="uri" xlink:href="http://dx.doi.org/10.3389/fnins.2015.00141">Qiao et al.</ext-link>; <ext-link ext-link-type="uri" xlink:href="http://dx.doi.org/10.3389/fnins.2015.00180">Wang et al.</ext-link>; <ext-link ext-link-type="uri" xlink:href="http://dx.doi.org/10.3389/fnins.2015.00010">Noack et al.</ext-link>). Due to advantageous technology scaling and reproducibility, digital implementations of neuromorphic plasticity are gaining popularity (<ext-link ext-link-type="uri" xlink:href="http://dx.doi.org/10.3389/fnins.2014.00429">Galluppi et al.</ext-link>; <ext-link ext-link-type="uri" xlink:href="http://dx.doi.org/10.3389/fnins.2015.00002">Vogginger et al.</ext-link>). The collection of articles in this topic is rounded out by articles on plasticity in novel nano-scale technologies (<ext-link ext-link-type="uri" xlink:href="http://dx.doi.org/10.3389/fnins.2015.00051">Saighi et al.</ext-link>; <ext-link ext-link-type="uri" xlink:href="http://dx.doi.org/10.3389/fnins.2015.00241">Thomas et al.</ext-link>; <ext-link ext-link-type="uri" xlink:href="http://dx.doi.org/10.3389/fnins.2014.00438">Wang et al.</ext-link>; <ext-link ext-link-type="uri" xlink:href="http://dx.doi.org/10.3389/fnins.2014.00412">Bill and Legenstein</ext-link>).</p>
<sec id="s1">
<title>1. Stochasticity and plasticity</title>
<p>One topic of interest in recent publications is the interaction between stochasticity and synaptic dynamics. <ext-link ext-link-type="uri" xlink:href="http://dx.doi.org/10.3389/fnins.2014.00438">Wang et al.</ext-link> introduces a stochastic synapse cell constructed with a memristor and two transistors. <ext-link ext-link-type="uri" xlink:href="http://dx.doi.org/10.3389/fnins.2014.00412">Bill and Legenstein</ext-link> show that stochastic synapses can provide graded responses from binary-valued synapses, aiding convergence in learning tasks. Stochasticity in conjunction with plasticity can also aid error tolerance. For instance, the stochastic synapse model of <ext-link ext-link-type="uri" xlink:href="http://dx.doi.org/10.3389/fnins.2014.00412">Bill and Legenstein</ext-link> can learn handwritten digits with high fidelity in the presence of significant device deviations and noise. The statistical inference in <ext-link ext-link-type="uri" xlink:href="http://dx.doi.org/10.3389/fnins.2014.00377">Afshar et al.</ext-link> actually uses deviations between individual dendrites. The visual feature extraction in <ext-link ext-link-type="uri" xlink:href="http://dx.doi.org/10.3389/fnins.2015.00046">Lagorce et al.</ext-link> operates on a high-dimensional projection of the input space through a recurrent neural network, benefitting from deviations across elements. A more conventional error-compensation approach is taken in <ext-link ext-link-type="uri" xlink:href="http://dx.doi.org/10.3389/fnins.2015.00141">Qiao et al.</ext-link>, where a network counterbalances for deviations through a learned aggregate of individual neuronal responses.</p>
</sec>
<sec id="s2">
<title>2. Plasticity operating on sensor data</title>
<p>The above mentioned <ext-link ext-link-type="uri" xlink:href="http://dx.doi.org/10.3389/fnins.2015.00141">Qiao et al.</ext-link> and <ext-link ext-link-type="uri" xlink:href="http://dx.doi.org/10.3389/fnins.2015.00046">Lagorce et al.</ext-link> also represent examples of processing and plasticity operating directly on spiking input. In fact, typical tasks that would be amenable to a neuromorphic solution have traditionally used non-spiking input, such as image processing applications exclusively using image frames (Henker et al., <xref ref-type="bibr" rid="B2">2007</xref>). Due to these incompatible representations (e.g., continuous time vs. discrete time, spikes vs. scalar values), there has not been much synergy between neuromorphic and traditional sensor processing, thus potentially missing some novel approaches in both fields. However, the two are growing closer together as sensors with spiking output are becoming more widely available in such diverse areas as vision (Delbruck, <xref ref-type="bibr" rid="B1">2008</xref>) or audition (Liu et al., <xref ref-type="bibr" rid="B4">2010</xref>). In addition to the plastic sensory processing in <ext-link ext-link-type="uri" xlink:href="http://dx.doi.org/10.3389/fnins.2015.00141">Qiao et al.</ext-link> and <ext-link ext-link-type="uri" xlink:href="http://dx.doi.org/10.3389/fnins.2015.00046">Lagorce et al.</ext-link>, the statistical inference of <ext-link ext-link-type="uri" xlink:href="http://dx.doi.org/10.3389/fnins.2014.00377">Afshar et al.</ext-link> could also be employed for sensory processing, as it is geared toward the temporal patterns of multiple input spike trains.</p>
</sec>
<sec id="s3">
<title>3. Digital implementations of plasticity</title>
<p>Neuromorphic engineering was envisioned as analog VLSI circuits, due to the similarity between the current across CMOS devices in subthreshold and across neurons ion channels. However, digital circuits benefit significantly more from technology scaling and low-power advances in deep-submicron nodes, making them attractive for neuromorphic implementations. Specifically, plasticity allows fixed, reproducible-function digital circuits to add adaptability and variation to their behavior. <ext-link ext-link-type="uri" xlink:href="http://dx.doi.org/10.3389/fnins.2014.00429">Galluppi et al.</ext-link> present a framework for plasticity implementation on a programmable digital neuromorphic system, SpiNNaker. <ext-link ext-link-type="uri" xlink:href="http://dx.doi.org/10.3389/fnins.2015.00002">Vogginger et al.</ext-link> discuss a computational optimization of a powerful learning rule, outlining an efficient implementation in a synthesized or programmable digital neuromorphic system. <ext-link ext-link-type="uri" xlink:href="http://dx.doi.org/10.3389/fnins.2014.00377">Afshar et al.</ext-link> present an FPGA implementation of a novel neuron model and an accompanying learning rule optimized for digital circuits.</p>
</sec>
<sec id="s4">
<title>4. Large scale hardware for plasticity</title>
<p>Complex real-world applications demand large, computationally capable neural networks. Consequently, there is a drive toward large scale neuromorphic hardware with plasticity. The chip of <ext-link ext-link-type="uri" xlink:href="http://dx.doi.org/10.3389/fnins.2015.00141">Qiao et al.</ext-link> is currently one of the largest devices with on-chip plasticity (256 neurons, 128k synapses, 180 nm CMOS) that employs the original subthreshold design philosophy. <ext-link ext-link-type="uri" xlink:href="http://dx.doi.org/10.3389/fnins.2015.00010">Noack et al.</ext-link> present a switched capacitor implementation of short- and long-term plasticity in 28 nm CMOS that at 3.6 &#x000D7; 3.6 &#x003BC;<italic>m</italic><sup>2</sup> is an order of magnitude smaller than any other plastic CMOS synapse. Other approaches to scaling include <ext-link ext-link-type="uri" xlink:href="http://dx.doi.org/10.3389/fnins.2015.00180">Wang et al.</ext-link>, which uses a digital time-multiplexed circuit to compute Spike Timing Dependent Plasticity (STDP) for time-multiplexed analog neurons. For large-scale networks, topological considerations also play an increasing role, e.g., in terms of which signals a plasticity circuit needs access to (e.g., pre- or post-synaptic) (Noack et al., <xref ref-type="bibr" rid="B5">2010</xref>). A neuron-synapse matrix arrangement seems the obvious choice, but the implementations in this topic explore a variety of other options.</p>
</sec>
<sec id="s5">
<title>5. Memristive plasticity</title>
<p>In terms of emerging technologies, the usage of nanoscale memristors for short- or long term plasticity has seen a large deal of interest since the pioneering work of Jo et al. (<xref ref-type="bibr" rid="B3">2010</xref>). Memristors inherently replicate aspects of synaptic plasticity and can combine plasticity, weight storage and weight effect in a single device. <ext-link ext-link-type="uri" xlink:href="http://dx.doi.org/10.3389/fnins.2015.00051">Saighi et al.</ext-link> gives an overview of recent developments in this area from a materials and neuromorphic perspective. <ext-link ext-link-type="uri" xlink:href="http://dx.doi.org/10.3389/fnins.2015.00241">Thomas et al.</ext-link> investigate tunnel junction based memristors that exhibit STDP-like plasticity. <ext-link ext-link-type="uri" xlink:href="http://dx.doi.org/10.3389/fnins.2014.00438">Wang et al.</ext-link> present a synaptic cell composed of memristor plus transistors which endows the synapse with stochastic learning capabilities. <ext-link ext-link-type="uri" xlink:href="http://dx.doi.org/10.3389/fnins.2014.00412">Bill and Legenstein</ext-link> introduce a model of an ideal stochastic memristor synapse and investigate its computational properties.</p>
</sec>
<sec id="s6">
<title>6. Summary</title>
<p>Synaptic plasticity is a crucial ingredient in neuromorphic hardware. It has the potential to contribute to many different fields, such as in the endeavor of building realistic brain models, in biohybrids where the hardware adapts to the biological counterpart or in the construction of truly cognitive systems. This research topic gives an overview of the state-of the art in plasticity circuit design and applications and outlines future research directions.</p>
</sec>
<sec id="s7">
<title>Author contributions</title>
<p>CM, EC, CB, and SS all contributed to the compilation of plasticity works described in this editorial and to the writing of the editorial.</p>
<sec>
<title>Conflict of interest statement</title>
<p>The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.</p></sec>
</sec>
</body>
<back>
<ack>
<p>This work was supported by the Excellence Cluster 227 (CITEC, Bielefeld University), the U.S. Office of Naval Research(ONR) under Grant Number N00014-13-1-0205 and the Swiss National Science Foundation under grant number P2EZP2_155561. This research has received funding from the European Union Seventh Framework Programme (FP7/2007- 2013) under grant agreement no. 269459 (CORONET), no. 612058 (RAMP) and no. 284553 (SICODE). The authors would like to thank all contributors of the Frontiers Special Topic. We wish to acknowledge R. Douglas, G. Indiveri, S. Fusi and F. Stefanini for insightful discussions.</p>
</ack>
<ref-list>
<title>References</title>
<ref id="B1">
<citation citation-type="book"><person-group person-group-type="author"><name><surname>Delbruck</surname> <given-names>T.</given-names></name></person-group> (<year>2008</year>). <article-title>Frame-free dynamic digital vision</article-title>, in <source>Proceedings of the International Symposium on Secure-Life Electronics</source>, <volume>Vol. 1</volume> (<publisher-loc>Tokyo</publisher-loc>: <publisher-name>University of Tokyo</publisher-name>).</citation>
</ref>
<ref id="B2">
<citation citation-type="other"><person-group person-group-type="author"><name><surname>Henker</surname> <given-names>S.</given-names></name> <name><surname>Mayr</surname> <given-names>C.</given-names></name> <name><surname>Schl&#x000FC;ssler</surname> <given-names>J.-U.</given-names></name> <name><surname>Sch&#x000FC;ffny</surname> <given-names>R.</given-names></name> <name><surname>Ramacher</surname> <given-names>U.</given-names></name> <name><surname>Heittmann</surname> <given-names>A.</given-names></name></person-group> (<year>2007</year>). <article-title>Active pixel sensor arrays in 90/65nm CMOS-technologies with vertically stacked photodiodes</article-title>, in <source>Proceedings IEEE International Image Sensor Workshop IIS07</source>, (<publisher-loc>Ogunquit, ME</publisher-loc>).</citation>
</ref>
<ref id="B3">
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Jo</surname> <given-names>S. H.</given-names></name> <name><surname>Chang</surname> <given-names>T.</given-names></name> <name><surname>Ebong</surname> <given-names>I.</given-names></name> <name><surname>Bhadviya</surname> <given-names>B. B.</given-names></name> <name><surname>Mazumder</surname> <given-names>P.</given-names></name> <name><surname>Lu</surname> <given-names>W.</given-names></name></person-group> (<year>2010</year>). <article-title>Nanoscale memristor device as synapse in neuromorphic systems</article-title>. <source>Nano Lett.</source> <volume>10</volume>, <fpage>1297</fpage>&#x02013;<lpage>1301</lpage>. <pub-id pub-id-type="doi">10.1021/nl904092h</pub-id></citation>
</ref>
<ref id="B4">
<citation citation-type="book"><person-group person-group-type="author"><name><surname>Liu</surname> <given-names>S.</given-names></name> <name><surname>van Schaik</surname> <given-names>A.</given-names></name> <name><surname>Minch</surname> <given-names>B.</given-names></name> <name><surname>Delbruck</surname> <given-names>T.</given-names></name></person-group> (<year>2010</year>). <article-title>Event-based 64-channel binaural silicon cochlea with q enhancement mechanisms</article-title>, in <source>Circuits and Systems (ISCAS), Proceedings of 2010 IEEE International Symposium on</source>, (<publisher-loc>Paris</publisher-loc>: <publisher-name>IEEE</publisher-name>).</citation>
</ref>
<ref id="B5">
<citation citation-type="other"><person-group person-group-type="author"><name><surname>Noack</surname> <given-names>M.</given-names></name> <name><surname>Partzsch</surname> <given-names>J.</given-names></name> <name><surname>Mayr</surname> <given-names>C.</given-names></name> <name><surname>Henker</surname> <given-names>S.</given-names></name> <name><surname>Schuffny</surname> <given-names>R.</given-names></name></person-group> (<year>2010</year>). <article-title>Biology-derived synaptic dynamics and optimized system architecture for neuromorphic hardware</article-title>, in <source>Mixed Design of Integrated Circuits and Systems (MIXDES), 2010 Proceedings of the 17th International Conference</source>, (<publisher-loc>Warsaw</publisher-loc>).</citation>
</ref>
</ref-list>
</back>
</article>
