HYPOTHESIS AND THEORY article
Patterned brain stimulation, what a framework with rhythmic and noisy components might tell us about recovery maximization
- 1Neurology, Vision and Motor Systems Research Group, Charité – Universitätsmedizin Berlin, Berlin, Germany
- 2Neuronale Informationsverarbeitung, Fakultät (IV) Elektrotechnik und Informatik, Technische Universität Berlin, Berlin, Germany
Brain stimulation is having remarkable impact on clinical neurology. Brain stimulation can modulate neuronal activity in functionally segregated circumscribed regions of the human brain. Polarity, frequency, and noise specific stimulation can induce specific manipulations on neural activity. In contrast to neocortical stimulation, deep-brain stimulation has become a tool that can dramatically improve the impact clinicians can possibly have on movement disorders. In contrast, neocortical brain stimulation is proving to be remarkably susceptible to intrinsic brain-states. Although evidence is accumulating that brain stimulation can facilitate recovery processes in patients with cerebral stroke, the high variability of results impedes successful clinical implementation. Interestingly, recent data in healthy subjects suggests that brain-state dependent patterned stimulation might help resolve some of the intrinsic variability found in previous studies. In parallel, other studies suggest that noisy “stochastic resonance” (SR)-like processes are a non-negligible component in non-invasive brain stimulation studies. The hypothesis developed in this manuscript is that stimulation patterning with noisy and oscillatory components will help patients recover from stroke related deficits more reliably. To address this hypothesis we focus on two factors common to both neural computation (intrinsic variables) as well as brain stimulation (extrinsic variables): noise and oscillation. We review diverse theoretical and experimental evidence that demonstrates that subject-function specific brain-states are associated with specific oscillatory activity patterns. These states are transient and can be maintained by noisy processes. The resulting control procedures can resemble homeostatic or SR processes. In this context we try to extend awareness for inter-individual differences and the use of individualized stimulation in the recovery maximization of stroke patients.
With 65,133 deaths in 2006, stroke ranked third place among all causes of death (7.9%) in Germany. The annual stroke incidence rate is approximately 120 per 100,000 adjusted to the European population (European Registers of Stroke et al., 2009), leading to about 100,000 new strokes in Germany per year and leaving about one million people with residual impairments. Globally an estimated 30.7 million people have survived stroke and stroke is considered to be the primary cause of disability (Norrving and Kissela, 2013). Spontaneous recovery after a cerebral insult is generally insufficient, the success of post-stroke rehabilitation is highly limited and novel therapeutic options are lacking (Wolfe et al., 2011). About 42% of stroke patients require rehabilitative and 25% inpatient care (Toschke et al., 2010) with paresis being one of the most disabling and important factors in stroke outcome (Toschke et al., 2010).
Increasing evidence summarized in a number of independent editorials and reviews supports the use of non-invasive brain stimulation (NBS) to maximize the speed and success of spontaneous recovery processes after stroke (Hallett, 2005; Talelli and Rothwell, 2006; Hummel et al., 2008; Nitsche et al., 2008; Nowak et al., 2010; Bastani and Jaberzadeh, 2012). Yet, in contrast to the successful clinical implementation of deep-brain stimulation in the therapy of movement disorders, it seems evident that NBS therapy regimes are still experimental and will require further robust refinement before entering standard clinical care (Hallett, 2005; Hummel et al., 2008; Nitsche et al., 2008; Plow et al., 2009; Grefkes and Fink, 2012). The lack of robust results and necessity of further refinement could be due to various factors. For example, the stimulus paradigm, the optimal time point, the duration, the hemisphere, and region or regions of stimulation as well as how these factors might interact with the level of impairment, type of impairment, patient age and the dynamics of inhibition, and excitation reflecting different stages of recovery processes (Dimyan and Cohen, 2011; Schulz et al., 2013). Conversely, there is a wide consensus that promising developments are the combination of NBS with subject or recovery specific factors such as physiotherapy and sensory input (Dimyan and Cohen, 2011; Schulz et al., 2013) or brain-computer interface decoding of sensorimotor brain-states (Jackson and Zimmermann, 2012). This demonstrates that the understanding of the underlying mechanisms of NBS is still incomplete and that the manipulation of subject and function specific factors will gain on importance for recovery maximization in neurobiological diseases (see also Plow et al., 2009). Interestingly, recent findings suggest that a reappraisal of the neurophysiological mechanisms of NBS with regards to their frequency components might help resolve the challenge of subject-function specific stimulation. Here, patterned stimulation is providing promising results in brain-state1 specific modulations in cognitive neuroscience (Thut et al., 2012). In parallel, noisy or “stochastic resonance” (SR)-like processes have been suggested to provide a common framework component that can reconcile previous contradictory findings in NBS studies (Harris et al., 2008; Schwarzkopf et al., 2011). Together, these findings suggest that oscillation and noise are both components in a common framework that require further investigation. Thus we review theoretical and experimental evidence to address the following questions. Which patterns of stimulation might optimally modify brain-states associated with motor recovery in stroke patients? What evidence is there that noise induced resonance effects are a component? This being established, we will argue that a closed-loop optimization of a state-variable (similar to brain-computer interface decoding) is a promising approach to optimally configure patterned NBS paradigms.
Neural Oscillations and Noise
Intrinsic Sources of Oscillations
The first of many band-width confined EEG pattern’s reflecting brain rhythms described were α (∼8–12 Hz) waves (Berger, 1929). Subsequent research found that these EEG pattern’s reflect neural oscillations in a system of dynamically coupled brain oscillators, each defined by the intrinsic ability of single neurons to resonate at specific frequencies, the physical architecture of a given neuronal network, and its computational restraints due to axon conductance and synaptic delay (Buzsaki and Draguhn, 2004). An oscillator (single neurons and networks) is predominantly characterized by its eigenfrequency, showing its ability to resonate in a sharply tuned frequency band. In neurons, the required band-pass characteristic is delineated by neuronal membrane capacitance and leakage currents (forming a low-pass filter) and neuron specific voltage-gated currents (acting as a high-pass filter), with which it responds to a significant input (Llinas, 1988; Hodgkin and Huxley, 1990; Hutcheon and Yarom, 2000; Augustin et al., 2013).
Oscillations are Associated with Specific Information Transmission
The adaptive tuning of high- and low-pass filtering enables the brain to subsequently construct and maintain a multitude of different band-width-confined communication channels associated with specific functions spanning from the amplification of weak signals over the reduction of environmental input to the focusing on a specific input (Buzsaki and Draguhn, 2004). The brain architecture encoding this communication is understood to utilize highly interconnected local neuron arrays (hypercolumns) sparsely interconnected by long-range connections. Within this “small-world” architecture (Watts and Strogatz, 1998; Sporns et al., 2004; Yu et al., 2008), the most energy efficient mechanism to flexibly integrate multiple segregated neuron assemblies is transient synchronization by oscillation (i.e., phase-locking Engel et al., 2001; see Figure 1). This highly dynamic integrative process is viewed as the mechanism linking single neuron activity to motor output and behaviors (see in review Buzsaki and Draguhn, 2004).
Figure 1. Cartoon of network dynamics showing noise induced switching of transient communication channels. At start, a network is synchronized with network b. Noise than induces a phase shift in b, thus desynchronizing this channel and synchronizing a with c. Noise can also induce oscillation in d synchronizing it with e. F Could principally also synchronize with d and e, but is currently in its different oscillation mode.
Different Bandwidths are Associated with Different Aspects of Motor Function
Neuronal oscillators resonate between 0.05 and 500 Hz (Buzsaki and Draguhn, 2004), macroscopic brain oscillations synchronize between up to at least 200 Hz (Grenier et al., 2001). In the motor system the most evident bandwidth is the β (or high rolandic μ) rhythm. -oscillations are understood to facilitate long-range interactions between distant network nodes (Donner and Siegel, 2011) signaling predominantly the maintenance of status quo or steady-motor output in a sensorimotor behavioral loop2(Farmer et al., 1993; Salenius and Hari, 2003; Baker, 2007; Faisal et al., 2008; Engel and Fries, 2010). In contrast, γ-oscillations are understood to reflect more focal (Donner and Siegel, 2011) neural activity related to contraction strength (Salenius and Hari, 2003), attention processes, movement preparation (Pfurtscheller et al., 2003) and execution (Baker, 2007; Engel and Fries, 2010; van Wijk et al., 2012), faster reaction times (Joundi et al., 2012), and heightened cortico-fugal output efficiency (Schoffelen et al., 2005) as well as motor learning (Brown, 2000; van Wijk et al., 2012). Recent evidence shows that non-invasive stimulatory entrainment of β-oscillations slows whereas entrainment of γ-oscillations expedites motor performance in simple tasks (Joundi et al., 2012). Motor performance in more complex tasks, requiring sensorimotor short-term memory integration, was susceptible to phase-dependent entrainment of θ- but not β-oscillations in a frontoparietal network (Polania et al., 2012). Thus a common small-world like wired framework (Watts and Strogatz, 1998) can be understood to confer frequency-division multiplex3 coherent (Engel et al., 2001) information from neural oscillator assemblies between distant motor nodes to form brain-state’s translating neural activity into simple or complex motor tasks and behavior (Brown and Marsden, 2001; Varela et al., 2001; Brown, 2003; Schoffelen et al., 2005; Engel and Fries, 2010; Donner and Siegel, 2011).
The Role of Noise
Why should one include noise when utilizing NBS to improve restitution? The better question might be: “could we afford to exclude it”? To address these questions we have to define what exactly is meant by the term “neural noise,” which: (i) sums up all neural activity which could not directly be associated with a specific function but may be part of the signal instead of random noise (Stein et al., 2005), (ii) is not constant, i.e., the level of noise differs with respect to brain-states (Misic et al., 2010) and extrinsic input (Harris and Wolpert, 1998), and (iii) is always present, throughout all systems in the whole brain (Shadlen and Newsome, 1994; Ermentrout et al., 2008; Clarke, 2012). It is therefore important to understand if the brain is just robust against noise – which is undisputed – or if it utilizes noise, meaning that neural noise is an important and necessary system ingredient (Shadlen and Newsome, 1994; Friston, 1997; Lindner, 2004; Stein et al., 2005; Sejnowski and Paulsen, 2006; Ermentrout et al., 2008; McDonnell and Ward, 2011). Conjecturing that the brain is a system utilizing distinct frequencies from null to above 200 Hz as possible communication channels and that the selection of “active” channels is done via phase-locking, the question is which mechanism putatively acts as the “switch”? To put it more blatantly: could neural noise (in the notion of a complex, not understood, and non-random mechanism) act as the controller of communications in the brain (Horsthemke and Lefever, 1984; Neiman et al., 1999; Sosnovtseva et al., 2001; Misic et al., 2010)?
Intrinsic Sources of Noise
In the behavioral loop noise is generated at multiple stages: i.e., sensory, cellular, and motor noise. The central cellular noise can be decomposed into electrical and synaptic noise (Calvin and Stevens, 1968). In the absence of input, electrical noise is produced by random opening and closing of voltage- or ligand-gated ion channels (White et al., 2000) or changes in membrane resistance (Yarom and Hounsgaard, 2011) as well as cross-over talk due to the activity of nearby neurons (ephaptic couplings Debanne, 2004), after extensive electrical signaling or spillover of neurotransmitters). This noise can affect the initiation (Bryant and Segundo, 1976), timing (Mainen and Sejnowski, 1995; Schneidman et al., 1998), and propagation (Diba et al., 2006) of action potentials in the neural network. In contrast, synaptic noise is associated with an intense bombardment from thousands of synapses and a large number of unresolved mechanisms (Moss et al., 2004) that provide a sigmoidal transition from attenuating and facilitating signal transmission in a neural network (Destexhe and Contreras, 2006). Networks of neurons dynamically control and utilize noise effects by homeostatic adjusting of local synaptic strengths and ion-channel expression or neuromodulator release as well as global wiring strategies (Faisal et al., 2008).
Computational Modeling Exploits Putative Functions of Noise
Stochastic resonance (Benzi et al., 1981) is one of the most widely investigated phenomena associated with attenuation and amplification by neural noise (Hanggi, 2002; Moss et al., 2004; Ward et al., 2010; Durrant et al., 2011; Mejias and Torres, 2011; Schwarzkopf et al., 2011; Torres et al., 2011). Traditionally defined SR describes sub-threshold signal transmission in the presence of an optimal noise level in dynamic non-linear excitable systems but has been recently extended to “stochastic facilitation” (McDonnell and Abbott, 2009) relaxing the strict sub-threshold signal constrictions in SR to be of (even) more practical use. Although such reliable signal transmission is an important factor, it becomes even more interesting when observing the complex dynamics of excitable systems. First of all, it’s important to note, that noise-free systems of coupled oscillators are generally unstable (Strogatz and Mirollo, 1991). In the presence of noise, the state space of these systems becomes richer, introducing new oscillatory states (Horsthemke and Lefever, 1984; Timme et al., 2002; Ostojic et al., 2009). It has been shown that noise: (i) can “switch” between these states (Neiman et al., 1999; Bascones et al., 2002; Misic et al., 2010), (ii) induces oscillations itself (Zhou et al., 2003; Ermentrout et al., 2008; Ghosh et al., 2008), and (iii) enhances phase synchronization (Neiman et al., 1999) as well as de-synchronization (Kurrer and Schulten, 1995). When considering realistically large coupled excitable systems of model neurons, the presence of noise leads to a clustering of frequencies (Postnov et al., 2001; Sosnovtseva et al., 2001; Brunel and Hansel, 2006; Deco et al., 2009), i.e., neurons form groups characterized by (almost) the same “stochastic eigenfrequency.” The number of such clusters strongly depends on the distribution interval of coupling, the larger the coupling the less clusters form. Interestingly a relaxed notion of phase-locking is sufficient for this phenomenon to occur (Sosnovtseva et al., 2001). Kurrer and Schulten (1995) have shown, that the role of noise in a system of coupled excitable systems is twofold: in the low-noise transition, noise induces synchronicity, while in the high-noise transition it leads to a loss of coherency (de-synchronization), following a sigmoid transition function between synchronization and de-synchronization. There is a large number of experimental data supporting this model in different systems throughout the whole brain and various species (Bezrukov and Vodyanoy, 1995; Gutkin et al., 2009). Considering these results, it seems not too farfetched to look upon noise as a powerful control mechanism over neural computation (see also McDonnell and Ward, 2011) for an elaboration on “stochastic facilitation.”
Thus, under the assumption that a general framework exists that sufficiently explains NBS related variability, these modeling results and experimental findings show that neural noise is not just there but in contrast has a very prominent role in controlling neural communication. This control manifests through the induction of oscillations and phase synchronization and de-synchronization, thus providing a switching agent between transient oscillatory brain-states (Destexhe and Contreras, 2006) known to require activity dependent control mechanisms (Bienenstock et al., 1982; Abraham, 2008).
Non-Invasive Brain Stimulation
Non-Invasive Brain Stimulation, Mode-of-Action
Transcranial brain stimulation encompasses various tools that can induce long-term neural plastic changes (Ahissar et al., 1992; Huang et al., 2005; Paulus, 2011), modulate neural noise (Harris et al., 2008; Terney et al., 2008), and entrain cortical neuronal assemblies to frequency-specific oscillatory input (Zaehle et al., 2010; Thut et al., 2012). For example, transcranial direct current stimulation (tDCS) effects are typically related to elevated/decreased firing rates in neuronal structures (Creuzfeldt and Struck, 1962; Bindman et al., 1964) with after-effects analogous to long-term potentiation (LTP) and depression (LTD) (Nitsche and Paulus, 2000). Transcranial alternating current stimulation (tACS) is understood to be associated with the modulation of neural oscillations associated with powerful and coherent synchronization in cortico-thalamo-cortical loops (Terney et al., 2008), conducive of information processing and storage (Sejnowski and Paulsen, 2006). Transcranial random noise stimulation (tRNS) effects could possibly be associated with various mechanisms, e.g., high frequency oscillations (80–200 Hz ripples) related to plasticity processes (Grenier et al., 2001; Ponomarenko et al., 2008), repetitive opening of Na+ channels (Schoen and Fromherz, 2008) or elevated firing rates due to noisy inputs related to SR (Moss et al., 2004; Antal et al., 2008). Repetitive transcranial magnetic stimulation (rTMS) with longer trains of low (0.2–1 Hz) or high (>5 Hz) frequency stimulation have been shown to cause longer-lasting decrease or increase in brain excitability, respectively (Pascual-Leone et al., 1994; Khedr et al., 2007). These effects can be expedited with repetitive (5 Hz “theta”) trains of short high frequency (∼50 Hz) bursts delivered either intermittently or continuously (Theta-burst stimulation, Huang et al., 2005). The carry-over effects induced by rTMS are typically also understood to reflect LTP- and LTD-like effects, although the variability of findings provide some uncertainty about the underlying mechanisms (Huang et al., 2005; Paulus, 2005; Pell et al., 2011). Interestingly, recent studies suggest noise as a missing component in a common framework of TMS that can successfully reconcile previous seemingly contradictory findings of both impairment and facilitation (Schwarzkopf et al., 2011). Similarly, recent stimulation studies provide evidence that stimulation-frequency and -state dependencies can help reconcile inhibitory and facilitatory (Huang et al., 2005; Antal et al., 2007; Rothkegel et al., 2010) as well as subject-function specific variability (Schmidt and Lee, 2005; Plow et al., 2009; Thut and Pascual-Leone, 2010). In summary, both weak- and high-voltage transcranial stimulation can in some cases induce LTD- and LTP-like effects (Huang et al., 2005; Paulus, 2011), yet the underlying mechanisms are unclear and a common framework unifying oscillatory and noisy action-modes has not been studied.
Oscillatory Multiplex Stimulation Opens “Communication Channels”
It is well established that NBS is related to brain-states associated with brain functions or dysfunctions amenable to specific modulation by NBS (Siebner et al., 2010; Thut et al., 2012). Rhythmic NBS can assert an instantaneous and transient modulation (synchronize or desynchronize) of ongoing brain oscillations. Longer application will assert longer modulation, entrainment of specific frequencies and after-effects (Moliadze et al., 2010a; Zaehle et al., 2010; Joundi et al., 2012; Thut et al., 2012; Schmidt et al., 2013). Yet the situation seems more complex, as brain-states are characterized by a weighted-mixture of multiple coherent oscillatory processes (Engel et al., 2001; Varela et al., 2001) and modification might imply stimulation in multiple bandwidths. In line with this notion, recent data could demonstrate that multiplex patterned stimulation modulates specific brain-states resulting in specific behavior modifications (Thut et al., 2012). These results have led to the notion that the patterning of NBS can open communication channels defining (electrophysiological) specific finger-prints4 of brain function and dysfunction (Thut et al., 2012).
Noisy Stimulation, a “Control Mechanism” in a Common Framework
In contrast to oscillatory stimulation relatively few studies have addressed noisy or stochastic stimulation. In support of the notion that noise plays a specific role in brain computations and stimulation, tRNS has been shown to induce carry-over effects suggestive of neural adaptation (Moliadze et al., 2010b, 2012; Schwarzkopf et al., 2011). Yet, bi-directional manipulations well established for tDCS were lacking for tRNS. Initial, possibly misleadingly, tRNS results found only positive carry-over effects (Antal et al., 2008; Terney et al., 2008). Otherwise, both tDCS and tRNS were understood to modulate the firing rate probability possibly by membrane de-polarization (Paulus, 2011). These findings were possibly rectified by recent comparison of tDCS and tRNS, which show an “unexpected” similarity between tDCS and tRNS (Moliadze et al., 2010b) and stimulus strength dependent bi-directional effects also for tRNS (Moliadze et al., 2012). Similar to low-voltage tRNS, high-voltage TMS results might be related to the induction of noisy processes in the brain (Harris et al., 2008; Schwarzkopf et al., 2011). For example, the finding of stimulus (noise) strength dependent bi-directional results were suggested not only to reflect SR processes but also to provide a missing component in a framework that can reconcile previous apparently contradictory findings (Schwarzkopf et al., 2011). Despite emerging evidence for possible similarities between different forms of NBS (strength dependent bi-directional carry-over effects) it is still unresolved how exactly noisy stimulation might affect brain computations.
Given computational evidence that neural noise is related to sigmoidal bi-directional control mechanisms (Destexhe and Contreras, 2006), mode-of-action evidence that both tDCS and tRNS modify firing rates and recent evidence that both TMS and tRNS induce noise strength dependent bi-directional effects, we argue that noisy processes are indicative of metaplastic homeostatic control mechanisms (see also Hamada et al., 2008). This being said, the Bienenstock, Cooper, and Munro model (BCM) is currently considered to be the most influential theory of synaptic plasticity (Bienenstock et al., 1982). The vital extension is a sigmoidal metaplastic control component that can potentiate and depress synaptic plasticity and contain runaway potentiation or depression (Abraham, 2008). An association between homeostatic metaplasticity, the BCM model and NBS driven manipulations has been established in various studies with various forms of high- and low-voltage stimulation (Gentner et al., 2008; Hamada et al., 2008; Ziemann and Siebner, 2008; Jung and Ziemann, 2009; Fricke et al., 2011). Similarly well established is the association of noisy processes with a sigmoidal transformation of all-or-none spike-probability response curves and control mechanisms that are either highly beneficial or detrimental for network computations (Destexhe and Contreras, 2006). A noise dependent homeostatic component could reconcile previous contradictory NBS findings from various NBS methods. For example, it would explain the finding of only positive effects after weak (<1 mA) tRNS (Terney et al., 2008; Chaieb et al., 2011), bi-directional results for weaker and stronger TMS (Schwarzkopf et al., 2011) or tRNS (Moliadze et al., 2012), and the unexpected finding of similar effects for tDCS and tRNS in direct comparison (Moliadze et al., 2010b).
Patterned Brain Stimulation Studies, What Might Rhythmic and Noisy Stimulation Tell Us about Restitution?
In stroke patients, clinical scores are the gold-standard to monitor the success of recovery (Cramer et al., 2011; Schulz et al., 2013). These scores are reliable, modality-specific, and time demanding. In NBS studies, changes in motor performance are most often quantified with behavioral measures, which typically capture fine motor skills that use smaller muscles to perform discrete precise tasks (Schmidt and Lee, 2005). These measures result in quantifiable results related to finger-tapping speed, muscle fatigue, pinch-strength or simple-, choice-, and serial-reaction times (Leocani et al., 1997, 2000; Manganotti et al., 1998). In comparison neurophysiologic measures (e.g., neural oscillations or cortico-spinal coupling) are fast, continuous, modality-specific (Brown and Marsden, 2001) and reflect fine motor skills (Halliday et al., 1998; Engel and Fries, 2010), motor learning processes (van Wijk et al., 2012), and can found in the absence or independent of behavioral measures (Laureys et al., 2001; Brown, 2003; Schoffelen et al., 2005; Fang et al., 2009; Donner and Siegel, 2011). They can also capture the dynamics of recovery processes (Brown, 2003; Strens et al., 2004; Swayne et al., 2008; Fang et al., 2009; Engel and Fries, 2010; Thut et al., 2012) and have successfully controlled brain-computer interfaces supporting patients-driven rehabilitation in neurological disease (Jackson and Zimmermann, 2012). Within this framework recovery can be conceptualized as the reestablishment of functional from dysfunctional brain-states (Hummel et al., 2008; Jackson and Zimmermann, 2012; Thut et al., 2012) and recovery maximization as the facilitation of spontaneous (coherent) neural processes driving the transition between these two states (Hummel et al., 2008; Jackson and Zimmermann, 2012; Thut et al., 2012). Thus, although data is missing to detail the characteristics of transitional states, there is ample evidence that post-stroke recovery processes should be amenable to patterned stimulation and that patterned stimulation should provide more specific stimulation effects.
It is well established that NBS can modify cortical excitability and that the manipulation of cortical excitability can maximize recovery processes (Hallett, 2005; Talelli and Rothwell, 2006; Nitsche et al., 2008) with a reported 8–30% range in functional improvement in patients recovering from stroke (Hummel et al., 2008). A classic example for NBS induced recovery maximization, is the therapeutic reduction of pathological contralesional hyperexcitability associated (transcallosal) with stroke induced ipsilesional hypoexcitability. This interhemispheric “disinhibition” phenomenon has been shown to be negatively and its therapeutic reduction with NBS positively associated with a patient’s outcome (Murase et al., 2004; Hummel et al., 2008). Similarly, the facilitation of ipsilesional excitability (Kim et al., 2006, 2010) or simultaneous bi-hemispheric combined stimulation (Lindenberg et al., 2010) have provided promising results supporting the notion of pathological interhemispheric competition and its role in rehabilitation (Schulz et al., 2013). Yet future studies will need to resolve controversies related to the individual tailoring of NBS, i.e., patient stratification according to type, extent of clinical deficit, recovery stage, lesion location and size, patient age, and gender (Hummel et al., 2008). Similarly, it has also been suggested that adjunctive NBS should be combined with simultaneous physiological input (sensory or physiotherapy). Alternatively, one can address the experimental basis of NBS to resolve these controversies. This would imply understanding the underlying mechanism to define the optimal stimulus parameters (Hummel et al., 2008). Here we argue, that the optimal stimulus parameters can be estimated relative to a state-variable of interest (e.g., pinch-strength or some brain-state of motor function) and that the underlying mechanism can be adequately described by noisy and oscillatory neural processes. The hypothesis is that optimal patterning of NBS to drive noisy and oscillatory brain rhythms, i.e., stimulation tailored on-the-fly, are essential for recovery maximization.
It is presently unclear if this might involve potentiating the μ rhythm (Jackson and Zimmermann, 2012), γ rhythm (Schoffelen et al., 2005), or multiplex brain-states reflecting function, dysfunction, or recovery in the central motor system (Brown and Marsden, 2001; Thut and Pascual-Leone, 2010). Despite positive results in a large body of pilot studies, clinical class I evidence has recently been provided in two independent studies that generic rTMS stimulation did not suffice to maximize recovery in stroke patients (Kakuda et al., 2012; Talelli et al., 2012). Conversely, patterned stimulation is providing information about finger-prints in cognitive processes (Thut et al., 2011), brain-computer interface decoding is advancing neurorehabilitation (Jackson and Zimmermann, 2012), deep-brain stimulation must control for frequency dependent side effects (Fogelson et al., 2005), and closed-loop stimulation successfully controls epilepsy in the rat (Berenyi et al., 2012). Finally the proposed framework is in line with a general notion that NBS (homeostatic priming) in combination with peripheral input (inducing a recovery related brain-state) is likely best suited to successfully maximize the speed and duration of spontaneous restitution (Chen et al., 2002; Nowak et al., 2010; Kakuda et al., 2012; Schulz et al., 2013). Thus, in review of a wide variety of data we find that patterned NBS is a promising procedure that could account for many brain-state dependent factors responsible for variability in previous recovery maximization studies. The challenge is to get the right patterning.
Since it is unclear how exactly NBS affects cortical structures and how to correctly pattern NBS to modify a given subject-function specific “finger-print,” we propose a promising, yet simple solution to this seemingly complex problem: i.e., a stimulation algorithm that quickly adapts stimulation patterning online in a closed-loop procedure utilizing a predefined state-variable (behavioral or electrophysiological) associated with motor recovery – similar to a simple brain-computer interface (Jackson and Zimmermann, 2012) (see Figure 2). This allows not only for the elimination of ill-defined prerequisites, but – by careful analysis of stimulus characteristics and their effects on the motor performance – it also provides the enticing perspective to obtain information about the temporo-spatial dynamics of brain-states and their role in motor control, plasticity, and restitution in stroke patients.
Figure 2. In order to formulate a closed-loop approach for different stimulation paradigms, the following components are needed: (i) a set of stimulation parameters, common to all methods (e.g., stimulus strength per frequency), (ii) a measure of success (e.g., cortico-muscular coherence), and (iii) a means of adapting the stimulation parameters utilizing this measure.
Conflict of Interest Statement
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
- ^Brain states are understood to reflect instantaneous and transient couplings of neural networks due to phase-locked coupling of bandwidth-confined coherent oscillations.
- ^The sensorimotor sampling loop is understood to collect sensory data necessary for guiding movements (MacKay, 1997).
- ^Frequency-division multiplexing in neural networks describes the communication of several signals over a single medium by sending in several distinct frequency ranges, see, e.g., Thut et al. (2011).
- ^Brain-states are reproducible function specific brain patterns. But, no two subject’s brain patterns are identical. Finger-prints, highly reproducible subject specific entities, are understood to circumscribe the subject specificity of brain-states.
Ahissar, E., Vaadia, E., Ahissar, M., Bergman, H., Arieli, A., and Abeles, M. (1992). Dependence of cortical plasticity on correlated activity of single neurons and on behavioral context. Science 257, 1412–1415. doi:10.1126/science.1529342
Antal, A., Boros, K., Poreisz, C., Chaieb, L., Terney, D., and Paulus, W. (2008). Comparatively weak after-effects of transcranial alternating current stimulation (tACS) on cortical excitability in humans. Brain Stimul. 1, 97–105. doi:10.1016/j.brs.2007.10.001
Antal, A., Terney, D., Poreisz, C., and Paulus, W. (2007). Towards unravelling task-related modulations of neuroplastic changes induced in the human motor cortex. Eur. J. Neurosci. 26, 2687–2691. doi:10.1111/j.1460-9568.2007.05896.x
Bascones, R., Garcia-Ojalvo, J., and Sancho, J. M. (2002). Pulse propagation sustained by noise in arrays of bistable electronic circuits. Phys. Rev. E Stat. Nonlin. Soft Matter Phys. 65, 061108. doi:10.1103/PhysRevE.65.061108
Bastani, A., and Jaberzadeh, S. (2012). Does anodal transcranial direct current stimulation enhance excitability of the motor cortex and motor function in healthy individuals and subjects with stroke: a systematic review and meta-analysis. Clin. Neurophysiol. 123, 644–657. doi:10.1016/j.clinph.2011.08.029
Bienenstock, E. L., Cooper, L. N., and Munro, P. W. (1982). Theory for the development of neuron selectivity: orientation specificity and binocular interaction in visual cortex. J. Neurosci. 2, 32–48.
Bindman, L. J., Lippold, O. C., and Redfearn, J. W. (1964). The action of brief polarizing currents on the cerebral cortex of the rat (1) during current flow and (2) in the production of long-lasting after-effects. J. Physiol. (Lond.) 172, 369–382.
Chaieb, L., Paulus, W., and Antal, A. (2011). Evaluating aftereffects of short-duration transcranial random noise stimulation on cortical excitability. Neural Plast. 2011, 105927. doi:10.1155/2011/105927
Cramer, S. C., Sur, M., Dobkin, B. H., O’Brien, C., Sanger, T. D., Trojanowski, J. Q., et al. (2011). Harnessing neuroplasticity for clinical applications. Brain 134, 1591–1609. doi:10.1093/brain/awr039
Creuzfeldt, O., and Struck, G. (1962). Neurophysiology and morphology of the chronically isolated cortical islet in the cat: brain potentials and neuron activity of an isolated nerve cell population without afferent fibers. Arch. Psychiatr. Nervenkr. Z. Gesamte Neurol. Psychiatr. 203, 708–731.
Deco, G., Jirsa, V., McIntosh, A. R., Sporns, O., and Kotter, R. (2009). Key role of coupling, delay, and noise in resting brain fluctuations. Proc. Natl. Acad. Sci. U.S.A. 106, 10302–10307. doi:10.1073/pnas.0901831106
Durrant, S., Kang, Y., Stocks, N., and Feng, J. (2011). Suprathreshold stochastic resonance in neural processing tuned by correlation. Phys. Rev. E Stat. Nonlin. Soft Matter Phys. 84, 011923. doi:10.1103/PhysRevE.84.011923
European Registers of Stroke (EROS) Investigators, Heuschmann, P. U., Di Carlo, A., Bejot, Y., Rastenyte, D., Ryglewicz, D., et al. (2009). Incidence of stroke in Europe at the beginning of the 21st century. Stroke 40, 1557–1563. doi:10.1161/STROKEAHA.108.535088
Fang, Y., Daly, J. J., Sun, J., Hvorat, K., Fredrickson, E., Pundik, S., et al. (2009). Functional corticomuscular connection during reaching is weakened following stroke. Clin. Neurophysiol. 120, 994–1002. doi:10.1016/j.clinph.2009.02.173
Farmer, S. F., Bremner, F. D., Halliday, D. M., Rosenberg, J. R., and Stephens, J. A. (1993). The frequency content of common synaptic inputs to motoneurones studied during voluntary isometric contraction in man. J. Physiol. (Lond.) 470, 127–155.
Fogelson, N., Kuhn, A. A., Silberstein, P., Limousin, P. D., Hariz, M., Trottenberg, T., et al. (2005). Frequency dependent effects of subthalamic nucleus stimulation in Parkinson’s disease. Neurosci. Lett. 382, 5–9. doi:10.1016/j.neulet.2005.02.050
Fricke, K., Seeber, A. A., Thirugnanasambandam, N., Paulus, W., Nitsche, M. A., and Rothwell, J. C. (2011). Time course of the induction of homeostatic plasticity generated by repeated transcranial direct current stimulation of the human motor cortex. J. Neurophysiol. 105, 1141–1149. doi:10.1152/jn.00608.2009
Gentner, R., Wankerl, K., Reinsberger, C., Zeller, D., and Classen, J. (2008). Depression of human corticospinal excitability induced by magnetic theta-burst stimulation: evidence of rapid polarity-reversing metaplasticity. Cereb. Cortex 18, 2046–2053. doi:10.1093/cercor/bhm239
Ghosh, A., Rho, Y., McIntosh, A. R., Kotter, R., and Jirsa, V. K. (2008). Noise during rest enables the exploration of the brain’s dynamic repertoire. PLoS Comput. Biol. 4:e1000196. doi:10.1371/journal.pcbi.1000196
Gutkin, B. S., Jost, J., and Tuckwell, H. C. (2009). Inhibition of rhythmic neural spiking by noise: the occurrence of a minimum in activity with increasing noise. Naturwissenschaften 96, 1091–1097. doi:10.1007/s00114-009-0570-5
Halliday, D. M., Conway, B. A., Farmer, S. F., and Rosenberg, J. R. (1998). Using electroencephalography to study functional coupling between cortical activity and electromyograms during voluntary contractions in humans. Neurosci. Lett. 241, 5–8. doi:10.1016/S0304-3940(97)00964-6
Hamada, M., Terao, Y., Hanajima, R., Shirota, Y., Nakatani-Enomoto, S., Furubayashi, T., et al. (2008). Bidirectional long-term motor cortical plasticity and metaplasticity induced by quadripulse transcranial magnetic stimulation. J. Physiol. (Lond.) 586, 3927–3947. doi:10.1113/jphysiol.2008.152793
Hanggi, P. (2002). Stochastic resonance in biology. How noise can enhance detection of weak signals and help improve biological information processing. Chemphyschem 3, 285–290. doi:10.1002/1439-7641(20020315)3:3<285::AIDCPHC285>3.0.CO;2-A
Harris, J. A., Clifford, C. W., and Miniussi, C. (2008). The functional effect of transcranial magnetic stimulation: signal suppression or neural noise generation? J. Cogn. Neurosci. 20, 734–740. doi:10.1162/jocn.2008.20048
Hodgkin, A. L., and Huxley, A. F. (1990). A quantitative description of membrane current and its application to conduction and excitation in nerve. 1952. Bull. Math. Biol. 52, 25–71. discussion 25–23. doi:10.1007/BF02459568
Hummel, F. C., Celnik, P., Pascual-Leone, A., Fregni, F., Byblow, W. D., Buetefisch, C. M., et al. (2008). Controversy: noninvasive and invasive cortical stimulation show efficacy in treating stroke patients. Brain Stimul. 1, 370–382. doi:10.1016/j.brs.2008.09.003
Joundi, R. A., Jenkinson, N., Brittain, J. S., Aziz, T. Z., and Brown, P. (2012). Driving oscillatory activity in the human cortex enhances motor performance. Curr. Biol. 22, 403–407. doi:10.1016/j.cub.2012.01.024
Kakuda, W., Abo, M., Shimizu, M., Sasanuma, J., Okamoto, T., Yokoi, A., et al. (2012). A multi-center study on low-frequency rTMS combined with intensive occupational therapy for upper limb hemiparesis in post-stroke patients. J. Neuroeng. Rehabil. 9, 4. doi:10.1186/1743-0003-9-4
Khedr, E. M., Rothwell, J. C., Ahmed, M. A., Shawky, O. A., and Farouk, M. (2007). Modulation of motor cortical excitability following rapid-rate transcranial magnetic stimulation. Clin. Neurophysiol. 118, 140–145. doi:10.1016/j.clinph.2006.09.006
Kim, D. Y., Lim, J. Y., Kang, E. K., You, D. S., Oh, M. K., Oh, B. M., et al. (2010). Effect of transcranial direct current stimulation on motor recovery in patients with subacute stroke. Am. J. Phys. Med. Rehabil. 89, 879–886. doi:10.1097/PHM.0b013e3181f70aa7
Kim, Y. H., You, S. H., Ko, M. H., Park, J. W., Lee, K. H., Jang, S. H., et al. (2006). Repetitive transcranial magnetic stimulation-induced corticomotor excitability and associated motor skill acquisition in chronic stroke. Stroke 37, 1471–1476. doi:10.1161/01.STR.0000221233.55497.51
Laureys, S., Peigneux, P., Phillips, C., Fuchs, S., Degueldre, C., Aerts, J., et al. (2001). Experience-dependent changes in cerebral functional connectivity during human rapid eye movement sleep. Neuroscience 105, 521–525. doi:10.1016/S0306-4522(01)00269-X
Leocani, L., Cohen, L. G., Wassermann, E. M., Ikoma, K., and Hallett, M. (2000). Human corticospinal excitability evaluated with transcranial magnetic stimulation during different reaction time paradigms. Brain 123(Pt 6), 1161–1173. doi:10.1093/brain/123.6.1161
Leocani, L., Toro, C., Manganotti, P., Zhuang, P., and Hallett, M. (1997). Event-related coherence and event-related desynchronization/synchronization in the 10 Hz and 20 Hz EEG during self-paced movements. Electroencephalogr. Clin. Neurophysiol. 104, 199–206. doi:10.1016/S0168-5597(96)96051-7
Lindenberg, R., Renga, V., Zhu, L. L., Nair, D., and Schlaug, G. (2010). Bihemispheric brain stimulation facilitates motor recovery in chronic stroke patients. Neurology 75, 2176–2184. doi:10.1212/WNL.0b013e318202013a
Manganotti, P., Gerloff, C., Toro, C., Katsuta, H., Sadato, N., Zhuang, P., et al. (1998). Task-related coherence and task-related spectral power changes during sequential finger movements. Electroencephalogr. Clin. Neurophysiol. 109, 50–62. doi:10.1016/S0924-980X(97)00074-X
McDonnell, M. D., and Abbott, D. (2009). What is stochastic resonance? Definitions, misconceptions, debates, and its relevance to biology. PLoS Comput. Biol. 5:e1000348. doi:10.1371/journal.pcbi.1000348
Mejias, J. F., and Torres, J. J. (2011). Emergence of resonances in neural systems: the interplay between adaptive threshold and short-term synaptic plasticity. PLoS ONE 6:e17255. doi:10.1371/journal.pone.0017255
Moliadze, V., Antal, A., and Paulus, W. (2010a). Boosting brain excitability by transcranial high frequency stimulation in the ripple range. J. Physiol. (Lond.) 588, 4891–4904. doi:10.1113/jphysiol.2010.196998
Moliadze, V., Antal, A., and Paulus, W. (2010b). Electrode-distance dependent after-effects of transcranial direct and random noise stimulation with extracephalic reference electrodes. Clin. Neurophysiol. 121, 2165–2171. doi:10.1016/j.clinph.2010.04.033
Moliadze, V., Atalay, D., Antal, A., and Paulus, W. (2012). Close to threshold transcranial electrical stimulation preferentially activates inhibitory networks before switching to excitation with higher intensities. Brain Stimul. 5, 505–511. doi:10.1016/j.brs.2011.11.004
Moss, F., Ward, L. M., and Sannita, W. G. (2004). Stochastic resonance and sensory information processing: a tutorial and review of application. Clin. Neurophysiol. 115, 267–281. doi:10.1016/j.clinph.2003.09.014
Neiman, A., Schimansky-Geier, L., Moss, F., Shulgin, B., and Collins, J. J. (1999). Synchronization of noisy systems by stochastic signals. Phys. Rev. E Stat. Phys. Plasmas Fluids Relat. Interdiscip. Topics 60, 284–292. doi:10.1103/PhysRevE.60.284
Nitsche, M. A., Cohen, L. G., Wassermann, E. M., Priori, A., Lang, N., Antal, A., et al. (2008). Transcranial direct current stimulation: state of the art 2008. Brain Stimul. 1, 206–223. doi:10.1016/j.brs.2008.06.004
Nitsche, M. A., and Paulus, W. (2000). Excitability changes induced in the human motor cortex by weak transcranial direct current stimulation. J. Physiol. (Lond.) 527(Pt 3), 633–639. doi:10.1111/j.1469-7793.2000.t01-1-00633.x
Ostojic, S., Brunel, N., and Hakim, V. (2009). Synchronization properties of networks of electrically coupled neurons in the presence of noise and heterogeneities. J. Comput. Neurosci. 26, 369–392. doi:10.1007/s10827-008-0117-3
Pascual-Leone, A., Valls-Sole, J., Wassermann, E. M., and Hallett, M. (1994). Responses to rapid-rate transcranial magnetic stimulation of the human motor cortex. Brain 117(Pt 4), 847–858. doi:10.1093/brain/117.4.847
Pell, G. S., Roth, Y., and Zangen, A. (2011). Modulation of cortical excitability induced by repetitive transcranial magnetic stimulation: influence of timing and geometrical parameters and underlying mechanisms. Prog. Neurobiol. 93, 59–98. doi:10.1016/j.pneurobio.2010.10.003
Pfurtscheller, G., Graimann, B., Huggins, J. E., Levine, S. P., and Schuh, L. A. (2003). Spatiotemporal patterns of beta desynchronization and gamma synchronization in corticographic data during self-paced movement. Clin. Neurophysiol. 114, 1226–1236. doi:10.1016/S1388-2457(03)00067-1
Plow, E. B., Carey, J. R., Nudo, R. J., and Pascual-Leone, A. (2009). Invasive cortical stimulation to promote recovery of function after stroke: a critical appraisal. Stroke 40, 1926–1931. doi:10.1161/STROKEAHA.108.540823
Polania, R., Nitsche, M. A., Korman, C., Batsikadze, G., and Paulus, W. (2012). The importance of timing in segregated theta phase-coupling for cognitive performance. Curr. Biol. 22, 1314–1318. doi:10.1016/j.cub.2012.05.021
Ponomarenko, A. A., Li, J. S., Korotkova, T. M., Huston, J. P., and Haas, H. L. (2008). Frequency of network synchronization in the hippocampus marks learning. Eur. J. Neurosci. 27, 3035–3042. doi:10.1111/j.1460-9568.2008.06232.x
Postnov, D. É., Setsinskii, D. V., and Sosnovtseva, O. V. (2001). Stochastic synchronization and the growth in regularity of the noise-induced oscillations. Tech. Phys. Lett. 27, 463–466. doi:10.1134/1.1383826
Schmidt, S., Mante, A., Ronnefarth, M., Fleischmann, R., Gall, C., and Brandt, S. A. (2013). Progressive enhancement of alpha activity and visual function in patients with optic neuropathy: a two-week repeated session alternating current stimulation study. Brain Stimul. 6, 87–93. doi:10.1016/j.brs.2012.03.008
Schneidman, E., Freedman, B., and Segev, I. (1998). Ion channel stochasticity may be critical in determining the reliability and precision of spike timing. Neural Comput. 10, 1679–1703. doi:10.1162/089976698300017089
Schoen, I., and Fromherz, P. (2008). Extracellular stimulation of mammalian neurons through repetitive activation of Na+ channels by weak capacitive currents on a silicon chip. J. Neurophysiol. 100, 346–357. doi:10.1152/jn.90287.2008
Schwarzkopf, D. S., Silvanto, J., and Rees, G. (2011). Stochastic resonance effects reveal the neural mechanisms of transcranial magnetic stimulation. J. Neurosci. 31, 3143–3147. doi:10.1523/JNEUROSCI.4863-10.2011
Siebner, H. R., Hartwigsen, G., Kassuba, T., and Rothwell, J. (2010). How does transcranial magnetic stimulation modify neuronal activity in the brain? Implications for studies of cognition. Cortex 45, 1035–1042. doi:10.1016/j.cortex.2009.02.007
Sosnovtseva, O. V., Fomin, A. I., Postnov, D. E., and Anishchenko, V. S. (2001). Clustering of noise-induced oscillations. Phys. Rev. E Stat. Nonlin. Soft Matter Phys. 64, 026204. doi:10.1103/PhysRevE.64.026204
Sporns, O., Chialvo, D. R., Kaiser, M., and Hilgetag, C. C. (2004). Organization, development and function of complex brain networks. Trends Cogn. Sci. (Regul. Ed.) 8, 418–425. doi:10.1016/j.tics.2004.07.008
Strens, L. H., Asselman, P., Pogosyan, A., Loukas, C., Thompson, A. J., and Brown, P. (2004). Corticocortical coupling in chronic stroke: its relevance to recovery. Neurology 63, 475–484. doi:10.1212/01.WNL.0000133010.69694.F8
Swayne, O. B., Rothwell, J. C., Ward, N. S., and Greenwood, R. J. (2008). Stages of motor output reorganization after hemispheric stroke suggested by longitudinal studies of cortical physiology. Cereb. Cortex 18, 1909–1922. doi:10.1093/cercor/bhm218
Talelli, P., Wallace, A., Dileone, M., Hoad, D., Cheeran, B., Oliver, R., et al. (2012). Theta burst stimulation in the rehabilitation of the upper limb: a semirandomized, placebo-controlled trial in chronic stroke patients. Neurorehabil. Neural Repair 26, 976–987. doi:10.1177/1545968312437940
Terney, D., Chaieb, L., Moliadze, V., Antal, A., and Paulus, W. (2008). Increasing human brain excitability by transcranial high-frequency random noise stimulation. J. Neurosci. 28, 14147–14155. doi:10.1523/JNEUROSCI.4248-08.2008
Thut, G., and Pascual-Leone, A. (2010). A review of combined TMS-EEG studies to characterize lasting effects of repetitive TMS and assess their usefulness in cognitive and clinical neuroscience. Brain Topogr. 22, 219–232. doi:10.1007/s10548-009-0115-4
Thut, G., Veniero, D., Romei, V., Miniussi, C., Schyns, P., and Gross, J. (2011). Rhythmic TMS causes local entrainment of natural oscillatory signatures. Curr. Biol. 21, 1176–1185. doi:10.1016/j.cub.2011.05.049
Timme, M., Wolf, F., and Geisel, T. (2002). Coexistence of regular and irregular dynamics in complex networks of pulse-coupled oscillators. Phys. Rev. Lett. 89, 258701. doi:10.1103/PhysRevLett.89.258701
Toschke, A. M., Tilling, K., Cox, A. M., Rudd, A. G., Heuschmann, P. U., and Wolfe, C. D. (2010). Patient-specific recovery patterns over time measured by dependence in activities of daily living after stroke and post-stroke care: the South London Stroke Register (SLSR). Eur. J. Neurol. 17, 219–225. doi:10.1111/j.1468-1331.2009.02774.x
Wolfe, C. D., Crichton, S. L., Heuschmann, P. U., McKevitt, C. J., Toschke, A. M., Grieve, A. P., et al. (2011). Estimates of outcomes up to ten years after stroke: analysis from the prospective South London Stroke Register. PLoS Med. 8:e1001033. doi:10.1371/journal.pmed.1001033
Zhou, C., Kurths, J., and Hu, B. (2003). Frequency and phase locking of noise-sustained oscillations in coupled excitable systems: array-enhanced resonances. Phys. Rev. E Stat. Nonlin. Soft Matter Phys. 67, 030101. doi:10.1103/PhysRevE.67.030101
Keywords: transcranial brain stimulation, adaptive stimulus control, synchronization, stochastic facilitation, metaplasticity, neuroplasticity, stroke rehabilitation, motor cortex
Citation: Schmidt S, Scholz M, Obermayer K and Brandt SA (2013) Patterned brain stimulation, what a framework with rhythmic and noisy components might tell us about recovery maximization. Front. Hum. Neurosci. 7:325. doi: 10.3389/fnhum.2013.00325
Received: 22 February 2013; Accepted: 12 June 2013;
Published online: 28 June 2013.
Edited by:Janine Reis, Albert-Ludwigs-University Freiburg, Germany
Reviewed by:Leighton B. Hinkley, University of California, USA
Walter Paulus, University of Goettingen, Germany
Copyright: © 2013 Schmidt, Scholz, Obermayer and Brandt. This is an open-access article distributed under the terms of the Creative Commons Attribution License, which permits use, distribution and reproduction in other forums, provided the original authors and source are credited and subject to any copyright notices concerning any third-party graphics etc.
*Correspondence: Stephan A. Brandt, Neurology, Vision and Motor Systems Research Group, Charité – Universitätsmedizin Berlin, Charitéplatz 1, 10117 Berlin, Germany e-mail: firstname.lastname@example.org
†Sein Schmidt and Michael Scholz have contributed equally to this work.