Abstract
Introduction: Closed-loop control of deep brain stimulation (DBS) is beneficial for effective and automatic treatment of various neurological disorders like Parkinson’s disease (PD) and essential tremor (ET). Manual (open-loop) DBS programming solely based on clinical observations relies on neurologists’ expertise and patients’ experience. Continuous stimulation in open-loop DBS may decrease battery life and cause side effects. On the contrary, a closed-loop DBS system uses a feedback biomarker/signal to track worsening (or improving) of patients’ symptoms and offers several advantages compared to the open-loop DBS system. Existing closed-loop DBS control systems do not incorporate physiological mechanisms underlying DBS or symptoms, e.g., how DBS modulates dynamics of synaptic plasticity.
Methods: In this work, we propose a computational framework for development of a model-based DBS controller where a neural model can describe the relationship between DBS and neural activity and a polynomial-based approximation can estimate the relationship between neural and behavioral activities. A controller is used in our model in a quasi-real-time manner to find DBS patterns that significantly reduce the worsening of symptoms. By using the proposed computational framework, these DBS patterns can be tested clinically by predicting the effect of DBS before delivering it to the patient. We applied this framework to the problem of finding optimal DBS frequencies for essential tremor given electromyography (EMG) recordings solely. Building on our recent network model of ventral intermediate nuclei (Vim), the main surgical target of the tremor, in response to DBS, we developed neural model simulation in which physiological mechanisms underlying Vim–DBS are linked to symptomatic changes in EMG signals. By using a proportional–integral–derivative (PID) controller, we showed that a closed-loop system can track EMG signals and adjust the stimulation frequency of Vim–DBS so that the power of EMG reaches a desired control target.
Results and discussion: We demonstrated that the model-based DBS frequency aligns well with that used in clinical studies. Our model-based closed-loop system is adaptable to different control targets and can potentially be used for different diseases and personalized systems.
Introduction
Deep brain stimulation (DBS) is a standard therapy for various movement disorders, including Parkinson’s disease (PD) (), essential tremor (ET) (), and dystonia (). The thalamic ventral intermediate nucleus (Vim) is the primary surgical target of DBS for ET treatment. The stimulation frequency of clinical Vim–DBS for treating ET is usually chosen to be 130 Hz (; ; ). Currently, in clinics, DBS parameters—typically, frequency, amplitude, and pulse width—are usually manually tuned in a trial-and-error process, based on immediate clinical observations by neurologists (; ; ). Such manual DBS programming may be biased toward the neurologists’ expertise and patients’ experience, while requiring multiple clinical visits to test a large number of possible parameters, which cost time and induce stress in both patients and clinicians (; ; ). Additionally, manually programmed DBS delivers continuous DBS (cDBS) to the patient, which can cause side effects and exacerbate stimulation habituation (; ; ). Continuous stimulation can also decrease battery life, thus increasing patients’ burden caused by battery replacement surgeries or battery recharging processes (; ). Hence, there is a need for a control system that can automatically adjust DBS parameters in a closed-loop fashion. Such closed-loop DBS needs to be based on a biomarker that characterizes the patient’s clinical states.
A closed-loop DBS control system consists of three essential components: (i) input DBS pulses; (ii) output feedback, i.e., the biomarker observed during DBS; and (iii) feedback control, which adjusts the DBS parameters based on the feedback biomarker (; ; ). Such a system offers an automatic way to adapt stimulation parameters moment-to-moment with respect to the patient’s clinical states (). Compared with manually programmed (open-loop) cDBS, closed-loop DBS can significantly reduce the stimulation time and enhances clinical efficacy (; ; ).
Most common closed-loop DBS systems use local field potential (LFP), recorded from stimulated nuclei, to find an effective feedback biomarker (; ; Velisar et al., 2019), e.g., the power of the beta oscillation (12–32 Hz) of LFP recorded in the subthalamic nucleus (STN) for reducing PD symptoms (; ; ). Velisar et al. (2019) developed a closed-loop DBS control system in which the beta oscillation power of the STN-LFP was chosen as the biomarker and the DBS amplitude was updated by a dual-threshold control method that maintains the STN–LFP beta power within a certain range. Other signals like muscle activities in electromyography (EMG) or inertial measurement units (IMUs) have also been used as biomarkers in treatment of tremors by closed-loop DBS (; Yamamoto et al., 2013; ; ). For example, in the treatment of ET, developed a closed-loop DBS system that controls the EMG power to be below a specified threshold. There are also other types of feedback biomarkers used in closed-loop DBS, e.g., single-unit recordings () and the coherence among electroencephalogram (EEG) recordings (Silberstein et al., 2005).
Regardless of the type of the feedback biomarker, DBS settings are determined solely based on neural (e.g., LFP) or behavioral (e.g., EMG) signals in most existing closed-loop DBS controllers (Velisar et al., 2019; ; ; ; ; ). However, these methods suffer from the lack of an understanding of the physiological mechanisms underlying the DBS and disease-related neuronal circuits. An effective approach to overcome this problem is to embed a computational model of the underlying mechanisms into the control system (). For example, to control Parkinson’s disease, closed-loop DBS systems were developed based on the physiological models of the related cortico-basal ganglia–thalamic network (. used the control system to suppress the beta oscillations in the cortex, and ) suppressed the beta power of LFP in the STN. Although these computational studies included methods for adjusting DBS in a closed-loop manner (; ; ), the models used were not validated for replicating/tracking experimental data nor did they incorporate DBS mechanisms of actions, e.g., DBS-induced short-term synaptic plasticity (; Tian et al., 2023a; ).
In this work, we develop a closed-loop control system to adjust the stimulation frequency of Vim–DBS automatically. Our control system is based on a computational model that predicts the EMG activities in response to different frequencies of Vim–DBS. In this computational model, the firing rate of Vim neurons in response to Vim–DBS is predicted by our recently developed rate network model that reproduces the human clinical data recorded in Vim neurons in response to different DBS frequencies (10–200 Hz) (Tian et al., 2023b). Dynamics of DBS-induced short-term synaptic plasticity (Tian et al., 2023b) are incorporated in the rate network model. We used a neural model simulation study including models of DBS, Vim, the motor cortex, motoneurons in the spinal cord, and muscle fibers to generate muscle activities (represented by EMG). To link Vim–DBS to EMG signals in our model-based control framework, model-predicted EMG signals, generated in our simulation study, are used to calculate the feedback biomarker by a polynomial fit, which is processed and implemented in a proportional–integral–derivative (PID) controller (; ; ) that automatically updates the appropriate DBS frequency. Our model-predicted EMG can predict the symptoms of essential tremor during DBS-OFF and is consistent with clinical observations of tremors during different frequencies of Vim–DBS. In a closed-loop DBS control system, the ability of predicting the biomarker decreases the probability of delivering inappropriate DBS frequencies to the patient, and thus increases the therapeutic efficacy and reduces side effects.
The proposed model-based closed-loop DBS control system is based on synthetic EMG data and is currently in the stage of proof-of-concept. However, we anticipate that our computational framework can facilitate the development of model-based control systems that can be potentially implemented in and out of the clinic to automatically update the appropriate DBS frequency for individual patients suffering from different diseases.
Materials and methods
We developed a computational framework for incorporating the physiological mechanisms of deep brain stimulation into controlling disease symptoms. This framework consists of two main parts: (1) a computational model characterizing the physiological mechanism of the stimulated neuronal network and (structurally/functionally) connected neurons and (2) a feedback control reflecting the disease state. In this study, we use computer simulations and apply our framework to control DBS frequency for reducing ET symptoms observed from EMG signals.
Computational model
The computational model consists of four components: (i) neural activities, spikes, generated by the Vim network model in response to different DBS frequencies; (ii) motor cortex neural activities influenced by propagation of Vim–DBS effects to the motor cortex; (iii) spinal motoneuron activities impacted by neurons in the motor cortex; (iv) motor unit action potentials in the muscle fibers innervated by the spinal motoneurons.
(i) Vim network model impacted by Vim–DBS
The baseline firing rate of Vim neurons during DBS-OFF is often chosen in the range of 10–40 Hz (; Tian et al., 2023b). The firing rate dynamics of the Vim neurons in response to Vim–DBS were simulated by our previous model of the Vim network based on clinical DBS data recorded during surgery on human patients with essential tremor (ET) (Supplementary Method S2) (Tian et al., 2023b). The impact of DBS pulses was modeled as the induction of synaptic release (Tian et al., 2023b), the dynamics of which is characterized by the Tsodyks and Markram (TM) model (Tsodyks et al., 1998) (Supplementary Method S1) of short-term synaptic plasticity (STP) (). DBS pulses are fed into the TM model to obtain the post-synaptic currents into Vim neurons (Tian et al., 2023b). The firing rate network model consists of recurrent connections among three neural groups: DBS-targeted Vim neurons, external excitatory nuclei, and inhibitory nuclei (Supplementary Method S2) (Tian et al., 2023b). Our previous model could accurately reproduce the clinically recorded instantaneous firing rate of the Vim neurons receiving DBS of different stimulation frequencies (10–200 Hz) (Supplementary Figure S5) (Tian et al., 2023b).
(ii) Propagation to the primary motor cortex
In our model, the effects of Vim–DBS are propagated to the primary motor cortex (M1). We modeled the propagation using the dynamics induced by two sources: (1) the effects of Vim–DBS and (2) the background neuronal activities that induce tremor symptoms. The Vim–DBS effects are induced by the direct DBS activation of the axons projected to the M1 neuron and the firings of the Vim neurons during Vim–DBS.
These effects consist of direct axon activation and DBS-induced Vim firings. DBS activates the axons connecting to the synapses projecting to the M1 neuron, and these synapses are characterized by the Tsodyks and Markram model (Tsodyks et al., 1998) (Supplementary Method S1). In addition to the direct axon activation, the M1 neuron is also affected by the DBS-induced firings of the Vim neurons. With our previous Vim network model (Tian et al., 2023b), we simulated the instantaneous firing rate of the Vim neurons receiving DBS of different stimulation frequencies (10–200 Hz). The Vim firing rate signal is the time-varying Poisson rate for generating Poisson spike trains, which were passed to the TM-modeled synapses to produce the post-synaptic current in the M1 neurons (Supplementary Method S1).
In addition to the DBS effects, we also modeled the background neuronal activities inducing tremor symptoms. The tremor activities observed in the EMG from ET patients are often in the frequency band of 4–8 Hz (; ; ). The tremor-inducing background firing rate was taken as a waveform consisting of 6-Hz bursts with a baseline shift (Supplementary Figure S1). To be consistent with the EMG recordings from ET patients (; Vaillancourt et al., 2003; ; Zhang et al., 2017), each burst consists of three consecutive sinusoidal waves and the period of each wave is 20 ms (Supplementary Figure S1). We then generated Poisson spike trains from the background firing rate waveform; these spikes were then passed to the M1 synapses characterized by the TM model (Tsodyks et al., 1998), which produced the post-synaptic current into the M1 neurons (Supplementary Method S1).
The membrane potential of one neuron in the M1 neuron population was characterized by a leaky integrate-and-fire (LIF) model (Eq. 1) as follows:where 65 mV is the equilibrium potential, (resistance parameter) = 1 MΩ, and = 10 ms is the membrane time constant; spikes occur when , where = 35 mV. The reset voltage is 90 mV, and the absolute refractory period is 1 ms. is the total post-synaptic input current, consisting of the inputs induced by Vim-DBS () and the background inputs generating the tremor (), and was obtained by the TM model (Tsodyks et al., 1998) that incorporates all the input spikes (see Supplementary Method S1).
(iii) Projection from the primary motor cortex to spinal motoneurons
We modeled the effects of Vim–DBS as being propagated to a population of 150 M1 neurons ( = 150), which project to 120 motoneurons ( = 120) in the spinal cord (; Watanabe et al., 2013). We assumed that each motoneuron randomly connects to 70 M1 neurons and receives monosynaptic inputs from each M1 neuron (; ). Following a spike from an M1 neuron, we modeled the post-synaptic current into a motoneuron by the rule of spike-timing-dependent plasticity (STDP) from ):where is a spike timing of an M1 neuron, = 10 ms is the M1-to-spinal-motor-neuron transmission delay (), is a time point following the M1 spike timing , = 20 ms is a time constant, and = 0.1 nA is the scaling factor (). The membrane potential of the motoneuron is given by an LIF model (Eq. 3) equivalent to that of Herrmann and Gerstner (2002) (; ):where is the last spike timing of the jth motoneuron. h(t) is the Heaviside step function, which is 0 when its argument is negative and 1 otherwise. is the post-synaptic current from M1 neurons into the jth motoneuron and is a summation of (Eq. 2) from each of the 70 M1 neurons projecting to the motoneuron. mV is the reset membrane potential (). When the membrane potential reaches a firing threshold , it is instantaneously reset to , and the integration process restarts. For each motoneuron, the firing threshold ∈ [, ] mV is chosen randomly (). = 36 M is the input resistance (). = 2 ms is the refractory time constant. = 4 ms is the passive membrane time constant. = 100 ms is the recovery time constant (; ). The firing rate of a human motoneuron is normally between 5 and 50 Hz (), although it can be over 100 Hz for a brief period during fast contractions ().
(iv) Generation of EMG activities from spinal motoneuron spikes
The spikes from the spinal motoneurons generate action potentials in the motor units of muscle fibers (; Watanabe et al., 2013). These motor unit action potentials (MUAPs) were modeled (Eq. 4) as follows (Watanabe et al., 2013; ; ):where is the MUAP of the jth motor unit, corresponding to the jth motoneuron; 2 ms is the time factor (); is the spike timing; = 10 ms is the motor-neuron-to-muscle conduction delay in humans (); and h(t) is the Heaviside step function. is the scale factor of the amplitude of activities in the jth motor unit (; ) and was modeled as following the exponential distribution , where is the mean of distribution (; ); we chose 7 10–3 to be consistent with the EMG simulation during transcranial magnetic stimulation (TMS), as given in ). Finally, the surface EMG () was modeled (Eq. 5) as the summation of MUAPs with a low-level Gaussian white noise () (Watanabe et al., 2013; ) with a standard deviation of 0.025 mV:
Feedback control for DBS frequency
Our computational model simulates the EMG signal in response to different DBS frequencies. Simulated EMG signals are used to calculate the feedback biomarker which controls the DBS frequency. The feedback control consists of three main parts: (1) biomarker identification, (2) computation of a system output from the biomarker, and (3) a closed-loop controller that implements the system output to update the DBS frequency.
Biomarker identification
The EMG simulation of our computational model is slow to implement: it takes more than 30 min when using MATLAB R2022b with a personal computer to simulate 10 s of the EMG signal. Thus, to facilitate the implementation speed of the model in a closed-loop control system, we need rapid EMG estimation to replace the direct EMG simulation. We implemented a polynomial method to estimate the EMG from the Vim firing rate, and the direct model-simulated EMG is used as the reference (i.e., reference EMG) for estimation. We implemented the MATLAB custom function polyfit for polynomial estimation, which gives a least-square fit of the polynomial coefficients. The estimated EMG is formulated as follows:where is the Vim firing rate simulated from our previous Vim network model (Tian et al., 2023b) and is the estimated EMG. is the standardization of ; and are the mean and standard deviation of , respectively. Then, has a mean of 0 and a standard deviation of 1. The polynomial order is 25, and are the polynomial coefficients. The statistic () of the fit generally increases with increase in the polynomial order (Supplementary Figure S3), and 25 is a minimal order of the polynomial when converges. is the Gaussian white noise with a standard deviation of 0.038 mV. We fitted the consistent polynomial coefficients (Supplementary Table S2) across data from different DBS frequencies, including 10, 50, 80, 100, 120, 130, 140, 160, and 200 Hz. Our previous work showed that consistent model parameters fitted based on concatenated DBS frequencies in a certain range—in this case, [10–200] Hz—can be consistently applied to unobserved frequencies (e.g., 25 and 180 Hz) in the same range (Tian et al., 2023a). Thus, we implement the polynomial-estimated EMG as the biomarker to control the DBS frequencies in the range [10–200] Hz.
Computation of system output from the estimated EMG
The power spectral density (PSD) of the estimated EMG (Eq. 6) is the system output for updating the frequency of the input DBS (10–200 Hz). In the system output, we consider PSD in the frequency band [2–200] Hz, which includes the frequencies of both DBS and EMG activities (; ; ; ). The power density is calculated by the following equation (; ), with a sampling frequency of 0.5 kHz:
.
where represents the frequency of the EMG activities. is the Hann windowing function (; ), and is the width of the window, chosen to be = 1 s to ensure stability (; ). represents the estimated EMG in response to DBS with stimulation frequency . The total power of EMG activities over the initial period of the estimated EMG signal is then given as
The EMG power thus computed can be used to analyze the EMG activities in the frequency domain in response to different frequencies of DBS.
In response to DBS frequency , the PSD of EMG within the frequency band of [2–200] Hz is approximated as the sum of the power density (, Eq. 7) from each integer DBS frequency (2, 3, 4, …, 200 Hz) in [2–200] Hz, and the system output is calculated as the approximated PSD in the initial T = 5 s of the estimated EMG:
Finally, a closed-loop controller updates the DBS frequency so that is close to a specified control target (see the next section).
The PID controller that updates the DBS frequency
We implemented the proportional–integral–derivative (PID) controller (; ; ) to update the DBS frequency based on the system output, z (Eq. 9). The updated DBS frequency is computed as Eq. 10and is evaluated at the time points {, , …, }, with = 0, = 10 min, and = – = 1/3 min. The simulation of the PID controller was performed with MATLAB R2022b. , , and denote the proportional, integral, and derivative gains, respectively. The error signal is the difference between the system output z and its control target .
Results
Our proposed computational framework for model-based closed-loop DBS control is shown in Figure 1. As shown in Figure 1A, an encoding model is used to replicate (predict) neuronal activities in response to DBS frequencies. In this encoding model, the dynamics of synaptic plasticity and other biophysical details can be preserved, and model parameters are estimated by fitting the model output to experimental data (Tian et al., 2023b; Tian et al., 2023a). Additionally, to map neural activities to behavioral signals, we use a data-driven approach (Eq. 6) in our framework. A controller, e.g., a PID controller, is developed to adjust DBS patterns given behavioral signals solely. It is to be noted that, unlike the encoding model, using neural models to identify neural–behavioral relationships requires building a network of several neuronal circuits (see our simulation study in Figure 2), which in turn increases the complexity of this type of model for mapping neural features to behavioral activities. However, we show that data-driven approaches are strong alternatives. The proposed computational framework in Figure 1B highlights the contributions of encoding (biophysical) and decoding (data-driven) models.
FIGURE 1
FIGURE 2
In the next sections, we present details of the model-based closed-loop DBS system that can effectively control the DBS frequency based on EMG signals generated by a neural model simulation (Figure 2) of the underlying neuronal network (from DBS/Vim neural activity to muscle activity).
Schematics of the neural model simulation study for Vim-DBS control
The simulation study for the Vim–DBS control system is schematized in Figure 2. The effects of Vim–DBS included direct axon activation and DBS-induced Vim firings, which were simulated from our previous Vim network model established based on clinical Vim–DBS data (Tian et al., 2023b). The Vim–DBS effects are propagated to the M1 neuron, which projects to the motoneuron in the spinal cord. The firings of the spinal motoneurons innervate the corresponding motor units in the muscle fibers and induce motor unit action potentials (MUAPs). The simulated EMG consists of a linear summation of MUAPs and a low-level Gaussian white noise. In the feedback control, in order to facilitate the implementation speed, we estimated the simulated EMG by a polynomial fit. Then, we computed the mean power spectral density (PSD) of such polynomial-estimated EMG as the system output. Finally, a proportional–integral–derivative (PID) controller updated the DBS frequency that brought the system output close to a specified control target.
DBS pulses are delivered to the neurons in the thalamic ventral intermediate nucleus (Vim) and also activate the axons projecting to neurons in the primary motor cortex (M1). The firing rate of the Vim neurons impacted by DBS was obtained from our previous Vim network model that reproduced experimental DBS data (Tian et al., 2023b). Spike trains are generated from the modeled Vim firing rate () as a Poisson process and are propagated to the M1 neurons. The spikes from the M1 neurons are then propagated to the motoneurons in the spinal cord. The spikes from these motoneurons innervate the corresponding motor units in the muscle fibers and induce motor unit action potentials (MUAPs). The simulated EMG () is a linear summation of MUAPs with additive low-level Gaussian white noise. In the feedback control, we estimate the simulated EMG by fitting a polynomial function (Eq. 6), and this estimated EMG () is the biomarker used in the control. is the constant term of , is the Gaussian white noise, and is the standardization of the modeled Vim firing rate (Eq. 6). The system output is calculated as the mean power spectral density (PSD) over the initial T of the biomarker (Eq. 9). Finally, a proportional–integral–derivative (PID) controller (Eq. 10) updates the DBS frequency u that reduces the error () between the system output and a specified control target .
The Vim–Cortex propagation
Our model of the propagation of the Vim–DBS effects to the cortical M1 neurons was validated by using a 10-s block of neural spike data from single-unit recordings in M1 during 130-Hz VPLo-DBS in non-human primates, reported in ). The thalamic VPLo nucleus (ventralis posterior lateralis pars oralis, in the Olszewski atlas) in non-human primates is homologous to the Vim in humans (; Xiao et al., 2018). To assess the response of Vim to 130-Hz DBS, a peristimulus time histogram (PSTH) was calculated based on spike times occurring between 0 and 7.7 ms after each DBS pulse, with the PSTH further smoothed by an optimal Gaussian kernel (Shimazaki and Shinomoto, 2007; ) (Figure 3), both for empirical and simulated data. The standard deviation of the Gaussian kernel was 0.2 ms, which was obtained from optimization of the Gaussian kernel to best characterize the spikes using a Poisson process (Shimazaki and Shinomoto, 2007; ; Tian et al., 2023b). Our Vim–M1 propagation model’s generated M1 spike activity behaved similarly to that of the empirically recorded non-human primate M1, as indicated by the spike raster plot and PSTH firing rate analysis (Figure 3). We computed the statistic () to compare model-simulated and experimental PSTHs, and = 0.728 represents a good model fit (Figure 3B). Thus, our Vim–M1 propagation model could reflect the M1 dynamics during 130-Hz Vim–DBS.
FIGURE 3
EMG simulation from the computational model
We simulated the EMG from our model, both during DBS-OFF and in response to Vim-DBS of different stimulation frequencies in [10–200] Hz (Figure 4).
FIGURE 4

Model-simulated EMG in response to different frequencies of DBS. Simulated EMG with our model, in response to different frequencies of Vim–DBS. Each signal is given relative to its mean.
The EMG simulation with DBS-OFF presented a typical tremor band (∼6 Hz) in the clinical EMG signals recorded from ET patients (
Estimation of the simulated EMG
The EMG simulation from the model is too slow for practical implementation. Thus, we estimated the model-simulated EMG with a polynomial fit to facilitate the computational speed in a closed-loop control system. The model-simulated EMG and polynomial-estimated EMG are denoted as “reference EMG” and “estimated EMG,” respectively (Figure 5). We compared the reference EMG and estimated EMG in response to different frequencies of DBS (Figures 5, 6).
FIGURE 5

Comparison of reference and estimated EMGs (time domain) in response to different frequencies of DBS. “Reference EMG” is the EMG simulated by our model ( in Figure 2). “Estimated EMG” is the estimation of the reference EMG with the polynomial fit ( in Figure 2). (A) Comparison of the reference EMG and estimated EMG in the time domain, in response to different frequencies of DBS. Each signal is subtracted by its mean. (B) Correlation between the reference EMG and estimated EMG. The correlation is computed based on the initial 5 s of data. (C) Comparison of the mean power spectral density (PSD) between the reference EMG and estimated EMG. Mean PSD is computed based on the initial 5 s of data.
FIGURE 6

Comparison of the reference and estimated EMGs (frequency domain) in response to different frequencies of DBS. “Reference EMG” is the EMG simulated by our model ( in Figure 2). “Estimated EMG” is the estimation of reference EMG with the polynomial fit ( in Figure 2). We compare the reference EMG and estimated EMG in the frequency domain, which is the frequency band [2–200] Hz of the EMG activities. For each DBS frequency, at each frequency of the EMG activities, we compute the corresponding frequency power with Eq. 8 in the initial T = 5 s of the EMG. The frequency power of EMG activities is plotted on a log scale.
In the time domain, the estimated EMG is similar to the reference EMG across different DBS frequencies (10–200 Hz), in terms of both amplitude and variation (Figure 5A). The correlation between the reference and estimated EMGs is generally above 0.3, representing some positive correlations (Figure 5B); the correlation is not very high because of the existence of white noise in the simulations. The power is generally similar between reference and estimated EMGs (Figure 5C). In addition to the comparison in the time domain, we also compared the reference and estimated EMGs in the frequency domain (Figure 6). At each frequency in the band [2–200] Hz of the EMG activities, we computed the corresponding frequency power with Eq. 8 in the initial T = 5 s of the EMG (Figure 6). The estimated EMG [by a 25-order polynomial (Eq. 6)] is well-fitted to the reference EMG in the frequency domain, with R2 = 0.745 (Supplementary Figure S3), computed based on the signals across different DBS frequencies. Additionally, we observed other similarities between the estimated and reference EMGs in terms of the amplitude and pattern of different frequency powers of EMG activities (Figure 6). The EMG power is high with DBS-OFF and during low-frequency (<100 Hz) DBS and is mostly suppressed during 130 Hz DBS (Figure 6). During 10–80 Hz DBS, in both estimated and reference EMGs, we observed that the power is high at the harmonics of the DBS frequency (Figure 6). This might indicate that DBS could induce synchronized activities during low-frequency DBS (
The system output based on EMG power spectral density
We computed the system output to be implemented in a closed-loop controller updating the DBS frequency. The system output during Vim–DBS was computed with the estimated EMG (Eq. 6) that facilitates the implementation speed. For DBS frequency , we defined the system output as the mean power spectral density (PSD) in the initial interval = 5 s of the estimated EMG in response to DBS with stimulation frequency (Eq. 9). PSD represents the band [2–200] Hz of EMG activities. The system output in response to different frequencies ([10–200] Hz) of DBS is presented in Figure 7:
FIGURE 7

System output in response to different frequencies of DBS. The system output z(u) is the mean power spectral density (PSD) in the initial interval T = 5 s of the estimated EMG ( in Figure 2) in response to DBS with the simulation frequency u (Eq. 9).
In general, the system output decreases with increase in the DBS frequency (Figure 7, Supplementary Table S3). During low-frequency ( 50 Hz) DBS, the system output is not reduced much compared with the DBS-OFF ( = 0) situation (Figure 7). The system output is low during high-frequency ( 100 Hz) DBS and is close to minimum during 130 Hz DBS (Figure 7). These responses of the system output to different DBS frequencies are consistent with clinical observations of the effectiveness of different frequencies of Vim–DBS (
Closed-loop control of the DBS frequency with the PID controller
A PID controller (Eq. 10) was implemented to update the DBS frequency in the closed-loop system, based on the system output z (Eq. 9). The parameters , , and of the PID controller were chosen to be 103 (Hz/mV2), 105 Hz/(mV2 min), and 5 103 (Hz min/mV2), respectively; parameter tuning was performed to increase the efficacy of the controller (Supplementary Figure S2 and Supplementary Note).
As a test of the controller, when the control target is the power of the biomarker (estimated EMG, Eq. 6) from 130-Hz DBS, the PID controller can converge to the target in 10 min (Figure 8A and Supplementary Table S4). This shows that our control system is potentially effective and efficient for clinical implementation. Note that during the PID control, only the steady-state DBS frequency (reached after ∼10 min) is delivered to the patient. As we change the control target of the system output, the result of the PID control is also robustly and flexibly changed (Figure 8B). As shown in Figure 8B, the five control targets of the system output correspond to the biomarker power from both observed and unobserved DBS frequencies (Supplementary Table S4). The observed DBS frequencies (10, 50, 80, 100, 120, 130, 140, 160, and 200 Hz) were used in fitting the polynomial coefficients (Eq. 6), and the unobserved DBS frequencies are arbitrary.
FIGURE 8

Closed-loop control of the DBS frequency with the PID controller. The DBS frequency is controlled in closed-loop with the proportional–integral–derivative (PID) controller (Eq. 10; Figure 2). The simulation of the PID controller is performed with MATLAB R2022b. (A) PID control of the DBS frequency with a specified target . During the control, the system output converges to the target, which is the power of the biomarker (estimated EMG, Eq. 6) simulated during 130-Hz DBS. (B) PID control of DBS frequency with different targets. represent five control targets of the system output z (Eq. 9 and Supplementary Table S4). and correspond to the biomarker power during DBS frequency 140, 130, and 120 Hz, respectively. and correspond to unobserved DBS frequencies.
Discussion
We developed a model-based closed-loop control system for the stimulation frequency of Vim–DBS. The DBS control system was based on our previously verified computational model, which represents the neuronal network characterizing the physiological mechanisms that connect the input (DBS pulses) and the output (model-predicted EMG activities). In order to facilitate the implementation speed, we estimated the model-predicted EMG with a polynomial fit, which was used as the feedback biomarker for the controller. The power spectrum of the biomarker was the system output implemented in a PID controller that automatically updates the appropriate DBS frequency. Thus, the closed-loop system controls the EMG power by adjusting the DBS frequency. Our closed-loop system can control the DBS frequency to achieve different control targets of EMG power and can potentially be implementable for different diseases and individual patients.
Clinical relevance of the system output
The system output used in our closed-loop system is related to the power of the model-predicted EMG signals, and the optimal DBS frequency is obtained by bringing the system output to a specified control target. In clinical studies, the power of EMG is a commonly observed indicator for different movement disorders, e.g., PD (Zhang et al., 2017), ET (
Importance of predictability in a control system
The ability to predict how different frequencies of DBS change neural and behavioral activities is the main advantage of our model-based closed-loop DBS. A controller (e.g., PID) can select appropriate DBS patterns that are biophysically relevant and clinically effective. Although the model parameters [for both encoding and decoding models (see Figure 2) are obtained based on sparse DBS frequencies, 5, 10, 20, 30, 50, 100, 130, and 200 Hz [human Vim data (Tian et al., 2023b) and non-human primate cortical data (
The use of machine learning methods in closed-loop DBS
In recent closed-loop DBS control systems, machine learning methods have been developed to map biomarker features (input) to patients’ observed states (output) and could further deliver an appropriate DBS setting (
A key improvement to existing machine learning methods is to incorporate physiological characterizations of the input–output mapping. In this work, we developed a physiological model to map the input (DBS frequency) to the output (model-predicted EMG). We then used a polynomial-based approximation to estimate the input–output map to facilitate the implementation speed of the control system. However, the polynomial method is prone to be less robust to unseen inputs, owing to its high-order terms (
Our closed-loop DBS control is based on a physiological model that can generate an arbitrary amount of synthetic data, which can be implemented in fully training deep learning methods. The arbitrary amount of data in the training set will increase the accuracy and robustness of our future closed-loop DBS control based on physiological models and deep learning methods. Therefore, it is recommended that the efficacy of the SVM, logistic regression, LDA, hidden Markov model (HMM), random forests, and deep neural network models like CNNs be evaluated in greater detail using the abundance of synthetic data. Watts et al. (2020) performed a thorough retroactive study of various machine learning classifiers used to identify optimal DBS parameters for PD, and it was recommended to pursue machine learning in the context of adaptive closed-loop DBS for PD.
Different DBS mechanisms
Synaptic depression can partially explain the therapeutic mechanisms of high-frequency DBS (e.g., Vim–DBS), which can stem from synaptic and axonal failure (
Limitations and future work
In our closed-loop system, the EMG power of a broad band is used as the system output to update the input DBS frequency. We used the band [2–200] Hz that covers the DBS frequencies [10–200] Hz, which induces DBS-evoked activities in our EMG simulations (Figures 5, 6). These DBS-evoked activities could be a mechanism of the ineffectiveness of low-frequency Vim–DBS (Ushe et al., 2004;
We developed a model-based closed-loop control system that automatically updates the DBS frequency. Although the DBS frequency is a commonly tuned parameter in clinical applications (
Our model-based closed-loop DBS control system is in the proof-of-concept stage for clinical implementations. The system will be implemented together with a constant monitoring of the EMG signal. In contrast to existing closed-loop DBS systems that update DBS parameters based on EMG signals solely (Yamamoto et al., 2013;
Our model included the clinical Vim–DBS data recorded in Vim neurons across different stimulation frequencies (10–200 Hz) (Tian et al., 2023b). However, experimental data were not sufficiently included in other components of our model. We incorporated non-human primate single-unit recordings in M1 during 130-Hz VPLo-DBS reported in
It is worth mentioning that the synaptic connections between the Vim (VPLo in primate) are reciprocal and excitatory, though the projections that the M1 sends to the Vim are in different M1 laminae than the ones it receives from Vim (Stepniewska et al., 1994). Our model simplified this excitatory feedback relationship by considering the excitatory propagation effect as unidirectional, from the Vim to the M1. We fitted the simplified model to the recording from one M1 neuron during 130-Hz VPLo-DBS, and there are variabilities among the dynamics of different M1 neurons. In the future, we will develop a more detailed Vim-M1 model based on more M1 recordings. In this work, we modeled the spinal motoneurons as one population. Spinal motoneurons can be classified into two function groups: somatic and visceral (
Statements
Data availability statement
The raw data supporting the conclusion of this article will be made available by the authors, without undue reservation.
Ethics statement
The studies involving humans were approved by the Tri-Council Policy on Ethical Conduct for Research Involving Humans and the University Health Network Research Ethics Board. The studies were conducted in accordance with the local legislation and institutional requirements. The participants provided their written informed consent to participate in this study. The animal study was approved by the Institutional Animal Care and Use Committee of the University of Minnesota and United States Public Health Service policy on the humane care and use of laboratory animals. The study was conducted in accordance with the local legislation and institutional requirements.
Author contributions
YT: conceptualization, formal analysis, investigation, methodology, resources, software, validation, visualization, writing–original draft, and writing–review and editing. SS: writing–original draft and writing–review and editing. EB: data curation, resources, writing–original draft, and writing–review and editing. MJ: writing–original draft and writing–review and editing. GE: writing–original draft and writing–review and editing. MP: writing–original draft and writing–review and editing. ML: conceptualization, formal analysis, funding acquisition, investigation, methodology, project administration, resources, supervision, visualization, writing–original draft, and writing–review and editing.
Funding
The author(s) declare that financial support was received for the research, authorship, and/or publication of this article. This work was supported by ML NSERC Discovery Grant (RGPIN-2020-05868), CIHR Project Grant, and Brain Canada (Azrieli Foundation).
Conflict of interest
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
Publisher’s note
All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors, and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.
Supplementary material
The Supplementary Material for this article can be found online at: https://www.frontiersin.org/articles/10.3389/fnetp.2024.1356653/full#supplementary-material
References
1
AgnesiF.MuralidharanA.BakerK. B.VitekJ. L.JohnsonM. D. (2015). Fidelity of frequency and phase entrainment of circuit-level spike activity during DBS. J. Neurophysiol.114 (2), 825–834. 10.1152/jn.00259.2015
2
ArlottiM.RosaM.MarcegliaS.BarbieriS.PrioriA. (2016). The adaptive deep brain stimulation challenge. Park. Relat. Disord.28, 12–17. 10.1016/j.parkreldis.2016.03.020
3
BakerS. N.LemonR. N. (1998). Computer simulation of post-spike facilitation in spike-triggered averages of rectified EMG. J. Neurophysiol.80 (3), 1391–1406. 10.1152/jn.1998.80.3.1391
4
BarbeM. T.LiebhartL.RungeM.PaulsK. A. M.WojteckiL.SchnitzlerA.et al (2011). Deep brain stimulation in the nucleus ventralis intermedius in patients with essential tremor: habituation of tremor suppression. J. Neurol.258 (3), 434–439. 10.1007/s00415-010-5773-3
5
BeltrãoJ. F.SilvaJ. B. C.CostaJ. C. (1991). Robust polynomial fitting method for regional gravity estimation. GEOPHYSICS56 (1), 80–89. 10.1190/1.1442960
6
BisdorffA. R.BronsteinA. M.WolsleyC.GrestyM. A.DaviesA.YoungA. (1999). EMG responses to free fall in elderly subjects and akinetic rigid patients. J. Neurol. Neurosurg. Psychiatry66 (4), 447–455. 10.1136/jnnp.66.4.447
7
BorgK.BorgJ. (1987). Conduction velocity and refractory period of single motor nerve fibres in antecedent poliomyelitis. J. Neurol. Neurosurg. Psychiatry50 (4), 443–446. 10.1136/jnnp.50.4.443
8
BoutetA.MadhavanR.EliasG. J. B.JoelS. E.GramerR.RanjanM.et al (2021). Predicting optimal deep brain stimulation parameters for Parkinson’s disease using functional MRI and machine learning. Nat. Commun.12 (1), 3043. 10.1038/s41467-021-23311-9
9
Castaño-CandamilS.FerlegerB. I.HaddockA.CooperS. S.HerronJ.KoA.et al (2020). A pilot study on data-driven adaptive deep brain stimulation in chronically implanted essential tremor patients. Front. Hum. Neurosci.14, 541625. 10.3389/fnhum.2020.541625
10
CerneraS.AlcantaraJ. D.OpriE.CagleJ. N.EisingerR. S.BoogaartZ.et al (2021). Wearable sensor-driven responsive deep brain stimulation for essential tremor. Brain Stimul. Basic Transl. Clin. Res. Neuromodulation14 (6), 1434–1443. 10.1016/j.brs.2021.09.002
11
ChandrabhatlaA. S.PomeraniecI. J.HorganT. M.WatE. K.KsendzovskyA. (2023). Landscape and future directions of machine learning applications in closed-loop brain stimulation. Npj Digit. Med.6 (1), 79. 10.1038/s41746-023-00779-x
12
Colin CameronA.WindmeijerF. A. G. (1997). An R-squared measure of goodness of fit for some common nonlinear regression models. J. Econom.77 (2), 329–342. 10.1016/S0304-4076(96)01818-0
13
DallapiazzaR. F.LeeD. J.De VlooP.FomenkoA.HamaniC.HodaieM.et al (2019). Outcomes from stereotactic surgery for essential tremor. J. Neurol. Neurosurg. Psychiatry90 (4), 474–482. 10.1136/jnnp-2018-318240
14
DembekT. A.Petry-SchmelzerJ. N.RekerP.WirthsJ.HamacherS.SteffenJ.et al (2020). PSA and VIM DBS efficiency in essential tremor depends on distance to the dentatorubrothalamic tract. NeuroImage Clin.26, 102235. 10.1016/j.nicl.2020.102235
15
DeuschlG.PaschenS.WittK. (2013). Clinical outcome of deep brain stimulation for Parkinson’s disease. Handb. Clin. Neurol.116, 107–128. 10.1016/B978-0-444-53497-2.00010-3
16
Dowsey-LimousinP. (2002). Postoperative management of Vim DBS for tremor. Mov. Disord.17 (S3), S208–S211. 10.1002/mds.10165
17
DuchateauJ.BaudryS. (2014). Maximal discharge rate of motor units determines the maximal rate of force development during ballistic contractions in human. Front. Hum. Neurosci.8, 234. 10.3389/fnhum.2014.00234
18
EarhartG. M.HongM.TabbalS. D.PerlmutterJ. S. (2007). Effects of thalamic stimulation frequency on intention and postural tremor. Exp. Neurol.208 (2), 257–263. 10.1016/j.expneurol.2007.08.014
19
EyreJ. A.MillerS.ClowryG. J.ConwayE. A.WattsC. (2000). Functional corticospinal projections are established prenatally in the human foetus permitting involvement in the development of spinal motor centres. Brain J. Neurol.123 (Pt 1), 51–64. 10.1093/brain/123.1.51
20
FarokhniaeeA.McIntyreC. C. (2019). Theoretical principles of deep brain stimulation induced synaptic suppression. Brain Stimul.12 (6), 1402–1409. 10.1016/j.brs.2019.07.005
21
FieldsH. L.MeyerG. A.PartridgeL. D. (1970). Convergence of visceral and somatic input onto spinal neurons. Exp. Neurol.26 (1), 36–52. 10.1016/0014-4886(70)90086-5
22
FlemingJ. E.DunnE.LoweryM. M. (2020). Simulation of closed-loop deep brain stimulation control schemes for suppression of pathological beta oscillations in Parkinson’s disease. Front. Neurosci.14, 166. 10.3389/fnins.2020.00166
23
FlorinE.ReckC.BurghausL.LehrkeR.GrossJ.SturmV.et al (2008). Ten Hertz thalamus stimulation increases tremor activity in the subthalamic nucleus in a patient with Parkinson’s disease. Clin. Neurophysiol. Off. J. Int. Fed. Clin. Neurophysiol.119 (9), 2098–2103. 10.1016/j.clinph.2008.05.026
24
GhadimiA.SteinerL. A.PopovicM. R.MilosevicL.LankaranyM. (2022). Inferring stimulation induced short-term synaptic plasticity dynamics using novel dual optimization algorithm. PloS One17 (9), e0273699. 10.1371/journal.pone.0273699
25
GolshanH. M.HebbA. O.HanrahanS. J.NedrudJ.MahoorM. H. (2018). A hierarchical structure for human behavior classification using STN local field potentials. J. Neurosci. Methods293, 254–263. 10.1016/j.jneumeth.2017.10.001
26
GolshanH. M.HebbA. O.MahoorM. H. (2020). LFP-Net: a deep learning framework to recognize human behavioral activities using brain STN-LFP signals. J. Neurosci. Methods335, 108621. 10.1016/j.jneumeth.2020.108621
27
GradoL. L.JohnsonM. D.NetoffT. I. (2018). Bayesian adaptive dual control of deep brain stimulation in a computational model of Parkinson’s disease. PLOS Comput. Biol.14 (12), e1006606. 10.1371/journal.pcbi.1006606
28
GrillW. M.CantrellM. B.RobertsonM. S. (2008). Antidromic propagation of action potentials in branched axons: implications for the mechanisms of action of deep brain stimulation. J. Comput. Neurosci.24 (1), 81–93. 10.1007/s10827-007-0043-9
29
GütigR.AharonovR.RotterS.SompolinskyH. (2003). Learning input correlations through nonlinear temporally asymmetric hebbian plasticity. J. Neurosci.23 (9), 3697–3714. 10.1523/jneurosci.23-09-03697.2003
30
HaddockA.ChizeckH. J.KoA. L. (2019). “Deep neural networks for context-dependent deep brain stimulation,” in 2019 9th International IEEE/EMBS Conference on Neural Engineering (NER), 957–960. 10.1109/NER.2019.8717056
31
HaddockA.VelisarA.HerronJ.Bronte-StewartH.ChizeckH. J. (2017). “Model predictive control of deep brain stimulation for Parkinsonian tremor,” in 2017 8th International IEEE/EMBS Conference on Neural Engineering (NER), 358–362. 10.1109/NER.2017.8008364
32
HallidayD.ConwayB.FarmerS.ShahaniU.RussellA.RosenbergJ. (2000). Coherence between low-frequency activation of the motor cortex and tremor in patients with essential tremor. Lancet355 (9210), 1149–1153. 10.1016/S0140-6736(00)02064-X
33
HerrmannA.GerstnerW. (2002). Noise and the PSTH response to current transients: II. Integrate-and-fire model with slow recovery and application to motoneuron data. J. Comput. Neurosci.12 (2), 83–95. 10.1023/a:1015739523224
34
HerronJ. A.ThompsonM. C.BrownT.ChizeckH. J.OjemannJ. G.KoA. L. (2017). Chronic electrocorticography for sensing movement intention and closed-loop deep brain stimulation with wearable sensors in an essential tremor patient. J. Neurosurg.127 (3), 580–587. 10.3171/2016.8.JNS16536
35
HessC. W.PullmanS. L. (2012). Tremor: clinical phenomenology and assessment techniques. Tremor Hyperkinetic Mov. N. Y. N.2, 02–11. 10.5334/tohm.115
36
HoustonB.ThompsonM.KoA.ChizeckH. (2019). A machine-learning approach to volitional control of a closed-loop deep brain stimulation system. J. Neural Eng.16 (1), 016004. 10.1088/1741-2552/aae67f
37
HungS. W.HamaniC.LozanoA. M.PoonY. Y. W.PiboolnurakP.MiyasakiJ. M.et al (2007). Long-term outcome of bilateral pallidal deep brain stimulation for primary cervical dystonia. Neurology68 (6), 457–459. 10.1212/01.wnl.0000252932.71306.89
38
IzhikevichE. M. (2006). Polychronization: computation with spikes. Neural comput.18 (2), 245–282. 10.1162/089976606775093882
39
KaneD.KarmalkarS.PriceE. (2017). “Robust polynomial regression up to the information theoretic limit,” in 2017 IEEE 58th Annual Symposium on Foundations of Computer Science (FOCS), 391–402. 10.1109/FOCS.2017.43
40
KhaleeqT.HasegawaH.SamuelM.AshkanK. (2019). Fixed-life or rechargeable battery for deep brain stimulation: which do patients prefer?Neuromodulation Technol. Neural Interface22 (4), 489–492. 10.1111/ner.12810
41
KhobragadeN.TuninettiD.GraupeD. (2018). On the need for adaptive learning in on-demand deep brain stimulation for movement disorders. Annu. Int. Conf. IEEE Eng. Med. Biol. Soc. IEEE Eng. Med. Biol. Soc. Annu. Int. Conf.2018, 2190–2193. 10.1109/EMBC.2018.8512664
42
KuoC.-H.White-DzuroG. A.KoA. L. (2018). Approaches to closed-loop deep brain stimulation for movement disorders. Neurosurg. Focus45 (2), E2. 10.3171/2018.5.FOCUS18173
43
LiX.RymerW. Z.ZhouP. (2012). A simulation-based analysis of motor unit number index (MUNIX) technique using motoneuron pool and surface electromyogram models. IEEE Trans. Neural Syst. Rehabil. Eng. Publ. IEEE Eng. Med. Biol. Soc.20 (3), 297–304. 10.1109/TNSRE.2012.2194311
44
LimousinP.KrackP.PollakP.BenazzouzA.ArdouinC.HoffmannD.et al (1998). Electrical stimulation of the subthalamic nucleus in advanced Parkinson’s disease. N. Engl. J. Med.339 (16), 1105–1111. 10.1056/NEJM199810153391603
45
LittleS.BrownP. (2012). What brain signals are suitable for feedback control of deep brain stimulation in Parkinson’s disease?Ann. N. Y. Acad. Sci.1265, 9–24. 10.1111/j.1749-6632.2012.06650.x
46
LittleS.PogosyanA.NealS.ZavalaB.ZrinzoL.HarizM.et al (2013). Adaptive deep brain stimulation in advanced Parkinson disease. Ann. Neurol.74 (3), 449–457. 10.1002/ana.23951
47
LiuC.ZhaoG.MengZ.ZhouC.ZhuX.ZhangW.et al (2021). Closing the loop of DBS using the beta oscillations in cortex. Cogn. Neurodyn.15 (6), 1157–1167. 10.1007/s11571-021-09690-1
48
Lo ConteL. R.MerlettiR.SandriG. V. (1994). Hermite expansions of compact support waveforms: applications to myoelectric signals. IEEE Trans. Biomed. Eng.41 (12), 1147–1159. 10.1109/10.335863
49
MacefieldV. G.GandeviaS. C.Bigland-RitchieB.GormanR. B.BurkeD. (1993). The firing rates of human motoneurones voluntarily activated in the absence of muscle afferent feedback. J. Physiol.471, 429–443. 10.1113/jphysiol.1993.sp019908
50
MasudaH.ShirozuH.ItoY.FukudaM.FujiiY. (2022). Surgical strategy for directional deep brain stimulation. Neurol. Med. Chir. (Tokyo)62 (1), 1–12. 10.2176/nmc.ra.2021-0214
51
MerkT.PetersonV.KöhlerR.HaufeS.RichardsonR. M.NeumannW.-J. (2022). Machine learning based brain signal decoding for intelligent adaptive deep brain stimulation. Exp. Neurol.351, 113993. 10.1016/j.expneurol.2022.113993
52
MerolaA.ZibettiM.ArtusiC. A.RizziL.AngrisanoS.LanotteM.et al (2013). 80 Hz versus 130 Hz subthalamic nucleus deep brain stimulation: effects on involuntary movements. Park. Relat. Disord.19 (4), 453–456. 10.1016/j.parkreldis.2013.01.006
53
MillerK. J. (2019). A library of human electrocorticographic data and analyses. Nat. Hum. Behav.3 (11), 1225–1235. 10.1038/s41562-019-0678-3
54
MillsK. R. (2005). Specialised electromyography and nerve conduction studies. J. Neurol. Neurosurg. Psychiatry76 (Suppl. 2), ii36–ii40. 10.1136/jnnp.2005.068981
55
MilosevicL.KaliaS. K.HodaieM.LozanoA. M.PopovicM. R.HutchisonW. D. (2018). Physiological mechanisms of thalamic ventral intermediate nucleus stimulation for tremor suppression. Brain J. Neurol.141 (7), 2142–2155. 10.1093/brain/awy139
56
MoezziB.SchaworonkowN.PlogmacherL.GoldsworthyM. R.HordacreB.McDonnellM. D.et al (2018). Simulation of electromyographic recordings following transcranial magnetic stimulation. J. Neurophysiol.120 (5), 2532–2541. 10.1152/jn.00626.2017
57
MolnarG. F.PilliarA.LozanoA. M.DostrovskyJ. O. (2005). Differences in neuronal firing rates in pallidal and cerebellar receiving areas of thalamus in patients with Parkinson’s disease, essential tremor, and pain. J. Neurophysiol.93, 3094–3101. 10.1152/jn.00881.2004
58
MorrisonA.DiesmannM.GerstnerW. (2008). Phenomenological models of synaptic plasticity based on spike timing. Biol. Cybern.98 (6), 459–478. 10.1007/s00422-008-0233-1
59
NeumannW.-J.SteinerL. A.MilosevicL. (2023). Neurophysiological mechanisms of deep brain stimulation across spatiotemporal resolutions. Brain J. Neurol.146 (11), 4456–4468. 10.1093/brain/awad239
60
O’HaraD. A.HexemJ. G.DerbyshireG. J.OverdykF. J.ChenB.HenthornT. K.et al (1997). The use of a PID controller to model vecuronium pharmacokinetics and pharmacodynamics during liver transplantation. Proportional-integral-derivative. IEEE Trans. Biomed. Eng.44 (7), 610–619. 10.1109/10.594902
61
OliveiraA. M.CoelhoL.CarvalhoE.Ferreira-PintoM. J.VazR.AguiarP. (2023). Machine learning for adaptive deep brain stimulation in Parkinson’s disease: closing the loop. J. Neurol.270 (11), 5313–5326. 10.1007/s00415-023-11873-1
62
OndoW.JankovicJ.SchwartzK.AlmaguerM.SimpsonR. K. (1998). Unilateral thalamic deep brain stimulation for refractory essential tremor and Parkinson’s disease tremor. Neurology51 (4), 1063–1069. 10.1212/WNL.51.4.1063
63
OpriE.CerneraS.MolinaR.EisingerR. S.CagleJ. N.AlmeidaL.et al (2020). Chronic embedded cortico-thalamic closed-loop deep brain stimulation for the treatment of essential tremor. Sci. Transl. Med.12 (572), eaay7680. 10.1126/scitranslmed.aay7680
64
OzturkM.TelkesI.Jimenez-ShahedJ.ViswanathanA.TarakadA.KumarS.et al (2020). Randomized, double-blind assessment of LFP versus sua guidance in STN-DBS lead implantation: a pilot study. Front. Neurosci.14, 611. 10.3389/fnins.2020.00611
65
PahwaR.LyonsK. E.WilkinsonS. B.SimpsonR. K.OndoW. G.TarsyD.et al (2006). Long-term evaluation of deep brain stimulation of the thalamus. J. Neurosurg.104 (4), 506–512. 10.3171/jns.2006.104.4.506
66
PedrosaD. J.AuthM.EggersC.TimmermannL. (2013). Effects of low-frequency thalamic deep brain stimulation in essential tremor patients. Exp. Neurol.248, 205–212. 10.1016/j.expneurol.2013.06.009
67
PoratB. (1997). A course in digital signal processing. New York: John Wiley.
68
PorterR.LemonR. (1995). “Corticospinal influences on the spinal cord machinery for movement,” in Corticospinal function and voluntary movement. Editors Porter,R.LemonR. (Oxford University Press), 0. 10.1093/acprof:oso/9780198523758.003.0004
69
PrioriA.FoffaniG.RossiL.MarcegliaS. (2013). Adaptive deep brain stimulation (aDBS) controlled by local field potential oscillations. Exp. Neurol.245, 77–86. 10.1016/j.expneurol.2012.09.013
70
RajR.RamakrishnaR.SivanandanK. S. (2016). A real time surface electromyography signal driven prosthetic hand model using PID controlled DC motor. Biomed. Eng. Lett.6 (4), 276–286. 10.1007/s13534-016-0240-4
71
RissanenS. M.KankaanpääM.TarvainenM. P.NovakV.NovakP.HuK.et al (2011). Analysis of EMG and acceleration signals for quantifying the effects of deep brain stimulation in Parkinson’s disease. IEEE Trans. Biomed. Eng.58 (9), 2545–2553. 10.1109/TBME.2011.2159380
72
RissanenS. M.RuonalaV.PekkonenE.KankaanpääM.AiraksinenO.KarjalainenP. A. (2015). Signal features of surface electromyography in advanced Parkinson’s disease during different settings of deep brain stimulation. Clin. Neurophysiol. Off. J. Int. Fed. Clin. Neurophysiol.126 (12), 2290–2298. 10.1016/j.clinph.2015.01.021
73
RosenbaumR.ZimnikA.ZhengF.TurnerR. S.AlzheimerC.DoironB.et al (2014). Axonal and synaptic failure suppress the transfer of firing rate oscillations, synchrony and information during high frequency deep brain stimulation. Neurobiol. Dis.62, 86–99. 10.1016/j.nbd.2013.09.006
74
RosinB.SlovikM.MitelmanR.Rivlin-EtzionM.HaberS. N.IsraelZ.et al (2011). Closed-loop deep brain stimulation is superior in ameliorating parkinsonism. Neuron72 (2), 370–384. 10.1016/j.neuron.2011.08.023
75
RuonalaV. (2022). Surface electromyography and kinematic measurements in Parkinson’s disease: analysis methods for differential diagnosis and quantification of treatment. Disser in Fores and Natura Sci. Publisher: University of Eastern Finland, Faculty of Science and Forestry, Department of Applied Physics[Online]. Available: https://erepo.uef.fi/handle/123456789/27177 (Accessed December 13, 2023).
76
SattarN. Y.SyedU. A.MuhammadS.KausarZ. (2019). “Real-time EMG signal processing with implementation of PID control for upper-limb prosthesis,” in 2019 IEEE/ASME International Conference on Advanced Intelligent Mechatronics (AIM), 120–125. 10.1109/AIM.2019.8868796
77
SchmidtS. L.BrockerD. T.SwanB. D.TurnerD. A.GrillW. M. (2020). Evoked potentials reveal neural circuits engaged by human deep brain stimulation. Brain Stimul.13 (6), 1706–1718. 10.1016/j.brs.2020.09.028
78
ShimazakiH.ShinomotoS. (2010). Kernel bandwidth optimization in spike rate estimation. J. Comput. Neurosci.29 (1), 171–182. 10.1007/s10827-009-0180-4
79
ShimazakiH.ShinomotoS. (2007). A method for selecting the bin size of a time histogram. Neural comput.19 (6), 1503–1527. 10.1162/neco.2007.19.6.1503
80
SilbersteinP.PogosyanA.KühnA. A.HottonG.TischS.KupschA.et al (2005). Cortico-cortical coupling in Parkinson’s disease and its modulation by therapy. Brain J. Neurol.128 (Pt 6), 1277–1291. 10.1093/brain/awh480
81
SteffenJ. K.RekerP.MennickenF. K.DembekT. A.DafsariH. S.FinkG. R.et al (2020). Bipolar directional deep brain stimulation in essential and parkinsonian tremor. Neuromodulation J. Int. Neuromodulation Soc.23 (4), 543–549. 10.1111/ner.13109
82
StepniewskaI.PreussT. M.KaasJ. H. (1994). Thalamic connections of the primary motor cortex (M1) of owl monkeys. J. Comp. Neurol.349 (4), 558–582. 10.1002/cne.903490405
83
SunS.JiangL. P.PetersonS. M.HerronJ.WeaverK.KoA.et al (2020). Unsupervised sleep and wake state identification in long-term electrocorticography recordings. Annu. Int. Conf. IEEE Eng. Med. Biol. Soc. IEEE Eng. Med. Biol. Soc. Annu. Int. Conf.2020, 629–632. 10.1109/EMBC44109.2020.9175359
84
TianY.BelloE.CromptonD.KaliaS. K.HodaieM.LozanoA. M.et al (2023b). Uncovering network mechanism underlying thalamic Deep Brain Stimulation using a novel firing rate model. bioRxiv. 10.1101/2023.12.09.570924
85
TianY.MurphyM. J. H.SteinerL. A.KaliaS. K.HodaieM.LozanoA. M.et al (2023a). Modeling instantaneous firing rate of deep brain stimulation target neuronal ensembles in the basal ganglia and thalamus. Neuromodulation Technol. Neural Interface. 10.1016/j.neurom.2023.03.012
86
TsodyksM.PawelzikK.MarkramH. (1998). Neural networks with dynamic synapses. Neural comput.10 (4), 821–835. 10.1162/089976698300017502
87
UsheM.MinkJ. W.RevillaF. J.WernleA.Schneider GibsonP.McGee-MinnichL.et al (2004). Effect of stimulation frequency on tremor suppression in essential tremor. Mov. Disord.19 (10), 1163–1168. 10.1002/mds.20231
88
VaillancourtD. E.SturmanM. M.Verhagen MetmanL.BakayR. a. E.CorcosD. M. (2003). Deep brain stimulation of the VIM thalamic nucleus modifies several features of essential tremor. Neurology61 (7), 919–925. 10.1212/01.wnl.0000086371.78447.d2
89
VelisarA.Syrkin-NikolauJ.BlumenfeldZ.TragerM. H.AfzalM. F.PrabhakarV.et al (2019). Dual threshold neural closed loop deep brain stimulation in Parkinson disease patients. Brain Stimul.12 (4), 868–876. 10.1016/j.brs.2019.02.020
90
WangK.-L.BurnsM.XuD.HuW.FanS. Y.HanC. L.et al (2020). Electromyography biomarkers for quantifying the intraoperative efficacy of deep brain stimulation in Parkinson’s patients with resting tremor. Front. Neurol.11, 142. 10.3389/fneur.2020.00142
91
WatanabeR. N.MagalhãesF. H.EliasL. A.ChaudV. M.MelloE. M.KohnA. F. (2013). Influences of premotoneuronal command statistics on the scaling of motor output variability during isometric plantar flexion. J. Neurophysiol.110 (11), 2592–2606. 10.1152/jn.00073.2013
92
WattsJ.KhojandiA.ShyloO.RamdhaniR. A. (2020). Machine learning’s application in deep brain stimulation for Parkinson’s disease: a review. Brain Sci.10 (11), 809. 10.3390/brainsci10110809
93
XiaoY.AgnesiF.BelloE. M.ZhangS.VitekJ. L.JohnsonM. D. (2018). Deep brain stimulation induces sparse distributions of locally modulated neuronal activity. Sci. Rep.8 (1), 2062. 10.1038/s41598-018-20428-8
94
YamamotoT.KatayamaY.UshibaJ.YoshinoH.ObuchiT.KobayashiK.et al (2013). On-demand control system for deep brain stimulation for treatment of intention tremor. Neuromodulation J. Int. Neuromodulation Soc.16 (3), 230–235. 10.1111/j.1525-1403.2012.00521.x
95
YaoL.BrownP.ShoaranM. (2020). Improved detection of Parkinsonian resting tremor with feature engineering and Kalman filtering. Clin. Neurophysiol. Off. J. Int. Fed. Clin. Neurophysiol.131 (1), 274–284. 10.1016/j.clinph.2019.09.021
96
ZhangJ.XingY.MaX.FengL. (2017). Differential diagnosis of Parkinson disease, essential tremor, and enhanced physiological tremor with the tremor analysis of EMG. Park. Dis.2017, 1597907. 10.1155/2017/1597907
Summary
Keywords
deep brain stimulation, closed-loop control (CLC) system, physiological model, short-term synaptic plasticity, thalamic ventral intermediate nucleus
Citation
Tian Y, Saradhi S, Bello E, Johnson MD, D’Eleuterio G, Popovic MR and Lankarany M (2024) Model-based closed-loop control of thalamic deep brain stimulation. Front. Netw. Physiol. 4:1356653. doi: 10.3389/fnetp.2024.1356653
Received
15 December 2023
Accepted
18 March 2024
Published
08 April 2024
Volume
4 - 2024
Edited by
Kelly Cristiane Iarosz, Faculdade de Telêmaco Borba (FATEB), Brazil
Reviewed by
Nada Yousif, University of Hertfordshire, United Kingdom
Justus Alfred Kromer, Stanford University, United States
Updates

Check for updates
Copyright
© 2024 Tian, Saradhi, Bello, Johnson, D’Eleuterio, Popovic and Lankarany.
This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Milad Lankarany, milad.lankarany@uhn.ca
Disclaimer
All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher.