Abstract
Deep Brain Stimulation (DBS) is an important tool in the treatment of pharmacologically resistant neurological movement disorders such as essential tremor (ET) and Parkinson's disease (PD). However, the open-loop design of current systems may be holding back the true potential of invasive neuromodulation. In the last decade we have seen an explosion of activity in the use of feedback to “close the loop” on neuromodulation in the form of adaptive DBS (aDBS) systems that can respond to the patient's therapeutic needs. In this paper we summarize the accomplishments of a 5-year study at the University of Washington in the use of neural feedback from an electrocorticography strip placed over the sensorimotor cortex. We document our progress from an initial proof of hardware all the way to a fully implanted adaptive stimulation system that leverages machine-learning approaches to simplify the programming process. In certain cases, our systems out-performed current open-loop approaches in both power consumption and symptom suppression. Throughout this effort, we collaborated with neuroethicists to capture patient experiences and take them into account whilst developing ethical aDBS approaches. Based on our results we identify several key areas for future work. “Graded” aDBS will allow the system to smoothly tune the stimulation level to symptom severity, and frequent automatic calibration of the algorithm will allow aDBS to adapt to the time-varying dynamics of the disease without additional input from a clinician. Additionally, robust computational models of the pathophysiology of ET will allow stimulation to be optimized to the nuances of an individual patient's symptoms. We also outline the unique advantages of using cortical electrodes for control and the remaining hardware limitations that need to be overcome to facilitate further development in this field. Over the course of this study we have verified the potential of fully-implanted, cortically driven aDBS as a feasibly translatable treatment for pharmacologically resistant ET.
1. Introduction
Essential Tremor (ET) is one of the most common neurological movement disorders. By some estimates, it affects as much as 1% of the world's adult population and up to 4.5% of the senior population to some extent (Louis and Ferreira, ). ET manifests itself primarily as a 2–8 Hz tremor during active motion or holding of posture. Classically, the strongest tremor is apparent in the extremities, especially the hands, but will often also be accompanied by trunk tremor (Haubenberger and Hallett, ). Despite its prevalence, the non-lethal nature of the disorder means that it has been understudied for many years and the pathophysiology is still poorly understood (Soto and Fasano, 2020). Once patients are diagnosed, initial treatment is usually pharmacological, but for severe, pharmacologically refractive cases DBS is a promising option (Lyons and Pahwa, ).
Deep brain stimulation (DBS) is a common therapy used to treat neurological disorders. It has been approved by the FDA to treat ET, Parkinson's disease (PD), dystonia, and epilepsy; and is under investigation for treatment of depression, addiction, Tourette syndrome, and many others (Lozano et al., ). In current clinical practice, conventional or continuous DBS (cDBS) is used in an open-loop fashion. Stimulation is configured manually by a clinician and the applied stimulation pattern is fixed (Lyons and Pahwa, ). Parameter tuning is a lengthy process that, even with the expertise of a neurologist, may require several visits before a satisfactory setting is found. Optimal stimulation settings are those that significantly suppress tremor, without causing intolerable side effects. The patient is provided a “patient programmer” that they can use to turn the stimulator on or off, but this control is rather coarse at best and used primarily to conserve battery at night while patients sleep. As a result, stimulation is often delivered even when it is not necessary, which may unnecessarily increase exposure to side effects (Meidahl et al., ).
Adaptive DBS (aDBS) offers to solve many of the limitations of cDBS systems (Arlotti et al., ; Meidahl et al., ). In this approach, stimulation is delivered in a closed-loop format that allows the system to adapt to the patient's state. Stimulation can be applied only when necessary, thereby reducing side effects while maintaining clinical efficacy. Since the stimulation could adapt to the severity of symptoms, stimulation would always be delivered at the optimal level. Moreover, recent evidence suggests that intermittent stimulation may be more effective at suppressing symptoms than cDBS (Little et al., ; Ferleger et al., ). ET is a particularly attractive application for this approach since the primary symptom, tremor, manifests itself almost exclusively during movement. This clearly defines the periods when stimulation would be the most beneficial, greatly reducing the complexity of the control problem to be solved. It is worth noting that naming several conventions exist, with adaptive, closed-loop, and responsive DBS having overlapping definitions. In this work we use adaptive DBS as an umbrella term to describe the various ways in which we have automatically adjusted stimulation based on biomarkers of the patient's state
At the start of our study, aDBS had been demonstrated successfully in patients with PD. Several studies have even shown that in some cases aDBS could be more effective than traditional cDBS or randomly applied intermittent stimulation in ameliorating certain symptoms of PD (Little et al., , ). However, at the start of our study, there was only one known attempt at developing aDBS for ET. In that study, the authors used motion detected through an EMG system on the patient's arm as a control variable for turning DBS on and off (Yamamoto et al., 2013). This study and the encouraging results in the PD space guided much of our early work.
In this paper we review the development process of aDBS in ET patients carried out at the University of Washington. We begin with an overview of both the hardware and software in the research platform we developed around the Medtronic Activa PC+S. We then outline how we reproduced earlier results and developed a proof-of-concept aDBS system using cortical LFPs as a control signal. We then improved this system by leveraging machine learning and investigating volitional BCI-style control of aDBS. By the end of the study, we had arrived at a clinically translatable, fully implantable aDBS paradigm, accompanied by a largely automated programming process. Consequently, aDBS seems to have now reached the threshold where it could be evaluated as a clinical therapy to improve patients' lives. This however brings with it a plethora of neuro-ethical and practical consideration which we discuss. This review paper is intended to provide a an overview of the development process and preliminary clinical results from start to finish. We hope it will provide a unique viewpoint and present practical context for the ongoing development of aDBS for ET.
2. System Integration of the Activa PC+S and Nexus-D Systems
The research system we developed was an integration of multiple independent components. As a result, the system required a significant amount of software development. A full schematic of the system is shown in Figure 1. All research was carried out with the approval of the UW IRB and the FDA. Patients provided informed consent before participating in the study.
Figure 1
2.1. The Medtronic Activa PC+S and Nexus-D
The central component of the research system was the investigational-use Medtronic Activa PC+S, used with FDA permission under an investigational device exemption (IDE, clinical trial number NCT02443181) (Stanslaski et al., 2012). This device consists of a pulse generator implanted (IPG) in the chest which controls both stimulation and sensing capability. The IPG is connected via a subcutaneous clinical lead extension to the stimulation and sensing electrodes. For this protocol, stimulation was delivered using a clinical standard four-electrode DBS stimulation lead, the Medtronic Model 3387, implanted into the ventral intermediate nucleus of the thalamus (VIM). Sensing was performed utilizing a Medtronic Resume-II four-contact strip electrode placed on the surface of the cortex, spanning the central sulcus, roughly over the hand motor area. This configuration allowed for standard tremor-mitigating stimulation to be delivered to the VIM while also allowing the sensing of cortical local field potentials (LFPs) related to hand motor activity. The IPG supports both cDBS and aDBS. cDBS can be configured using the Medtronic 8,840 clinical programmer. aDBS can be performed either in a distributed fashion with control decisions made outside the device, or in a fully implanted fashion with stimulation decisions made on-board after configuration using the Activa PC+S Sensing Tablet. For distributed control of stimulation, the IPG can be paired via a short-range inductive connection with the Medtronic Nexus-D or Nexus-E telemetry bridges. The choice of sampling frequency for the neural data was largely driven by the hardware specifications. This setup can stream raw LFP data to a desktop computer via a USB connection with a sampling rate of up to 422Hz if streaming from one electrode, or 200 Hz if streaming from two simultaneously. In the work presented here, we used the 422 Hz LFP data streams. We found that the benefit to aDBS control of the addition of VIM data was not worth the loss in sampling rate, since LFP data from the VIM was heavily contaminated by stimulation artifacts. However, data is transmitted in discreet packets every 400ms. In practice, the half-duplex inductive link's bandwidth limitations resulted in a small window for stimulation updates to be transmitted to the PC+S without resulting in streamed neural data loss, so stimulation updates in a distributed algorithm needed to be performed with 400 ms resolution. All neural recordings consist of differential voltage recordings between pairs of electrodes. In this use-case we selected our cortical recordings to utilize pairs of electrodes that lay on opposite sides of the central sulcus. These were identified as the pair with the highest beta-band power while the patient was at rest, determined through a standardized montage-sweep provided by the Activa PC+S instruments. The Activa PC+S can also stream analog estimates of power bands at a sampling frequency of 5Hz, with frequency ranges configured on the proprietary Medtronic Sensing Tablet. When not streaming, the sampling rate of the IPG can be increased up to 800 Hz for raw LFP data, and the resulting LFP or power band data can be downloaded to a USB drive via the Medtronic tablet. In the fully implanted aDBS configuration the IPG uses the analog power band estimates from the attached electrodes in combination with a simple linear classifier to control stimulation. Both the power bands and the weights of the classifier are also configured via the Medtronic Sensing Tablet.
2.2. Tremor Sensing and Measurement
To better evaluate the severity of the patient's symptoms and the efficacy of the aDBS paradigm, several modalities of data were collected in parallel to those described above. An Android smartwatch worn on the patient's wrist capable of streaming 9 axis inertial measurement unit (IMU) data (3-axis accelerometer, 3-axis gyroscope, and 3-axis compass) at 100 Hz, was connected to the PC via a Bluetooth connection. This IMU data served as the basis of quantitative and automatic evaluation of tremor. In addition, we asked the patients to perform the tasks from the Fahn-Telosa-Marin tremor rating scale (FTM) (Fahn et al., ). Spiral and line drawings were recorded either on paper or through a custom application on a Microsoft Surface tablet (Sonnet et al., 2020). These, along with videos of the patients, were then rated by a panel of three blinded neurologists to obtain an objective, clinically translatable metric to evaluate the efficacy of DBS. For some experiments, we also used the gTec Mobilab to collect EMG from the study participant's tremoring limb using wet gel electrodes as both a trigger for stimulation and as a method of evaluating the effect of aDBS.
2.3. Software Development and C# API
The distributed elements of the research platform described above were integrated through the PC using an application development framework written in C# (Herron et al., ). This framework utilized a custom developed C# API for generic Nexus-D/Activa PC+S control which enabled simultaneous communication with all sensors and asynchronous dispatch of commands to the Activa PC+S. This C# API was used to develop protocol-specific applications responsible for the collecting and processing data from additional sensors. Multi-threaded coding techniques were used to ensure that sensing, processing, and device communication would not impact the responsiveness of the closed-loop algorithms being investigated. This was further complicated by the fact that the Nexus D and E could not concurrently send data and receive a command, leading to a very narrow timeout window. The API therefore independently maintained an internal model of the Nexus and IPG system states to ensure that all command timings remained in sync. This had additional battery power-saving benefits as the Activa IPG did not need to be queried for its system state. Even with this precise timing capability, the half-duplex nature of the communication hardware and the narrow window for stimulation adjustments to be made before the next data packet needed to be transmitted resulted in a potential delay of 800 ms between the time a biomarker appeared in the patients' brain signals and the time the system could respond by adjusting DBS.
Using this framework, we constructed an experiment control application that enabled rapid development and testing of novel aDBS paradigms. This application, also written in C#, allowed data from any subset of the potential signal sources (neural or wearable) to be streamed simultaneously. Each sensor's data could be visualized in real time and used to control stimulation. Under the hood, each new aDBS paradigm was implemented by editing a single class within the application. This class managed the buffers for all data streams and made the required most recent data available. Once the decision about how to adjust stimulation amplitude was made, the change was passed through another buffer to the Nexus-D API which handled the changing of stimulation. To minimize side effects, stimulation was slowly ramped up, step wise to and from its maximum value. A maximum ramp rate was set for each patient and the software was configured to send individual simulation change commands at the appropriate clock times to manage ramping. This setup allowed development of each new aDBS approach to focus on the meaningful interpretation of biomarkers and stimulation patterns rather than control of individual sensors and timing of stimulation updates.
2.4. Post-hoc Framework
To accurately compare the effectiveness of each of the aDBS algorithms discussed here, we use an evaluation of tremor based on the IMU gyroscope data. For this, we calculate the total power in the frequency band that corresponds to each patient's maximum tremor amplitude. The power spectral density along each of the three axes was calculated independently, and then the magnitude was taken for each frequency using the Euclidean distance. The results are plotted in Figure 2. The components below 1.5 Hz are considered normal characteristics of movement, power in this band indicates that the patient is actively moving. The largest peak in the spectrum in the 1.5–8.0 Hz band was determined to be the patient's peak tremor frequency. Power in this band quantifies the amount of tremor the patient is experiencing.
Figure 2
Tremor algorithms were also evaluated based on total power delivered. Since the onboard circuitry of the Activa PC+S uses relatively little power, stimulation is the largest drain on battery power. Since the Activa PC+S was not rechargeable, ensuring that algorithms delivered stimulation effectively with respect to power consumption was important. To calculate total electrical energy delivered (TEED) we used the following metric:
where V is the voltage, f is the stimulation frequency, p is the pulse width, z is the impedance, τ is the duration of the experiment, and t is the duration that stimulation is applied at this voltage (Moro et al., ; Koss et al., ). To make this metric easier to understand, we give values for TEED as the ratio between the TEED by aDBS, and TEED as if cDBS was applied with the same stimulation parameters. For comparison between algorithms, we use both TEED per second during movement, and TEED per second during rest. Lower TEED during movement with minimal tremor indicates that the stimulation paradigm used was efficient in suppressing tremor. TEED during rest indicates that the algorithm delivered stimulation even when it might not have been necessary. Since suppressing tremor is the prime purpose of aDBS, minor over-stimulation is not considered to be the primary concern. However, if over-stimulation leads to excessive side-effects, or rapidly drains the battery, then it quickly become unacceptable.
At the end of this multi-year study, we had amassed a large collection of longitudinal data. Due to the iterative nature of the development process, the data was not stored in consistent formats and did not always have complete metadata. We therefore developed a python analysis framework to standardize the data formats and enable large-scale longitudinal analysis of all the experiments and data modalities collected. This framework, built around a flexible experiment object, can search a directory tree to discover any sources of potential data and attempt to interpret missing metadata. This resulting dataset can easily be filtered by experiment type or data modalities available. Additionally, any missing or corrupted data resulting from a loss of connectivity or sensor saturation, respectively, was detected and filtered out. This framework has been used to examine the stability of biomarkers over the duration of the study period, as presented in Fraczek et al. (), and discussed in Section 4.3. In the context of this work, we used the framework to re-illustrate previously published data.
3. Development of aDBS for Tremor
Our effort to develop aDBS for ET proceeded from a technology demonstration study in one patient to a clinically translatable, fully implanted system. Here, we will outline the process by which we developed each of these systems and the most important outcomes that informed the next generation of the work.
3.1. Initial Demonstrator
Initial feasibility studies began with the implantation of our first patient in 2015. The goal of this initial work was to demonstrate that system integration was successful and could be used to prototype aDBS paradigms, which had never been done before (Herron et al., , ). These initial experiments would validate the system and allow us to correlate the various modalities of data to the patient's state. Using this data, we began the development and verification of neural biomarkers of movement and tremor to enable neural-driven aDBS (Herron, ; Herron et al., ). To objectively evaluate the effectiveness of any aDBS paradigm, we needed to develop an IMU-based measurement of tremor that could track fast changes in tremor severity. This would then be a test bed that would enable the identification of biomarkers that would not only reliably distinguish times when stimulation was needed but also be robust to changes in stimulation.
Hardware validation experiments with our first patient began before the post-operative lesion effect wore off, about 2 weeks after the implantation surgery. During this time, we calibrated the Activa PC+S recording capabilities and fine-tuned the research setup. The lesion effect had disappeared by the third visit, and the difference in tremor between the stim on and stim off states was fully visible in spiral drawing tasks. Taking inspiration from prior literature described in Yamamoto et al. (2013) where EMG was used to drive a DBS system using a re-engineered patient programmer, we first implemented prototype aDBS paradigms driven by EMG and IMU signals. Each of these devices was used to monitor the patient and detect whether they were actively moving. When movement was detected, stimulation was rapidly ramped up to the therapeutic threshold and maintained until the patient returned to rest. A representative trial for the EMG system is shown in Figure 3. These trials consisted of a comparison of the relevant data during repeated rest, movement, and imagined movement trials. During rest, the patient was asked to simply sit in the chair, while all sensors recorded data to use as a baseline. During movement, they were prompted to raise their hand (at the time of the green vertical lines) and hold it out in front of themselves, until prompted to return to rest (at the time of the red vertical lines). This movement was found to reliably elicit tremor for this patient. Prompt intervals of various lengths, were interleaved so that multiple comparisons could be collected quickly. A similar approach was used for imagined movements, but instead of moving, the patient was asked to instead imagine performing the same movement. This prompt paradigm was used as a template for many of the later experiments through the study. Data collected during these trials allowed us to verify that data was correctly streaming to the central control desktop. Analysis of the IMU data allowed us to develop a metric for tremor severity, described below and shown in the second plot below, which could be computed in near real time. We found this metric correlated to the tremor observed in the patient, based on the FTM scale, while reducing the movement onset and offset artifacts (Herron et al., ). By comparing the neural data obtained during these trials we tested whether our system was able to detect beta band desynchronization both during overt and imagined movement. Moreover, these changes were apparent even during stimulation, despite the dramatic changes in the frequency spectrum observed during DBS. Throughout this initial process, we conducted interviews with the patients to assess their level of comfort and gain a greater understanding of the patient experience.
Figure 3
This system fulfilled its primary goal as a technology demonstrator. aDBS triggered by movement, particularly in the case of EMG, was successful in suppressing tremor while delivering less total stimulation. With an average delay to max level stimulation of 2.40 ± 0.33 s, this resulted in stimulation delivered 76.6% of the time the patient was moving and 15.3% of the time the patient was at rest. This resulted in tremor severity (per Equation 2) during movement of 0.277 compared to 1.296 during no stimulation and 0.6473 during cDBS trials conducted with the same patient during the same session. aDBS driven directly by tremor severity interpreted from IMU data was less successful, due to feedback causing the stimulation to fluctuate wildly. Beta band desynchronization was shown to be reliably identifiable with the hardware available, and therefore a potential control variable for future aDBS systems triggering off of movement-related biomarkers. Although this initial work showed the potential of our system as an investigational device and the promise of aDBS for ET, it also highlighted many of the challenges that would need to be resolved over the rest of the study. Conversations with the patients exposed their reticence to undergo battery replacement surgery, thereby highlighting the importance of conserving battery power. Since streaming neural data used approximately 10 times as much battery as normal operation, experimental sessions were kept succinct and avoided unnecessarily draining the patient's battery. Moreover, using aDBS to minimize the energy usage of stimulation would be an important consideration throughout the rest of the project. The delays inherent in the distributed Activa PC+S system made the control scheme for distributed aDBS difficult to implement. We often observed transient periods of significant tremor at the onset of movement, before the aDBS control caught up and turned-on stimulation. Solving this issue would be one of the main targets we would pursue.
3.2. Distributed BCI Control
Informed by these initial results, we endeavored to build a neural driven, BCI aDBS system (Herron et al.,
Figure 4

Summary of the power spectral differences observed in cortical LFP recordings between the four states of primary interest for each of the four patients who participated in our study. Only single source recordings, performed at the hardware-specified 422 Hz, were used in this visualization, and movement periods were identified by manual inspection of the IMU data. Note the difference in spectral characteristics between the stim off (solid lines) and stim on (dotted lines) cases, as well as the drop in 12–30 Hz band power during movement (orange) compared to rest (blue). These spectra vary significantly between patients, necessitating training of classifiers for each patient individually.
The method we chose to detect movement was the well documented phenomenon of event-related-desynchronization in the beta band (12–30 Hz). This approach consisted of training linear discriminant classifiers to detect significant drops in power in the beta band that corresponded to movement for each patient. Since the application of high-frequency DBS significantly altered the power spectra visible on cortical recordings, two classifiers were trained in parallel, one with DBS off and one with DBS on. Classifier training used the prompted movement task described above. Average power spectra were computed in each of the four states for that patient on that day. A weight was assigned to each frequency bin, based on how much the power in that bin changed between the rest and prompted movement states for each stimulation state. Once the classifiers were trained, the adaptive DBS algorithm proceeded as follows. Starting in the stim off state, the off classifier listened to the neural data stream, calculated power spectra using Welch's method with a Hann window and normalized by the average and standard deviation of the classifier training data. We then took the dot product of this power spectrum with the classifier weights and fed it into a logistic regression function. When this result crossed a pre-set threshold, indicating the onset of volitional movement, stimulation was ramped up to its maximum clinically permitted value over the course of a few seconds, and the system switched to using the stim-on classifier. Since the ramping of stimulation is known to lead to the greatest number of side effects, the ramp rate was carefully tuned to be the fastest pre-set possible ramp rate that was tolerable for the patient. When the stim-on classifier detected that the beta band power had risen back up to levels indicating rest, stim was ramped back down and the system switched back to the stim-off classifier. The progression of cortical beta is shown in the third row of Figure 5. The thresholds were tuned for stimulation sensitivity, as reliably delivering stimulation during movement was considered more important than reliably turning stimulation off when at rest.
Figure 5

Representative example of cortical LFP driven aDBS using the beta desynchronization classifier approach with Patient 1. The inclusion of a separate classifier for the on and off states allows stimulation to stay on through the duration of prompted movements, shown in gray. However, large delays in this distributed system still led to large burst of tremor near the start of movement. Limited resolution of the LFP recordings occasionally lead to the classifier incorrectly switching on or off, as seen at 15 s and during the prompted movement at 100 s. This is a re-illustration of the results in Houston et al. (
The neural BCI approach resulted in a system that could control the delivery of stimulation with a sensitivity of 90 and 100% for the prompted movement and FTM drawing tasks, respectively (Houston et al.,
In a similar vein, we conducted a study in collaboration with the University of Freiburg to investigate distributed aDBS in a way that could more smoothly adapt stimulation and better adapt to the patient state (Castaño-Candamil et al.,
3.3. Fully Implanted Adaptive DBS
The fully implanted system was the culmination of all the work performed and the first potentially clinically translatable system (Ferleger et al.,
Figure 6

Representative trial of the fully implanted aDBS system with Patient 2. Since the classifier is strongly biased towards having stimulation on, the stimulator turns on even during rest. Unlike the previous examples, the cortical beta shown here is the power band estimate computed online by the Activa PC+S during the experiment. Although this is more noisy than the offline spectra, the system was able to respond very quickly to the onset of movement and turn on stimulation. This is a re-illustration of the results in Ferleger et al. (
Classifier training proceeded in a semi-automated fashion leveraging the convenience of a desktop PC to determine a classifier that could be used entirely within the capabilities of the implanted device. Due to hardware limitations, there was no explicit way to pass stimulation state as a parameter to the onboard mechanism. To overcome this, classifiers were trained for each of the four possible states the patient and stimulation system could find themselves in: Stim off, rest; stim on, rest; stim off, movement; and stim on, movement. Thirty seconds of data were collected for each state, with optional repetition of selected tasks. For each of the patients, data from these individual classifiers was combined, which resulted in a classifier that used the power in the band near the stimulation frequency to determine the stimulation state, and the power in the beta band (usually 12.0–28) to distinguish whether the patient was moving or not. Again, since unnecessary stimulation was considered less of an issue that missed stimulation, the classifier was strongly biased towards favoring the stimulated state. This classifier was then uploaded to the IPG and used to switch stimulation on and off. Total time to train this system was under 20 min for each patient. Evaluation of this system was performed in a manner similar to previous experiments, using both tremor suppression calculated from IMU data and total electrical energy delivered.
This system demonstrated the advantages of a fully embedded aDBS system. Although classification had to be performed on simpler hardware, it maintained high levels of effectiveness. The system had a sensitivity of 91.8%, and a false positive rate of 28.7% (Ferleger et al.,
4. Discussion
Over the course of this study, we made several important advancements. We demonstrated the feasibility of aDBS for ET using cortical LFPs as a control signal. We then developed preliminary machine-learning driven BCI and volitional control systems. These elements were then put together to create a fully implantable, clinically translatable aDBS system for ET. Over the course of this process, we came to many conclusions that we hope will be helpful to future generations of aDBS for ET. Here we outline some of the most important conclusions that we came to over the course of this study, both practical and theoretical. We also provide our outlook on what the key hardware and ethical challenges that need to be solved in aDBS for ET.
4.1. Remaining Work
One of the most prevalent issues that we ran into was the control delay inherent in the distributed system. A large part of this delay can be attributed to the hardware limitations of the Activa PC+S. However, any distributed system will necessarily have larger delays due to the increased communication distance over a fully implanted one. Conversely, a distributed system will have much higher computational power and flexibility than a fully implanted one. As we demonstrated in our embedded aDBS experiments, the tradeoffs between these two types of systems can be minimized by utilizing a hybrid approach. By training the system in a distributed fashion, we can utilize the full computational power that larger hardware offers to adapt stimulation in a high dimensional parameter space. By using this system to set the parameters on a simpler, fully-embedded classifier, we can retain the fast response times of a fully embedded system. Future studies will endeavor to further tighten and automate this two-stage control loop. It is likely that the classifier used in the implanted system will not remain effective for long periods of time as the patient's state and medications change. Multi-modal monitoring of the patient's symptoms, with simultaneous streaming of neural, IMU, and even video data, would detect when these changes occur. The system would then either prompt the patient to re-train the classifier or substitute in a previously trained classifier that would better suit the patient's current state.
As has been well documented; side effects of stimulation, especially paresthesia, are often exacerbated while stimulation is being ramped up. To ensure the comfort of our patients, we always set a maximum ramp rate for each patient that did not induce intolerable side effects. Several studies have noted the nuances of stimulation ramp rates but to our knowledge no conclusive best practices have been established (Petrucci et al.,
Due to the communication delays discussed above, we often observed large bursts of transient tremor at the onset of movement. Limitations on the ramp rate necessary for patient comfort mean that the delay between the need for stimulation and when stimulation reached clinically effective levels was even longer. Future studies should therefore investigate aDBS systems with different levels of minimal and maximal stimulation. Instead of switching stimulation between the on and off states, we would instead switch between high and low amplitude stimulation states. The low voltage state would be set low enough to not be noticeable for the patient, and the high level would be at the clinically effective threshold. Since the difference in voltage between states would be smaller, this would enable the system to respond faster without inducing ramping side effects.
All our work has focused on changing the amplitude of the delivered stimulation. There is evidence showing that stimulation amplitude offers the most control of any single parameter adjustment (Cooper et al.,
Another aspect of aDBS that has been shown to be important is the exact methodology of training the neural data classifier. This is highlighted by the comparison between our results and those recently published from the University of Florida (Opri et al.,
4.2. Alternative Approaches
A potential direction of research that we did not fully explore in our study is the potential to smoothly adapt the levels of stimulation to the severity of symptoms. Systems like this could follow a similar approach to the beta thermostat approach demonstrated in the PD literature (Qasim et al.,
One of the great remaining hurdles in the development of aDBS for ET and treatments for ET in general is the limited understanding of the pathology of the disease. Although progress has been made recently suggesting the involvement of multiple network components and the central role of the cerebellum many unanswered questions remain (Raethjen and Deuschl,
aDBS for ET lacks the sort of robust neural biomarkers that are directly correlated to symptoms. In PD, for example, abnormally long bursts of STN beta activity has been shown to be directly correlated to symptoms, while a sharp peak in the gamma band has been shown to be directly correlated to stimulation-induced dyskinesia, resulting in a perfect control signal for ramping DBS amplitude up and down (Whitmer et al., 2012; Little et al.,
Future studies of aDBS with larger numbers of patients will also be capable of investigating the variations observed between patients. Recent work is increasingly suggesting that ET is not a single disorder, but rather a family of related disorders that need to be treated slightly differently (Soto and Fasano, 2020). This is also supported by the wide variation in effective stimulation settings observed even in our relatively small cohort of patients. For most ET patients, the recommended stimulation frequency is close to 140 Hz, but for one of our patients we found the most effective stimulation occurred near frequencies of about 90 Hz. A survey of optimal stimulation parameters determined in an automated way, matched with neural recordings on and off stimulation would be a promising avenue to investigate these differences. In this context, aDBS is firmly in the regime of personalized medicine. Future aDBS applications should retain the focus on tuning stimulation individually to the needs of each specific patient. Broad generalization is useful only in so far as it simplifies the training process of each patients individualized aDBS paradigm and highlights the nuances of each patient's needs.
One of the developments that could most dramatically push aDBS for ET forward is a well-verified, explanatory model of ET. Specifically, such a model should explain at a high level the interactions between brain areas that give rise to pathological ET tremor oscillations. Though one such promising model has recently been proposed, more work is needed to verify this model and determine how it can be fit to patient data (Yousif et al., 2017; Duchet et al.,
4.3. Challenges of Clinical Translatability
As has been noted in several reviews in this field, there is a large gap between the experimental demonstration of aDBS and a clinically translatable treatment (Arlotti et al.,
One of the largest challenges to the clinical translatability of the neural-driven aDBS systems we developed over the course of this study is the availability of on-label cortical strips. These are a required component for the implementation of aDBS systems with that use movement intention sensed from cortex as a control parameter. As implied by our BCI control work, these could also be used in a volitional fashion to seamlessly offer the patient a greater degree of control over stimulation. Recent work along with our own analysis have shown that cortical electrodes such as these retain a high signal to noise ratio for years after implantation (Nurse et al.,
In the fully implanted aDBS system we describe above, training of the implanted algorithm proceeds in a distributed fashion. In our experiments, we train and test the classifiers within a reasonably short time scale of less than a few hours. However, this begs the question of how often these sorts of classifiers will need to be updated. If training need only be repeated once every few months, then a system like this could be tuned during routine clinical visits. Thanks to the automated nature of the system, this could be carried out by a trained technician instead of a neurologist. However, if the algorithm requires updating on a near daily basis, then any clinically translatable approach would need to be deployable to the patient's home. Both the algorithm update itself and detection of the ineffectiveness of the current algorithm would have to be fully automated. It is also not clear how well the control variables used in our experiments would translate to daily activities. In either case, more work will be required to evaluate the robustness of aDBS paradigms developed in this way.
Finally, there are a number of ethical considerations that arise as aDBS systems are translated into common clinical practice. We have discussed a number of these elsewhere, but we provide a short review here (Brown et al.,
4.4. Hardware and Future Systems Outlook
Next generation systems which have been developed and are on the horizon offer significant improvements over the Activa PC+S system.
The Medtronic Summit RC+S offers many of the same capabilities as the Activa PC+S but with greatly improved specifications (Stanslaski et al., 2018). The Summit system can record at 1 kHz, which enables use of gamma band activity (50–100 Hz) to inform aDBS decisions without excessive contamination from Nyquist noise. This is coupled with more advanced, onboard digital spectral power estimation hardware that will provide better accuracy and resolution than the analog system available in the Activa system. The Summit also supports a much more intricate state table for switching stimulation parameters in a fully embedded fashion. This device is already being used to perform aDBS research at several locations (Petrucci et al.,
Another upcoming system is the Medtronic Percept (Goyal et al.,
5. Conclusions
aDBS for ET remains a growing area of investigation. Since the start of this study, the field has developed from a single demonstrative case study to a clinically translatable approach. We have developed aDBS for ET from its initial state to a fully implantable system that could be adapted to clinical practice. This fully implantable system is able to suppress tremor more effectively than cDBS while delivering less total stimulation. Despite this, numerous avenues for advancement remain. The longitudinal efficacy of fully-implanted aDBS algorithms have not been tested in a chronic, at-home environment. All work to date has trained and tested the classifiers within the space of a day, so it is likely that transitioning to a chronic setup will require the development of automated tools that would allow the patient to re-train the aDBS algorithm on a regular basis with minimal input from a clinician. Any clinical translation of this work will depend on the availability of safe, reliable, on-label cortical electrodes. We look forward to the life-changing work that will be done in this space as new hardware, techniques, and understanding becomes available.
Funding
This work was supported by a donation of devices and funds from Medtronic. Reviewed work also includes funding from the following sources: the Department of Defense through the National Defense and Engineering Graduate Fellowship (DoD NDSEG), the National Science Foundation Graduate Reseach Fellowship Program (NSF GRFP), the National Institutes of Health (NIH) award R01-NS065186, BrainLinks-BrainTools Cluster of Excellence funded by the German Research Foundation (DFG, grant no. EXC1086), the Federal Ministry of Education and Research (BMBF, grant no. 16SV8012), and by Award Number EEC-1028725 from the National Science Foundation for the Center for Sensorimotor Neural Engineering, now known as the Center for Neurotechnology.
Author Disclaimer
The content is solely the responsibility of the authors and does not necessarily represent the official views of any funding source.
Publisher's Note
All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.
Statements
Author contributions
TF prepared the figures and wrote the manuscript. BF helped with figure preparation. TB provided input on neuro-ethical considerations and drafting the relevant sections of the manuscript. BF, MT, AH, BH, and JH performed the experiments reviewed here. JO, AK, JH, and HC provided oversight of the research. All authors reviewed the final manuscript.
Conflict of interest
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest. The authors declare that this study received hardware and funding from Medtronic. Medtronic was not involved in the study design, collection, analysis, interpretation of data, the writing of this article or the decision to submit it for publication.
References
1
Al-FatlyB.EwertS.KüblerD.KronebergD.HornA.KühnA. A. (2019). Connectivity profile of thalamic deep brain stimulation to effectively treat essential tremor. Brain142, 3086–3098. 10.1093/brain/awz236
2
ArlottiM.RosaM.MarcegliaS.BarbieriS.PrioriA. (2016). The adaptive deep brain stimulation challenge. Parkinsonism Relat. Disord. 28, 12–17. 10.1016/j.parkreldis.2016.03.020
3
BrownT. (2020). Building intricate partnerships with neurotechnology: deep brain stimulation and relational agency. Int. J. Fem. Approaches Bioeth. 13, 134–154. 10.3138/ijfab.13.1.09
4
BrownT.ThompsonM. C.HerronJ.KoA.ChizeckH.GoeringS. (2016). Controlling our brains-a case study on the implications of brain-computer interface-triggered deep brain stimulation for essential tremor. Brain Comput. Interfaces3, 165–170. 10.1080/2326263X.2016.1207494
5
Casta no-CandamilS.FerlegerB. I.HaddockA.CooperS. S.HerronJ.KoA.et al. (2020). A pilot study on data-driven adaptive deep brain stimulation in chronically implanted essential tremor patients. Front. Hum. Neurosci. 14:421. 10.3389/fnhum.2020.541625
6
CooperS. E.KuncelA. M.WolgamuthB. R.RezaiA.GrillW. M. (2008). A model predicting optimal parameters for deep brain stimulation in essential tremor. J. Clin. Neurophysiol. 25, 265. 10.1097/WNP.0b013e318182ed44
7
DembekT. A.BarbeM. T.ÅströmM.HoevelsM.Visser-VandewalleV.FinkG. R.et al. (2017). Probabilistic mapping of deep brain stimulation effects in essential tremor. Neuroimage Clin. 13:164–173. 10.1016/j.nicl.2016.11.019
8
DuchetB.WeerasingheG.CagnanH.BrownP.BickC.BogaczR. (2020). Phase-dependence of response curves to deep brain stimulation and their relationship: from essential tremor patient data to a wilson-cowan model. J. Math. Neurosci. 10, 1–39. 10.1186/s13408-020-00081-0
9
FahnS.TolosaE.MarínC.et al. (1988). Clinical rating scale for tremor. Parkinsons Dis. Mov. Disord. 2, 271–280.
10
FerlegerB. I.HoustonB.ThompsonM. C.CooperS. S.SonnetK. S.KoA. L.et al. (2020). Fully implanted adaptive deep brain stimulation in freely moving essential tremor patients. J. Neural Eng. 17, 056026. 10.1088/1741-2552/abb416
11
FilipP.LunguO. V.MantoM.-U.BarešM. (2016). Linking essential tremor to the cerebellum: physiological evidence. Cerebellum15, 774–780. 10.1007/s12311-015-0740-2
12
FraczekT. M.KoA. L.ChizeckH. J.HerronJ. A. (2021). Robustness of beta desynchronization from chronically implanted cortical electrodes on multiple time scales, in Submitted to: 43rd Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC) (IEEE), 6041–6044.
13
GoyalA.GoetzS.StanslaskiS.OhY.RusheenA. E.KlassenB.et al. (2021). The development of an implantable deep brain stimulation device with simultaneous chronic electrophysiological recording and stimulation in humans. Biosens. Bioelectron. 176:112888. 10.1016/j.bios.2020.112888
14
HaddockA.MitchellK. T.MillerA.OstremJ. L.ChizeckH. J.MiocinovicS. (2018). Automated deep brain stimulation programming for tremor. IEEE Trans. Neural Syst. Rehabil. Eng. 26, 1618–1625. 10.1109/TNSRE.2018.2852222
15
HaubenbergerD.HallettM. (2018). Essential tremor. N. Engl. J. Med. 378, 1802–1810. 10.1056/NEJMcp1707928
16
HeS.BaigF.MostofiA.PogosyanA.DebarrosJ.GreenA. L.et al. (2021). Closed-loop deep brain stimulation for essential tremor based on thalamic local field potentials. Mov. Disord. 36, 863–873. 10.1002/mds.28513
17
HelmichR. C.ToniI.DeuschlG.BloemB. R. (2013). The pathophysiology of essential tremor and parkinson's tremor. Curr. Neurol Neurosci. Rep. 13, 1–10. 10.1007/s11910-013-0378-8
18
HerronJ.DenisonT.ChizeckH. J. (2015). Closed-loop dbs with movement intention, in 2015 7th International IEEE/EMBS Conference on Neural Engineering (NER) (IEEE), 844–847.
19
HerronJ. A. (2016). Closed-Loop Deep Brain Stimulation: Bidirectional Neuroprosthetics for Tremor and BCI (Ph.D. thesis).
20
HerronJ. A.ThompsonM. C.BrownT.ChizeckH. J.OjemannJ. G.KoA. L. (2016). Chronic electrocorticography for sensing movement intention and closed-loop deep brain stimulation with wearable sensors in an essential tremor patient. J. Neurosurg. 127, 580–587. 10.3171/2016.8.JNS16536
21
HerronJ. A.ThompsonM. C.BrownT.ChizeckH. J.OjemannJ. G.KoA. L. (2017). Cortical brain-computer interface for closed-loop deep brain stimulation. IEEE Trans. Neural Syst. Rehabil. Eng. 25, 2180–2187. 10.1109/TNSRE.2017.2705661
22
HoustonB.ThompsonM.KoA.ChizeckH. (2018). A machine-learning approach to volitional control of a closed-loop deep brain stimulation system. J. Neural Eng. 16, 016004. 10.1088/1741-2552/aae67f
23
HoustonB. C.ThompsonM. C.OjemannJ. G.KoA. L.ChizeckH. J. (2017). Classifier-based closed-loop deep brain stimulation for essential tremor, in 2017 8th International IEEE/EMBS Conference on Neural Engineering (NER) (IEEE), 316–320.
24
IbrahimM. F.BeevisJ. C.EmpsonR. M. (2020). Essential tremor-a cerebellar driven disorder?Neuroscience462, 262–273. 10.1016/j.neuroscience.2020.11.002
25
JohnsonV.WiltR.GilronR.AnsoJ.PerroneR.BeudelM.et al. (2021). Embedded adaptive deep brain stimulation for cervical dystonia controlled by motor cortex theta oscillations. Exp. Neurol. 345:113825. 10.1016/j.expneurol.2021.113825
26
KleinE.BrownT.SampleM.TruittA. R.GoeringS. (2015). Engineering the brain: ethical issues and the introduction of neural devices. Hast. Center Rep. 45, 26–35. 10.1002/hast.515
27
KossA. M.AltermanR. L.TagliatiM.ShilsJ. L. (2005). Calculating total electrical energy delivered by deep brain stimulation systems. Ann. Neurol. 58, 168. 10.1002/ana.20525
28
LittleS.PogosyanA.NealS.ZavalaB.ZrinzoL.HarizM.et al. (2013). Adaptive deep brain stimulation in advanced parkinson disease. Ann. Neurol. 74, 449–457. 10.1002/ana.23951
29
LittleS.PogosyanA.NealS.ZrinzoL.HarizM.FoltynieT.et al. (2014). Controlling parkinson's disease with adaptive deep brain stimulation. J. Vis. Exp. 89:51403. 10.3791/51403
30
LouisE. D.FerreiraJ. J. (2010). How common is the most common adult movement disorder? update on the worldwide prevalence of essential tremor. Mov. Disord. 25, 534–541. 10.1002/mds.22838
31
LozanoA. M.LipsmanN.BergmanH.BrownP.ChabardesS.ChangJ. W.et al. (2019). Deep brain stimulation: current challenges and future directions. Nat. Rev. Neurol. 15, 148–160. 10.1038/s41582-018-0128-2
32
LyonsK. E.PahwaR. (2004). Deep brain stimulation and essential tremor. J. Clin. Neurophysiol. 21, 2–5. 10.1097/00004691-200401000-00002
33
MeidahlA. C.TinkhauserG.HerzD. M.CagnanH.DebarrosJ.BrownP. (2017). Adaptive deep brain stimulation for movement disorders: the long road to clinical therapy. Mov. Disord. 32, 810–819. 10.1002/mds.27022
34
MiddlebrooksE. H.OkromelidzeL.CarterR. E.JainA.LinC.WesterholdE.et al. (2021a). Directed stimulation of the dentato-rubro-thalamic tract for deep brain stimulation in essential tremor: a blinded clinical trial. Neuroradiol. J. 10.1177/19714009211036689. [Epub ahead of print].
35
MiddlebrooksE. H.OkromelidzeL.WongJ. K.EisingerR. S.BurnsM. R.JainA.et al. (2021b). Connectivity correlates to predict essential tremor deep brain stimulation outcome: evidence for a common treatment pathway. Neuroimage Clin. 32:102846. 10.1016/j.nicl.2021.102846
36
MoroE.EsselinkR.XieJ.HommelM.BenabidA.PollakP. (2002). The impact on parkinson's disease of electrical parameter settings in stn stimulation. Neurology59, 706–713. 10.1212/WNL.59.5.706
37
NurseE. S.JohnS. E.FreestoneD. R.OxleyT. J.UngH.BerkovicS. F.et al. (2017). Consistency of long-term subdural electrocorticography in humans. IEEE Trans. Biomed. Eng. 65, 344–352. 10.1109/TBME.2017.2768442
38
OpriE.CerneraS.MolinaR.EisingerR. S.CagleJ. N.AlmeidaL.et al. (2020). Chronic embedded cortico-thalamic closed-loop deep brain stimulation for the treatment of essential tremor. Sci. Transl. Med. 12:eaay7680. 10.1126/scitranslmed.aay7680
39
OpriE.ShuteJ.MolinaR.FooteK.OkunM.GunduzA. (2016). Closing the loop in deep brain stimulation: a responsive treatment for essential tremor (s27. 005). Neurology86(16 Suppl.):S27.005.
40
PanM.-K.LiY.-S.WongS.-B.NiC.-L.WangY.-M.LiuW.-C.et al. (2020). Cerebellar oscillations driven by synaptic pruning deficits of cerebellar climbing fibers contribute to tremor pathophysiology. Sci. Transl. Med. 12:eaay1769. 10.1126/scitranslmed.aay1769
41
PetrucciM. N.AndersonR. W.O'DayJ. J.KehnemouyiY. M.HerronJ. A.Bronte-StewartH. M. (2020). A closed-loop deep brain stimulation approach for mitigating burst durations in people with parkinson's disease, in 2020 42nd Annual International Conference of the IEEE Engineering in Medicine &Biology Society (EMBC) (Montreal, QC: IEEE), 3617–3620.
42
PetrucciM. N.WilkinsK. B.OrthliebG. C.KehnemouyiY. M.O'DayJ. J.HerronJ. A.et al. (2021). Ramp rate evaluation and configuration for safe and tolerable closed-loop deep brain stimulation, in 2021 10th International IEEE/EMBS Conference on Neural Engineering (NER) (Italy: IEEE), 959–962.
43
PfurtschellerG.AranibarA. (1977). Event-related cortical desynchronization detected by power measurements of scalp eeg. Electroencephalogr. Clin. Neurophysiol. 42, 817–826. 10.1016/0013-4694(77)90235-8
44
QasimS. E.de HemptinneC.SwannN. C.MiocinovicS.OstremJ. L.StarrP. A. (2016). Electrocorticography reveals beta desynchronization in the basal ganglia-cortical loop during rest tremor in parkinson's disease. Neurobiol. Dis. 86, 177–186. 10.1016/j.nbd.2015.11.023
45
RaethjenJ.DeuschlG. (2012). The oscillating central network of essential tremor. Clin. Neurophysiol. 123, 61–64. 10.1016/j.clinph.2011.09.024
46
SonnetK. S.FerlegerB. I.KoA. L.ChizeckH. J.HerronJ. A. (2020). Multi-class classification and feature analysis of ftm drawing tasks in a digital assessment of tremor, in 2020 IEEE 20th International Conference on Bioinformatics and Bioengineering (BIBE) (Cincinnati, OH: IEEE), 336–341.
47
SotoM. C. S.FasanoA. (2020). Essential tremor: new advances. Clin. Parkinsonism Relat. Disord. 3:100031. 10.1016/j.prdoa.2019.100031
48
StanslaskiS.AfsharP.CongP.GiftakisJ.StypulkowskiP.CarlsonD.et al. (2012). Design and validation of a fully implantable, chronic, closed-loop neuromodulation device with concurrent sensing and stimulation. IEEE Trans. Neural Syst. Rehabil. Eng. 20, 410–421. 10.1109/TNSRE.2012.2183617
49
StanslaskiS.HerronJ.ChouinardT.BourgetD.IsaacsonB.KremenV.et al. (2018). A chronically implantable neural coprocessor for investigating the treatment of neurological disorders. IEEE Trans. Biomed. Circ. Syst. 12, 1230–1245. 10.1109/TBCAS.2018.2880148
50
SwannN. C.de HemptinneC.ThompsonM. C.MiocinovicS.MillerA. M.OstremJ. L.et al. (2018). Adaptive deep brain stimulation for parkinson's disease using motor cortex sensing. J. Neural. Eng. 15, 046006. 10.1088/1741-2552/aabc9b
51
ToroC.DeuschlG.ThatcherR.SatoS.KuftaC.HallettM. (1994). Event-related desynchronization and movement-related cortical potentials on the ecog and eeg. Electroencephalogr. Clin. Neurophysiol. Evoked Potentials Sect. 93, 380–389. 10.1016/0168-5597(94)90126-0
52
UnterwegerJ.SeeberM.ZanosS.OjemannJ. G.SchererR. (2020). Ecog beta suppression and modulation during finger extension and flexion. Front. Neurosci. 14:35. 10.3389/fnins.2020.00035
53
WhitmerD.de SolagesC.HillB.YuH.HendersonJ.Bronte-StewartH. (2012). High frequency deep brain stimulation attenuates subthalamic and cortical rhythms in parkinson's disease. Front. Hum. Neurosci. 6:155. 10.3389/fnhum.2012.00155
54
YamamotoT.KatayamaY.UshibaJ.YoshinoH.ObuchiT.KobayashiK.et al. (2013). On-demand control system for deep brain stimulation for treatment of intention tremor. Neuromodulation16, 230–235. 10.1111/j.1525-1403.2012.00521.x
55
YousifN.MaceM.PaveseN.BorisyukR.NandiD.BainP. (2017). A network model of local field potential activity in essential tremor and the impact of deep brain stimulation. PLoS Comput. Biol. 13:e1005326. 10.1371/journal.pcbi.1005326
Summary
Keywords
essential tremor, deep brain stimulation, machine learning, motor cortex, adaptive deep brain stimulation, fully implantable
Citation
Fra̧czek TM, Ferleger BI, Brown TE, Thompson MC, Haddock AJ, Houston BC, Ojemann JG, Ko AL, Herron JA and Chizeck HJ (2021) Closing the Loop With Cortical Sensing: The Development of Adaptive Deep Brain Stimulation for Essential Tremor Using the Activa PC+S. Front. Neurosci. 15:749705. doi: 10.3389/fnins.2021.749705
Received
29 July 2021
Accepted
04 November 2021
Published
08 December 2021
Volume
15 - 2021
Edited by
Coralie de Hemptinne, University of Florida, United States
Reviewed by
J. Luis Lujan, Mayo Clinic College of Medicine and Science, United States; Kara A. Johnson, University of Florida, United States
Updates

Check for updates
Copyright
© 2021 Fra̧czek, Ferleger, Brown, Thompson, Haddock, Houston, Ojemann, Ko, Herron and Chizeck.
This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Jeffrey A. Herron jeffherr@uw.edu
This article was submitted to Neural Technology, a section of the journal Frontiers in Neuroscience
Disclaimer
All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher.