Skip to main content

ORIGINAL RESEARCH article

Front. Hum. Neurosci., 04 May 2022
Sec. Brain Imaging and Stimulation
Volume 16 - 2022 | https://doi.org/10.3389/fnhum.2022.842954

Transcranial Direct Current Stimulation Targeting the Entire Motor Network Does Not Increase Corticospinal Excitability

Joris Van der Cruijsen1,2* Zeb D. Jonker1,3,4 Eleni-Rosalina Andrinopoulou5,6 Jessica E. Wijngaarden1,2 Ditte A. Tangkau1 Joke H. M. Tulen7 Maarten A. Frens3 Gerard M. Ribbers1,4 Ruud W. Selles1,8
  • 1Department of Rehabilitation Medicine, Erasmus MC, University Medical Center Rotterdam, Rotterdam, Netherlands
  • 2Department of Biomechanical Engineering, Delft University of Technology, Delft, Netherlands
  • 3Department of Neuroscience, Erasmus MC, University Medical Center Rotterdam, Rotterdam, Netherlands
  • 4Rijndam Rehabilitation Centre, Rotterdam, Netherlands
  • 5Department of Biostatistics, Erasmus MC, University Medical Center Rotterdam, Rotterdam, Netherlands
  • 6Department of Epidemiology, Erasmus MC, University Medical Center Rotterdam, Rotterdam, Netherlands
  • 7Department of Psychiatry, Erasmus MC, University Medical Center Rotterdam, Rotterdam, Netherlands
  • 8Department of Plastic and Reconstructive Surgery and Hand Surgery, Erasmus MC, University Medical Center Rotterdam, Rotterdam, Netherlands

Transcranial direct current stimulation (tDCS) over the contralateral primary motor cortex of the target muscle (conventional tDCS) has been described to enhance corticospinal excitability, as measured with transcranial magnetic stimulation. Recently, tDCS targeting the brain regions functionally connected to the contralateral primary motor cortex (motor network tDCS) was reported to enhance corticospinal excitability more than conventional tDCS. We compared the effects of motor network tDCS, 2 mA conventional tDCS, and sham tDCS on corticospinal excitability in 21 healthy participants in a randomized, single-blind within-subject study design. We applied tDCS for 12 min and measured corticospinal excitability with TMS before tDCS and at 0, 15, 30, 45, and 60 min after tDCS. Statistical analysis showed that neither motor network tDCS nor conventional tDCS significantly increased corticospinal excitability relative to sham stimulation. Furthermore, the results did not provide evidence for superiority of motor network tDCS over conventional tDCS. Motor network tDCS seems equally susceptible to the sources of intersubject and intrasubject variability previously observed in response to conventional tDCS.

Introduction

Research involving transcranial direct current stimulation (tDCS) has been growing exponentially since Nitsche and Paulus (2000) described its enhancing effects on the excitability of the motor system. Nitsche and Paulus (2000) applied transcranial magnetic stimulation (TMS) to assess changes in corticospinal excitability (CSE), reflected by motor evoked potentials (MEPs). They reported that motor evoked potentials significantly increased after 10 min of tDCS to the contralateral primary motor cortex (cM1). In tDCS motor studies, it has frequently been suggested that tDCS could lead to better motor learning (Antal et al., 2004; Reis et al., 2009; Stagg et al., 2011; Saucedo Marquez et al., 2013) and could benefit motor rehabilitation, for example after stroke (Hummel and Cohen, 2006; Santos Ferreira et al., 2019). On the other hand, however, other studies have failed to demonstrate a consistent effect of tDCS on corticospinal excitability (Bastani and Jaberzadeh, 2013; Wiethoff et al., 2014; Dyke et al., 2016; Jonker et al., 2021) and motor learning (Ammann et al., 2016; van der Vliet et al., 2017).

A significant part of the tDCS effectiveness research focuses on finding optimal stimulation parameters to improve the reliability and magnitude of tDCS effects. These stimulation parameters include stimulation duration (Nitsche and Paulus, 2000; Agboada et al., 2019), focality (Dmochowski et al., 2011), and location. For instance, stimulation of the premotor cortex, instead of the M1, has been found to result in a more robust increase in M1 excitability (Boros et al., 2008; Lefebvre et al., 2019). These findings indicate that stimulating other motor-related brain regions than the M1 can also modulate corticospinal excitability.

Recently, applying tDCS to regions functionally connected to the M1 was found to increase corticospinal excitability more than stimulation of M1 alone (Fischer et al., 2017). The rationale behind motor network tDCS was that the contralateral M1 does not act in isolation but communicates with functionally connected brain regions; consequently, brain regions connected to contralateral M1 influence the effect of stimulation on the contralateral M1. Therefore, Fischer et al. (2017) hypothesized that multifocal stimulation of the entire motor system would result in a larger change in corticospinal excitability. Although the stimulation field strength directly on the contralateral M1 was lower during motor network tDCS than for conventional tDCS, Fischer et al. (2017) the increase in corticospinal excitability was larger during motor network than conventional stimulation. Therefore, motor network tDCS may provide new leads to more effective tDCS interventions and a better understanding of the physiological basis of corticospinal excitability.

The promising results of motor network tDCS on corticospinal excitability have been described by only a single study. Since reproducibility in tDCS has been challenged due to low sample sizes (Minarik et al., 2016) and intersubject and intrasubject variability (Horvath et al., 2014, 2015; López-Alonso et al., 2014, 2015; Dyke et al., 2016; Jonker et al., 2021), replicating these findings is necessary to assess the reliability of motor network tDCS. Therefore, the primary goal of our study was to verify in a within-subject design if tDCS applied to the entire motor network leads to higher increases in corticospinal excitability than conventional tDCS targeting only the contralateral M1. The secondary goal of the study was to assess whether motor network tDCS and conventional tDCS increased corticospinal excitability compared to sham stimulation.

Materials and Methods

Participants

Twenty-one healthy subjects participated in this study (age: 18–30 years; 13 female). All participants gave written informed consent before the experiment. Participants were self-reported right-handed and free of known neuromuscular disorders. The study was approved by the Medical Ethics Review Board of the Erasmus University Medical Center (NL64529.078.18). All experimental procedures were conducted in accordance with the Declaration of Helsinki (2013).

Experimental Design

Transcranial Direct Current Stimulation Conditions

Participants received non-invasive brain stimulation in three different tDCS configurations in a randomized, counterbalanced order in three experimental sessions separated by at least 48 h (Alonzo et al., 2012). Randomization of the applied stimulation configuration was performed a priori for the entire study. The participants were fully blinded and the investigators were partially blinded to the applied tDCS condition due to the different electrode locations in which stimulation electrodes were inserted for each stimulation configuration. To blind participants, stimulation electrodes were inserted in all nine electrode locations used in this experiment, regardless of whether the electrodes were used in a specific electrode configuration. Since the StarStim 8 only allows connecting eight electrodes, the investigators could not be blinded to the difference between motor network and conventional tDCS. However, investigators were blinded to the difference between motor network and sham tDCS.

All tDCS was applied using a StarStim 8 stimulator (Neuroelectrics, Barcelona, Spain) and a 128-channel EEG cap (TMSi, Oldenzaal, Netherlands) which was aligned according to the international 10/5 system (Oostenveld and Praamstra, 2001). We used platinum stimulation electrodes that could be manually inserted into any electrode location of the EEG cap. The surface contact area of the stimulation electrodes with the scalp was 0.79 cm2. We injected Sigma Gel (Parker Laboratories, Inc., Fairfield, NJ, United States) and used NIC 2.1 software (Neuroelectrics, Barcelona, Spain) to reduce the skin-electrode impedance below 2 kΩ when stimulation was applied.

Motor Network Transcranial Direct Current Stimulation

Motor network tDCS (Figure 1A) was performed as described by Fischer et al. (2017) to stimulate the entire motor network with 8 electrodes in total. Positive stimulation electrodes were placed over the primary motor cortices at C1, C2, C3, C4, T8 with input currents of 0.872, 0.888, 1.135, 0.922, and 0.183 mA, respectively. Negative stimulation electrodes were inserted at Fz, P3, and P4 with currents of −1.843, −1.121, and −1.035 mA, respectively. An additional electrode was inserted at the Fp2 channel (only actively used during conventional tDCS) to blind participants to the difference between motor network and conventional tDCS.

FIGURE 1
www.frontiersin.org

Figure 1. TDCS electrode configurations overview. (A) Motor network and sham tDCS configurations. (B) Conventional tDCS configuration. Red, anodes; blue, cathodes; white, electrodes not actively used for the stimulation configuration. Stimulation electrodes were inserted at all locations in all conditions to blind the participants from the applied configuration. Figure created using eeglab.

Conventional Transcranial Direct Current Stimulation

Conventional tDCS (Figure 1B) was based on Nitsche and Paulus (2000), with a single positive electrode placed over the contralateral primary motor cortex and a negative electrode on the ipsilateral supraorbital. Contrary to the original report by Nitsche and Paulus (2000), we placed the anode at C3 instead of directly above the motor hand area. C3 has been used as a standardized alternative in studies in which stimulation was applied through an EEG head cap, leading to similar changes in corticospinal excitability (Murray et al., 2015; Fischer et al., 2017; Rawji et al., 2018). Using standardized locations, we inserted a positive stimulation electrode at C3 and a negative stimulation electrode at Fp2. A 2-mA current was generated in between these electrodes to stimulate the contralateral primary motor cortex. Compared to motor network tDCS, the injection currents used for conventional tDCS lead to the highest current density (25.46 A/m2) at the scalp. This current density has been described as safe, with minimal sensation and no skin damage (Bikson et al., 2009). To blind the participants, stimulation electrodes were also inserted at the electrode locations used for motor network tDCS.

Motor Network Sham

Sham tDCS (Figure 1A) has been widely used as a control condition in tDCS/TMS research and mimics the sensation of active tDCS (Woods et al., 2016). Sham protocols only inject current at the beginning and the end of stimulation, resembling what participants experience in active stimulation conditions. We used the same electrode locations as the motor network condition in our sham stimulation.

Stimulation Protocol

The total stimulation duration was 12 min for all stimulation conditions. Both non-sham stimulation conditions consisted of three phases: (1) ramp up, in which the stimulation intensity linearly builds up from 0 to 100% in 60 s, (2) 10 min of constant stimulation at 100%, and (3) 60 s ramp down in which current linearly reduced from 100 to 0%. The sham condition was designed to give the same sensation as during active stimulation (Woods et al., 2016). It, therefore, consisted of a similar ramp-up phase of 60 s, directly followed by a ramp down phase of 60 s, which was repeated 10 min after the start of the stimulation session, resulting in a total duration of 12 min. In the sham condition, injection currents were built up to the same levels as motor network stimulation.

Corticospinal Excitability Measurements

We assessed corticospinal excitability (Barker et al., 1985) before we applied tDCS and at 0, 15, 30, 45, and 60 min after tDCS finished. Corticospinal excitability was assessed by measuring MEPs from the first dorsal interosseous (FDI) resulting from monophasic TMS pulses (MagPro X100 stimulator with an MC-B70 figure-eight coil, MagVenture, Farum, Denmark) applied to the motor hand area guided by a neuronavigational system (Polaris Spectra motion tracking system, NDI, Canada and visor2 software, ANT Neuro, Hengelo, Netherlands) to ensure MEP stability (Julkunen et al., 2009). We calculated MEPs from EMG activity, recorded at 5000 Hz with Ag/AgCl electrodes in a belly-tendon montage connected to a custom biosignal amplifier (TMSi, Oldenzaal, Netherlands).

From the EMG data, MEPs were online calculated as the largest peak-to-peak amplitude within 50 ms after a TMS pulse. The motor hand area was identified as the scalp location corresponding to the highest recorded MEPs. We stimulated at 50% of the maximum stimulator output on the motor cortex region (around C3 electrode) as an initial starting location to find the motor hand area. Throughout this process, we held the TMS coil tangent to the scalp, with the coil handle in the posterolateral direction rotated 45° from the midline. We increased the stimulation intensity in 5% increments until a scalp location was found for which the MEP exceeded 50 μV. At this location, about 10–20 pulses were required to determine the RMT, i.e., the stimulation intensity resulting in an MEP greater than 50 μV with a probability of 50% (Awiszus and Borckardt).

At this motor hand area, corticospinal excitability was assessed before tDCS (baseline) and 0, 15, 30, 45, and 60 min after tDCS using a fixed series of 65 TMS pulses on each time point. In these series, the inter-stimulus interval varied randomly between 2 and 5 s at a stimulation intensity of 120% of the RMT. Coil position and orientation relative to the scalp were monitored in real-time using the neuronavigational system to ensure a constant position throughout the measurement. EMG activity preceding the TMS pulses was also visually monitored. If persistent EMG activity was detected, we paused the TMS pulses and instructed participants to relax their muscles while providing real-time visual feedback on their EMG activity. The coil position during all TMS pulses and all EMG data were stored for offline analysis.

Power Estimation

We estimated the statistical power to find a significant tDCS effect based on the MEP data published by Fischer et al. (2017). We considered the baseline-normalized data and identified the mean and standard errors of the mean (SEM) at time points directly after tDCS, and at 15, 30, and 60 min after the intervention. Due to the unbalanced distribution of these time points, the grand average of corticospinal excitability is biased toward early time points, where post-tDCS corticospinal excitability is generally lower. Therefore, we added a measurement point at 45 min after tDCS by linearly interpolating the MEP means and SEMs at 30 and 60 min to compensate for this bias. We calculated the statistical power to find a significant effect between motor network tDCS and conventional tDCS, between motor network tDCS and sham tDCS, and conventional tDCS and sham tDCS.

The power analysis was performed by simulation, assuming corticospinal excitability was normally distributed around each time point. For motor network tDCS and conventional tDCS, we considered the data of the left hemisphere, and for sham tDCS, we used the data recorded from the right M1 during conventional tDCS targeting the left M1. We converted all SEMs to standard deviations by multiplying with the square root of the sample size (15) of Fischer et al. (2017). Using the means and standard deviations, we calculated the MEP ratios (±SD) averaged over all time points (motor network tDCS: 1.324 ± 0.284; conventional tDCS: 1.151 ± 0.144; sham tDCS: 1.008 ± 0.151), removing the time information to enhance statistical power. We simulated 10,000 data sets for sample sizes ranging from 10 to 50 subjects. We applied a linear mixed effect model (see section “Analysis”) with a fixed intercept and fixed term for stimulation condition to each dataset to investigate if post-tDCS/pre-tDCS MEP ratio differed between tDCS configurations. For each sample size, we extracted the number of p-values below 0.05 as a measure for statistical power. The simulations showed that a sample size of 21 subjects had a power of 70% to find that motor network tDCS significantly (p < 0.05) increases the post/pre-tDCS MEP ratio compared to conventional stimulation. Additional computations showed that the inclusion of 21 subjects in a within-subjects design provided a power of 99% to find that motor network tDCS increases the MEP ratio compared to sham tDCS, and a power of 86% to find that conventional tDCS increases the MEP ratio compared to sham tDCS.

Analysis

We calculated MEPs from the raw, continuous EMG data using EEGLAB (Delorme and Makeig, 2004) for experimental sessions. We first high-pass filtered the data (3 Hz, order: 1650) and then calculated MEPs as the peak-to-peak amplitude of the EMG signal within 50 ms after each TMS pulse. The mean and standard deviation (SD) of the coil position for all MEPs were calculated per session. Any TMS pulses applied while the coil position exceeded the mean coil position +3 SD were discarded from the analysis. Furthermore, TMS pulses in which the pre-TMS EMG amplitude in the 100 ms before the pulse exceeded the mean EMG amplitude +3 SD of all pulses within an experimental session were removed. The remaining pulses were considered the cleaned MEP data.

As a first step in the statistical analysis, we investigated if baseline corticospinal excitability differed between experimental sessions by applying a linear mixed-effects model. We defined two mixed-effects models with random intercepts per subject. For the full model, we included an intercept and the variable stimulation condition in the fixed-effects part. In both models, visual inspection indicated that baseline corticospinal excitability required a log-transform to ensure the residuals were normally distributed and homoscedastic. The likelihood ratio test was applied between both models to determine if baseline corticospinal excitability systematically varied between stimulation conditions. By doing so, we could identify potential systematic differences in baseline excitability that could intervene with any condition effects.

Since the variability in tDCS response has previously been attributed to intersubject variability, we screened for the presence of consistent responders in our sample. We looked for consistent responders in our data and defined those as subjects in which both network and conventional stimulation resulted in MEP ratios greater than one and were higher than the MEP ratio recorded during sham tDCS. We calculated the individual response to each stimulation condition as the ratio between the grand average of post-tDCS MEPs and baseline corticospinal excitability. As such, ratios above 1 correspond to enhanced cortical excitability, considered positive responses.

Next, we assessed the group effects of the different tDCS configurations on MEP ratios by applying a linear mixed-effects model with a random intercept per subject and a fixed effect term for stimulation condition. We evaluated two versions of the linear mixed-effects model. In the first model, visual inspection indicated log-transform was required for the outcome to ensure the residuals were both normally distributed and homoscedastic. In the second model, we performed a sensitivity analysis in which we removed outliers from the data, after which the residuals were normally distributed and homoscedastic, and the data was modeled accordingly. In this second mixed-effect model, we subtracted 1 from all MEP ratios, such that the intercept of the model corresponding to the average MEP ratio of sham stimulation could be interpreted. Finally, we investigated if the MEP ratio depended on baseline excitability by calculating the correlation coefficient between baseline excitability and the MEP ratio. After visually evaluating the distribution of MEP ratio and baseline corticospinal excitability, we calculated Pearson’s correlation coefficient for each stimulation condition. All statistical analyses were performed in MATLAB (MathWorks, Natick, MA, United States).

Results

Transcranial Magnetic Stimulation Data

Subject-specific resting motor threshold and baseline corticospinal excitability per condition are described in Supplementary Table 1. One participant (319) was unable to undergo the conventional stimulation protocol due to technical issues with the tDCS device. Within subjects, the mean (±SD) difference between the highest and lowest resting motor threshold (RMT) in all experimental sessions was 5% ± 3, indicating that RMTs were relatively constant over multiple sessions. On average, we discarded 6.2 ± 3.8 trials per subject from the analysis because the coil position deviated too much from the mean coil position or because too strong EMG activity preceded the TMS pulse. Comparison of the full and null linear mixed-effects models indicated the differences in baseline corticospinal excitability between sham stimulation (2203 ± 1562 μV), conventional tDCS (1753 ± 1349 μV), and motor network tDCS (2043 ± 1252 μV) were non-significant [λLR(2) = 1.45, p = 0.485].

Corticospinal Excitability – Subject Level

Inspection of the MEP ratios for the different tDCS conditions (Figure 2) indicated that during conventional tDCS, three subjects were outliers compared to the rest of the subjects. These subjects had MEP ratios higher than 2, compared to the condition median of 1.01. The baseline excitability of these subjects was lower than the condition average (1860 ± 1297 μV) with 482.6, 489.6, and 514.1 μV. In our data, MEP ratios above 1 were found 11 times during sham, 12 times during conventional, and 11 times during network stimulation, but corticospinal excitability was not consistently modulated within subjects as hypothesized. More specifically, only one subject could be considered a consistent tDCS responder, i.e., showing an increase in corticospinal excitability for network and conventional tDCS greater than registered during sham stimulation. All other subjects had at least once MEP ratios below 1 for conventional or network tDCS or a stronger response from sham stimulation compared to conventional or network tDCS.

FIGURE 2
www.frontiersin.org

Figure 2. Scatter plot of the post-tDCS/pre-tDCS MEP ratio for sham, conventional, and network tDCS. Each data point corresponds to a single subject. Three subjects, shown as triangles, were considered outliers [outside the median (black marker) ± 1.5 times the interquartile range (error bars)], explaining the high standard deviations and the relatively high group response observed after conventional tDCS. Data of the same subject are connected with gray lines. Jitter was applied to the plot to enhance the readability. Figure created using eeglab.

Corticospinal Excitability – Group Level

The group-level statistical analysis on the post-tDCS/pre-tDCS MEP ratios revealed no effect for conventional stimulation [b = 0.198, t(59) = 1.755, p = 0.084] or network stimulation [b = 0.035, t(59) = 0.317, p = 0.753], indicating that averaged over all subjects tDCS did not enhance corticospinal excitability relative to sham stimulation. The average time courses of corticospinal excitability are shown in Supplementary Figure 1. Due to the three outliers identified in Figure 2 in the conventional tDCS response, we performed a sensitivity analysis to determine the effect of outliers on the statistical analysis. When we excluded the three outlier subjects from all three conditions and applied the linear mixed-effects model, the conventional condition effect [MEP ratio (mean ± SD): 1.05 ± 0.26 μV] diminished [b = −0.005, t(50) = −0.052, p = 0.959] and the network effect [MEP ratio (mean ± SD): 1.05 ± 0.26 μV] remained equally low [b = −0.007, t(50) = −0.071, p = 0.944]. In addition, the model’s intercept [b = 0.061, t(50) = 0.822, p = 0.415], i.e., the response to sham tDCS [MEP ratio (mean ± SD): 1.06 ± 0.40 μV], indicated that there was no mean change in corticospinal excitability for the control condition. Overall, these results indicate that MEP ratios were highly variable and on average for both conventional and motor network tDCS were equal to sham stimulation. Finally, we found that baseline excitability did not correlate with the MEP ratio of sham (p = 0.27), conventional (p = 0.05), or network tDCS (p = 0.14).

Discussion

The primary goal of this study was to investigate if tDCS targeting the motor network of healthy subjects leads to larger changes in corticospinal excitability compared to conventional stimulation. Compared to sham stimulation, our sample of 21 healthy participants showed no significant increase in corticospinal excitability after motor network tDCS or conventional tDCS. Consequently, the results did not provide evidence for the superiority of motor network tDCS over conventional tDCS.

Our study is, to our knowledge, the first that attempts to replicate the effect of motor network tDCS on corticospinal excitability. We conducted the experiment in a larger sample (n = 21) than the original study (n = 15) (Fischer et al., 2017). Furthermore, we added sham stimulation as a control condition to distinguish potential TMS effects from tDCS effects. Nonetheless, no effect of motor network tDCS relative to conventional or even sham stimulation was found in our study. The inability to replicate the effects of motor network tDCS on corticospinal excitability fits with previous studies that recently challenged the potential of conventional tDCS (Wiethoff et al., 2014; Horvath et al., 2016; Tremblay et al., 2016; Jonker et al., 2021) and hd-tDCS (Pellegrini et al., 2020) to enhance corticospinal excitability.

Several factors may explain why we found no effect of motor network tDCS on corticospinal excitability. First, we did not control for intersubject and intrasubject variability in baseline corticospinal excitability. Previous studies that described positive effects of anodal tDCS controlled baseline corticospinal excitability by adjusting TMS intensity to elicit MEPs between 1 and 1.5 mV (Nitsche et al., 2004; Kuo et al., 2013). However, this would increase the intersubject variability in stimulation intensity, increasing the likelihood of stimulation intensity being an extraneous variable. Importantly, we found baseline corticospinal excitability did not correlate with the change in corticospinal excitability after tDCS. Also, baseline corticospinal excitability did not significantly vary between sessions in our sample. Furthermore, several studies show that adjusting TMS intensity to control for baseline corticospinal excitability is not a prerequisite for finding positive tDCS effects (Lang et al., 2004; Nitsche et al., 2004; Di Lazzaro et al., 2012; Pellicciari et al., 2013). Therefore, we do not consider variability in baseline excitability to explain the absence of a tDCS effect in our study.

A second factor explaining why tDCS did not affect corticospinal excitability could be the applied TMS protocol. In our study, the number of TMS pulses was relatively high (65 per interval; 390 per session) and the inter-stimulus-interval relatively short (2–5 s), which can affect corticospinal excitability (Julkunen et al., 2012; Pellicciari et al., 2016), and potentially intervene with a tDCS effect. However, a similar number of pulses has been used to demonstrate the enhancing effect of anodal tDCS on corticospinal excitability (Wiethoff et al., 2014). Furthermore, we used a sham condition to distinguish tDCS from potential effects on corticospinal excitability introduced by the TMS protocol. Our statistical analysis revealed no effect of sham stimulation on corticospinal excitability. Consequently, we argue that our TMS protocol did not interfere with potential tDCS effects (Horvath et al., 2015). We also inspected the response per subject for the three stimulation conditions to investigate subgroups of tDCS responders in our sample. Previous research has shown that in the absence of group effects, subgroups of tDCS responders may exist (Wiethoff et al., 2014). While MEP ratios above 1 were found in all conditions, there was no consistent corticospinal excitability enhancement for conventional and network tDCS in individual subjects. Only in one subject, conventional and network tDCS resulted in a stronger increase of cortical excitability compared to sham stimulation.

Finally, we applied TMS only on the contralateral motor cortex, which is different compared to Fischer et al. (2017), who applied TMS to both hemispheres. Thus, the effect of motor network tDCS described by Fischer et al. (2017) could originate from a combination of bilateral mixed TMS and tDCS and therefore be absent in our current study. An additional difference is the smaller electrode size we used for tDCS. Smaller electrodes lead to more focal electric fields in the brain (Mikkonen et al., 2020). Together with the standardized electrode locations we used, it could thus be that the peak electric fields were not located at the intended M1 target due to interindividual differences in brain anatomy relative to standardized EEG locations (Scrivener and Reader, 2022). Nonetheless, modeling studies indicate that the small stimulation electrodes generate electric fields in M1 that exceed those of large electrodes (up to 35 cm2) in a broad cortical area (Mikkonen et al., 2020), supporting the use of small electrodes in standardized EEG locations.

There are some limitations in our study that need to be considered. First, the primary goal of this study is somewhat limited by the relatively low power for the comparison between motor network tDCS and conventional tDCS. Our a priori power calculation, based on the data published by Fischer et al. (2017), indicated that our within-subject design of 21 healthy participants provided 70% chance of finding an effect of motor network tDCS relative to conventional tDCS. Thus, we should be careful with concluding that motor network stimulation is non-superior compared to conventional stimulation. However, because we did not find effects of both motor network tDCS and conventional tDCS relative to sham tDCS, despite high a priori powers for these comparisons (99 and 86%, respectively), it is unlikely that one intervention worked better than the other.

An additional limitation follows from the conventional sham protocol, which is under debate because it was shown that sham stimulation could not reliably mask active stimulation from sham stimulation in within-subject design studies (Ambrus et al., 2012; Fonteneau et al., 2019; Greinacher et al., 2019). Recently, new protocols have been suggested to better blind participants from active stimulation, for instance, by continuous stimulation in a montage that exceeds the skin’s perception threshold but is not strong enough to pass the skull (Neri et al., 2020). However, we were unaware of this alternative type of sham stimulation at the start of the data collection of this study. Although these limitations with the used sham protocol exist, it allowed us to distinguish potential effects on corticospinal excitability of the used TMS protocol from the potential effects of tDCS. However, questionnaires about the participants’ awareness of the used tDCS configurations could have helped control awareness-related tDCS response effects.

Finally, our statistical analysis did not control for sources of intersubject variability, such as genetics (Antal et al., 2010; Teo et al., 2014; van der Vliet et al., 2017), the electric field strength at stimulated brain areas (Laakso et al., 2015, 2019), or intrasubject variability, such as circadian or hormonal cycles (Horvath et al., 2014). One source of intrasubject variability was caused by the difference in stimulation currents of motor network tDCS and conventional tDCS, which resulted in different current densities at the contralateral M1. Due to safety constraints (Bikson et al., 2009), it was not possible to match the current densities between the two conditions. Consequently, it remains an open question whether the original findings of motor network tDCS are due to stimulation of the entire motor network or if they reflect the previously described non-linear relationship between the tDCS response and electric field strength at the contralateral M1 (Batsikadze et al., 2013).

Conclusion

Our study provides no evidence that motor network tDCS or conventional tDCS increases corticospinal excitability compared to sham tDCS. Consequently, the results did not provide evidence for superiority of motor network tDCS over conventional tDCS. While the rationale for tDCS targeting the entire motor network could be valid from the neurophysiological perspective, our results indicate that motor network tDCS might be equally susceptible to sources of intrasubject and intersubject variability as previously demonstrated for conventional tDCS. Including neurophysiologic measures such as EEG or magnetic resonance spectroscopy to control intrasubject and intersubject variability may facilitate the exploration of the potential of motor network tDCS and tDCS in general.

Data Availability Statement

The raw data supporting the conclusions of this article will be made available by the authors, without undue reservation.

Ethics Statement

The studies involving human participants were reviewed and approved by the Medical Ethics Review Board of the Erasmus University Medical Center (NL64529.078.18). The patients/participants provided their written informed consent to participate in this study.

Author Contributions

JV and ZJ were involved in the conceptualization of the study. JV, ZJ, and E-RA performed the formal analysis. JV, JW, and DT collected the data. JT and RS provided resources to perform the experiment. MF, GR, and RS supervised the study. JV wrote the original draft. All authors reviewed the manuscript.

Funding

This work was supported by the Netherlands Organisation for Scientific Research (NWO), Domain Applied and Engineering Sciences (TTW) (i-tDCS: grant number: 14902).

Conflict of Interest

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Publisher’s Note

All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.

Supplementary Material

The Supplementary Material for this article can be found online at: https://www.frontiersin.org/articles/10.3389/fnhum.2022.842954/full#supplementary-material

References

Agboada, D., Samani, M. M., Jamil, A., Kuo, M.-F., and Nitsche, M. A. (2019). Expanding the parameter space of anodal transcranial direct current stimulation of the primary motor cortex. Sci. Rep. 9:18185. doi: 10.1038/s41598-019-54621-0

PubMed Abstract | CrossRef Full Text | Google Scholar

Alonzo, A., Brassil, J., Taylor, J. L., Martin, D., and Loo, C. K. (2012). Daily transcranial direct current stimulation (tDCS) leads to greater increases in cortical excitability than second daily transcranial direct current stimulation. Brain Stimul. 5, 208–213. doi: 10.1016/J.BRS.2011.04.006

PubMed Abstract | CrossRef Full Text | Google Scholar

Ambrus, G. G., Al-Moyed, H., Chaieb, L., Sarp, L., Antal, A., and Paulus, W. (2012). The fade-in – short stimulation – fade out approach to sham tdcs - reliable at 1 ma for naïve and experienced subjects, but not investigators. Brain Stimul. 5, 499–504. doi: 10.1016/j.brs.2011.12.001

PubMed Abstract | CrossRef Full Text | Google Scholar

Ammann, C., Spampinato, D., and Márquez-Ruiz, J. (2016). Modulating motor learning through transcranial direct-current stimulation: an integrative view. Front. Psychol. 7:1981. doi: 10.3389/fpsyg.2016.01981

PubMed Abstract | CrossRef Full Text | Google Scholar

Antal, A., Chaieb, L., Moliadze, V., Monte-Silva, K., Poreisz, C., Thirugnanasambandam, N., et al. (2010). Brain-derived neurotrophic factor (BDNF) gene polymorphisms shape cortical plasticity in humans. Brain Stimul. 3, 230–237. doi: 10.1016/j.brs.2009.12.003

PubMed Abstract | CrossRef Full Text | Google Scholar

Antal, A., Nitsche, M. A., Kincses, T. Z., Kruse, W., Hoffmann, K. P., and Paulus, W. (2004). Facilitation of visuo-motor learning by transcranial direct current stimulation of the motor and extrastriate visual areas in humans. Eur. J. Neurosci. 19, 2888–2892. doi: 10.1111/j.1460-9568.2004.03367.x

PubMed Abstract | CrossRef Full Text | Google Scholar

Awiszus, F., and Borckardt, J. J. TMS Motor Threshold Assessment Tool (MTAT 2.0). Available online at: http://www.clinicalresearcher.org/software.htm

Google Scholar

Barker, A. T., Jalinous, R., and Freeston, I. L. (1985). Non-invasive magnetic stimulation of human motor cortex. Lancet 325, 1106–1107. doi: 10.1016/S0140-6736(85)92413-4

PubMed Abstract | CrossRef Full Text | Google Scholar

Bastani, A., and Jaberzadeh, S. (2013). A-tDCS differential modulation of corticospinal excitability: the effects of electrode size. Brain Stimul. 6, 932–937. doi: 10.1016/j.brs.2013.04.005

PubMed Abstract | CrossRef Full Text | Google Scholar

Batsikadze, G., Moliadze, V., Paulus, W., Kuo, M. F., and Nitsche, M. A. (2013). Partially non-linear stimulation intensity-dependent effects of direct current stimulation on motor cortex excitability in humans. J. Physiol. 591:1987. doi: 10.1113/JPHYSIOL.2012.249730

PubMed Abstract | CrossRef Full Text | Google Scholar

Bikson, M., Datta, A., and Elwassif, M. (2009). Establishing safety limits for transcranial direct current stimulation. Clin. Neurophysiol.y 120, 1033–1034. doi: 10.1016/j.clinph.2009.03.018

PubMed Abstract | CrossRef Full Text | Google Scholar

Boros, K., Poreisz, C., Münchau, A., Paulus, W., and Nitsche, M. A. (2008). Premotor transcranial direct current stimulation (tDCS) affects primary motor excitability in humans. Eur. J. Neurosci. 27, 1292–1300. doi: 10.1111/j.1460-9568.2008.06090.x

PubMed Abstract | CrossRef Full Text | Google Scholar

Delorme, A., and Makeig, S. (2004). EEGLAB: an open source toolbox for analysis of single-trial EEG dynamics including independent component analysis. J. Neurosci. Methods 134, 9–21. doi: 10.1016/j.jneumeth.2003.10.009

PubMed Abstract | CrossRef Full Text | Google Scholar

Di Lazzaro, V., Manganelli, F., Dileone, M., Notturno, F., Esposito, M., Capasso, M., et al. (2012). The effects of prolonged cathodal direct current stimulation on the excitatory and inhibitory circuits of the ipsilateral and contralateral motor cortex. J. Neural Transm. 119, 1499–1506. doi: 10.1007/s00702-012-0845-4

PubMed Abstract | CrossRef Full Text | Google Scholar

Dmochowski, J. P., Datta, A., Bikson, M., Su, Y., and Parra, L. C. (2011). Optimized multi-electrode stimulation increases focality and intensity at target. J. Neural Eng. 8:046011. doi: 10.1088/1741-2560/8/4/046011

CrossRef Full Text | Google Scholar

Dyke, K., Kim, S., Jackson, G. M., and Jackson, S. R. (2016). Intra-subject consistency and reliability of response following 2 ma transcranial direct current stimulation. Brain Stimul. 9, 819–825. doi: 10.1016/j.brs.2016.06.052

PubMed Abstract | CrossRef Full Text | Google Scholar

Fischer, D. B., Fried, P. J., Ruffini, G., Ripolles, O., Salvador, R., Banus, J., et al. (2017). Multifocal tDCS targeting the resting state motor network increases cortical excitability beyond traditional tDCS targeting unilateral motor cortex. Neuroimage 157, 34–44. doi: 10.1016/j.neuroimage.2017.05.060

PubMed Abstract | CrossRef Full Text | Google Scholar

Fonteneau, C., Mondino, M., Arns, M., Baeken, C., Bikson, M., Brunoni, A. R., et al. (2019). Sham tDCS: a hidden source of variability? Reflections for further blinded, controlled trials. Brain Stimul. 12, 668–673. doi: 10.1016/j.brs.2018.12.977

PubMed Abstract | CrossRef Full Text | Google Scholar

Greinacher, R., Buhôt, L., Möller, L., and Learmonth, G. (2019). The time course of ineffective sham-blinding during low-intensity (1 mA) transcranial direct current stimulation. Eur. J. Neurosci. 50, 3380–3388. doi: 10.1111/ejn.14497

PubMed Abstract | CrossRef Full Text | Google Scholar

Horvath, J. C., Carter, O., and Forte, J. D. (2014). Transcranial direct current stimulation: five important issues we aren’t discussing (but probably should be). Front. Syst. Neurosci. 8:2. doi: 10.3389/fnsys.2014.00002

PubMed Abstract | CrossRef Full Text | Google Scholar

Horvath, J. C., Forte, J. D., and Carter, O. (2015). Evidence that transcranial direct current stimulation (tDCS) generates little-to-no reliable neurophysiologic effect beyond MEP amplitude modulation in healthy human subjects: a systematic review. Neuropsychologia 66, 213–236. doi: 10.1016/j.neuropsychologia.2014.11.021

PubMed Abstract | CrossRef Full Text | Google Scholar

Horvath, J. C., Vogrin, S. J., Carter, O., Cook, M. J., and Forte, J. D. (2016). Effects of a common transcranial direct current stimulation (tDCS) protocol on motor evoked potentials found to be highly variable within individuals over 9 testing sessions. Exp. Brain Res. 234, 2629–2642. doi: 10.1007/s00221-016-4667-8

PubMed Abstract | CrossRef Full Text | Google Scholar

Hummel, F. C., and Cohen, L. G. (2006). Non-invasive brain stimulation: a new strategy to improve neurorehabilitation after stroke? Lancet Neurol. 5, 708–712. doi: 10.1016/S1474-4422(06)70525-7

CrossRef Full Text | Google Scholar

Jonker, Z. D., Gaiser, C., Tulen, J. H. M., Ribbers, G. M., Frens, M. A., and Selles, R. W. (2021). No effect of anodal tDCS on motor cortical excitability and no evidence for responders in a large double-blind placebo-controlled trial. Brain Stimul. 14, 100–109. doi: 10.1016/j.brs.2020.11.005

PubMed Abstract | CrossRef Full Text | Google Scholar

Julkunen, P., Säisänen, L., Danner, N., Niskanen, E., Hukkanen, T., Mervaala, E., et al. (2009). Comparison of navigated and non-navigated transcranial magnetic stimulation for motor cortex mapping, motor threshold and motor evoked potentials. Neuroimage 44, 790–795. doi: 10.1016/J.NEUROIMAGE.2008.09.040

PubMed Abstract | CrossRef Full Text | Google Scholar

Julkunen, P., Säisänen, L., Hukkanen, T., Danner, N., and Könönen, M. (2012). Does second-scale intertrial interval affect motor evoked potentials induced by single-pulse transcranial magnetic stimulation? Brain Stimul. 5, 526–532. doi: 10.1016/j.brs.2011.07.006

PubMed Abstract | CrossRef Full Text | Google Scholar

Kuo, H. I., Bikson, M., Datta, A., Minhas, P., Paulus, W., Kuo, M. F., et al. (2013). Comparing cortical plasticity induced by conventional and high-definition 4 × 1 ring tDCS: a neurophysiological study. Brain Stimul. 6, 644–648. doi: 10.1016/j.brs.2012.09.010

PubMed Abstract | CrossRef Full Text | Google Scholar

Laakso, I., Mikkonen, M., Koyama, S., Hirata, A., and Tanaka, S. (2019). Can electric fields explain inter-individual variability in transcranial direct current stimulation of the motor cortex? Sci. Rep. 9, 1–10. doi: 10.1038/s41598-018-37226-x

PubMed Abstract | CrossRef Full Text | Google Scholar

Laakso, I., Tanaka, S., Koyama, S., de Santis, V., and Hirata, A. (2015). Inter-subject variability in electric fields of motor cortical tDCS. Brain Stimul. 8, 906–913. doi: 10.1016/j.brs.2015.05.002

PubMed Abstract | CrossRef Full Text | Google Scholar

Lang, N., Nitsche, M. A., Paulus, W., Rothwell, J. C., and Lemon, R. N. (2004). Effects of transcranial direct current stimulation over the human motor cortex on corticospinal and transcallosal excitability. Exp. Brain Res. 156, 439–443. doi: 10.1007/s00221-003-1800-2

PubMed Abstract | CrossRef Full Text | Google Scholar

Lefebvre, S., Jann, K., Schmiesing, A., Ito, K., Jog, M., Schweighofer, N., et al. (2019). Differences in high-definition transcranial direct current stimulation over the motor hotspot versus the premotor cortex on motor network excitability. Sci. Rep. 9:17605. doi: 10.1038/s41598-019-53985-7

PubMed Abstract | CrossRef Full Text | Google Scholar

López-Alonso, V., Cheeran, B., Río-Rodríguez, D., and Fernández-Del-Olmo, M. (2014). Inter-individual variability in response to non-invasive brain stimulation paradigms. Brain Stimul. 7, 372–380. doi: 10.1016/j.brs.2014.02.004

PubMed Abstract | CrossRef Full Text | Google Scholar

López-Alonso, V., Fernández-del-Olmo, M., Costantini, A., Gonzalez-Henriquez, J. J., and Cheeran, B. (2015). Intra-individual variability in the response to anodal transcranial direct current stimulation. Clin. Neurophysiol. 126, 2342–2347. doi: 10.1016/j.clinph.2015.03.022

PubMed Abstract | CrossRef Full Text | Google Scholar

Mikkonen, M., Laakso, I., Tanaka, S., and Hirata, A. (2020). Cost of focality in TDCS: interindividual variability in electric fields. Brain Stimul. 13, 117–124. doi: 10.1016/J.BRS.2019.09.017

PubMed Abstract | CrossRef Full Text | Google Scholar

Minarik, T., Berger, B., Althaus, L., Bader, V., Biebl, B., Brotzeller, F., et al. (2016). The importance of sample size for reproducibility of tDCS effects. Front. Hum. Neurosci. 10:453. doi: 10.3389/fnhum.2016.00453

PubMed Abstract | CrossRef Full Text | Google Scholar

Murray, L. M., Edwards, D. J., Ruffini, G., Labar, D., Stampas, A., Pascual-Leone, A., et al. (2015). Intensity dependent effects of transcranial direct current stimulation on corticospinal excitability in chronic spinal cord injury. Arch. Phys. Med. Rehabil. 96, S114–S121. doi: 10.1016/j.apmr.2014.11.004

PubMed Abstract | CrossRef Full Text | Google Scholar

Neri, F., Mencarelli, L., Menardi, A., Giovannelli, F., Rossi, S., Sprugnoli, G., et al. (2020). A novel tDCS sham approach based on model-driven controlled shunting. Brain Stimul. 13, 507–516. doi: 10.1016/j.brs.2019.11.004

PubMed Abstract | CrossRef Full Text | Google Scholar

Nitsche, M. A., and Paulus, W. (2000). Excitability changes induced in the human motor cortex by weak transcranial direct current stimulation. J. Physiol. 527, 633–639. doi: 10.1111/j.1469-7793.2000.t01-1-00633.x

PubMed Abstract | CrossRef Full Text | Google Scholar

Nitsche, M. A., Liebetanz, D., Schlitterlau, A., Henschke, U., Fricke, K., Frommann, K., et al. (2004). GABAergic modulation of DC stimulation-induced motor cortex excitability shifts in humans. Eur. J. Neurosci. 19, 2720–2726. doi: 10.1111/j.0953-816X.2004.03398.x

PubMed Abstract | CrossRef Full Text | Google Scholar

Oostenveld, R., and Praamstra, P. (2001). The five percent electrode system for high-resolution EEG and ERP measurements. Clin. Neurophysiol. 112, 713–719. doi: 10.1016/S1388-2457(00)00527-7

CrossRef Full Text | Google Scholar

Pellegrini, M., Zoghi, M., and Jaberzadeh, S. (2020). The effects of transcranial direct current stimulation on corticospinal and cortico-cortical excitability and response variability: conventional versus high-definition montages. Neurosci. Res. 166, 12–15. doi: 10.1016/j.neures.2020.06.002

PubMed Abstract | CrossRef Full Text | Google Scholar

Pellicciari, M. C., Brignani, D., and Miniussi, C. (2013). Excitability modulation of the motor system induced by transcranial direct current stimulation: a multimodal approach. Neuroimage 83, 569–580. doi: 10.1016/j.neuroimage.2013.06.076

PubMed Abstract | CrossRef Full Text | Google Scholar

Pellicciari, M. C., Miniussi, C., Ferrari, C., Koch, G., and Bortoletto, M. (2016). Ongoing cumulative effects of single TMS pulses on corticospinal excitability: an intra- and inter-block investigation. Clin. Neurophysiol. 127, 621–628. doi: 10.1016/j.clinph.2015.03.002

PubMed Abstract | CrossRef Full Text | Google Scholar

Rawji, V., Ciocca, M., Zacharia, A., Soares, D., Truong, D., Bikson, M., et al. (2018). tDCS changes in motor excitability are specific to orientation of current flow. Brain Stimul. 11, 289–298. doi: 10.1016/j.brs.2017.11.001

PubMed Abstract | CrossRef Full Text | Google Scholar

Reis, J., Schambra, H. M., Cohen, L. G., Buch, E. R., Fritsch, B., Zarahn, E., et al. (2009). Noninvasive cortical stimulation enhances motor skill acquisition over multiple days through an effect on consolidation. Proc. Natl. Acad. Sci. U.S.A. 106, 1590–1595. doi: 10.1073/pnas.0805413106

PubMed Abstract | CrossRef Full Text | Google Scholar

Santos Ferreira, I., Teixeira Costa, B., Lima Ramos, C., Lucena, P., Thibaut, A., and Fregni, F. (2019). Searching for the optimal tDCS target for motor rehabilitation. J. NeuroEng. Rehabil. 16:90. doi: 10.1186/s12984-019-0561-5

PubMed Abstract | CrossRef Full Text | Google Scholar

Saucedo Marquez, C. M., Zhang, X., Swinnen, S. P., Meesen, R., and Wenderoth, N. (2013). Task-specific effect of transcranial direct current stimulation on motor learning. Front. Hum. Neurosci. 7:333. doi: 10.3389/fnhum.2013.00333

PubMed Abstract | CrossRef Full Text | Google Scholar

Scrivener, C. L., and Reader, A. T. (2022). Variability of EEG electrode positions and their underlying brain regions: visualizing gel artifacts from a simultaneous EEG-fMRI dataset. Brain Behav. 12:e2476. doi: 10.1002/BRB3.2476

PubMed Abstract | CrossRef Full Text | Google Scholar

Stagg, C. J., Jayaram, G., Pastor, D., Kincses, Z. T., Matthews, P. M., and Johansen-Berg, H. (2011). Polarity and timing-dependent effects of transcranial direct current stimulation in explicit motor learning. Neuropsychologia 49, 800–804. doi: 10.1016/j.neuropsychologia.2011.02.009

PubMed Abstract | CrossRef Full Text | Google Scholar

Teo, J. T. H., Bentley, G., Lawrence, P., Soltesz, F., Miller, S., Willé, D., et al. (2014). Late cortical plasticity in motor and auditory cortex: role of met-allele in BDNF Val66Met polymorphism. Int. J. Neuropsychopharmacol. 17, 705–713. doi: 10.1017/S1461145713001636

PubMed Abstract | CrossRef Full Text | Google Scholar

Tremblay, S., Larochelle-Brunet, F., Lafleur, L. P., El Mouderrib, S., Lepage, J. F., and Théoret, H. (2016). Systematic assessment of duration and intensity of anodal transcranial direct current stimulation on primary motor cortex excitability. Eur. J. Neurosci. 44, 2184–2190. doi: 10.1111/ejn.13321

PubMed Abstract | CrossRef Full Text | Google Scholar

van der Vliet, R., Ribbers, G. M., Vandermeeren, Y., Frens, M. A., and Selles, R. W. (2017). BDNF Val66Met but not transcranial direct current stimulation affects motor learning after stroke. Brain Stimul. 10, 882–892. doi: 10.1016/j.brs.2017.07.004

PubMed Abstract | CrossRef Full Text | Google Scholar

Wiethoff, S., Hamada, M., and Rothwell, J. C. (2014). Variability in response to transcranial direct current stimulation of the motor cortex. Brain Stimul. 7, 468–475. doi: 10.1016/j.brs.2014.02.003

PubMed Abstract | CrossRef Full Text | Google Scholar

Woods, A. J., Antal, A., Bikson, M., Boggio, P. S., Brunoni, A. R., Celnik, P., et al. (2016). A technical guide to tDCS, and related non-invasive brain stimulation tools. Clin. Neurophysiol. 127, 1031–1048. doi: 10.1016/j.clinph.2015.11.012

PubMed Abstract | CrossRef Full Text | Google Scholar

Keywords: tDCS, TMS, corticospinal excitability, motor network, motor evoked potential

Citation: Van der Cruijsen J, Jonker ZD, Andrinopoulou E-R, Wijngaarden JE, Tangkau DA, Tulen JHM, Frens MA, Ribbers GM and Selles RW (2022) Transcranial Direct Current Stimulation Targeting the Entire Motor Network Does Not Increase Corticospinal Excitability. Front. Hum. Neurosci. 16:842954. doi: 10.3389/fnhum.2022.842954

Received: 24 December 2021; Accepted: 11 April 2022;
Published: 04 May 2022.

Edited by:

Gregor Thut, University of Glasgow, United Kingdom

Reviewed by:

Ali Jannati, Boston Children’s Hospital and Harvard Medical School, United States
George M. Opie, University of Adelaide, Australia

Copyright © 2022 Van der Cruijsen, Jonker, Andrinopoulou, Wijngaarden, Tangkau, Tulen, Frens, Ribbers and Selles. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.

*Correspondence: Joris Van der Cruijsen, j.vandercruijsen@tudelft.nl

Download