Abstract
Currently little is known about how a mechanically coupled BMI system's actions are integrated into ongoing body dynamics. We tested a locomotor task augmented with a BMI system driving a robot mechanically interacting with a rat under three conditions: control locomotion (BL), “simple elastic load” (E) and “BMI with elastic load” (BMI/E). The effect of the BMI was to allow compensation of the elastic load as a function of the neural drive. Neurons recorded here were close to one another in cortex, all within a 200 micron diameter horizontal distance of one another. The interactions of these close assemblies of neurons may differ from those among neurons at longer distances in BMI tasks and thus are important to explore. A point process generalized linear model (GLM), was used to examine connectivity at two different binning timescales (1 ms vs. 10 ms). We used GLM models to fit non-Poisson neural dynamics solely using other neurons' prior neural activity as covariates. Models at different timescales were compared based on Kolmogorov-Smirnov (KS) goodness-of-fit and parsimony. About 15% of cells with non-Poisson firing were well fitted with the neuron-to-neuron models alone. More such cells were fitted at the 1 ms binning than 10 ms. Positive connection parameters (“excitation” ~70%) exceeded negative parameters (“inhibition” ~30%). Significant connectivity changes in the GLM determined networks of well-fitted neurons occurred between the conditions. However, a common core of connections comprising at least ~15% of connections persisted between any two of the three conditions. Significantly almost twice as many connections were in common between the two load conditions (~27%), compared to between either load condition and the baseline. This local point process GLM identified neural correlation structure and the changes seen across task conditions in the rats in this neural subset may be intrinsic to cortex or due to feedback and input reorganization in adaptation.
Introduction
Brain Machine Interfaces (BMIs) hold the potential to provide functions to spinal-injured patients (Hochberg et al., 2006) or to augment normal motor functions in novel ways. The operation of BMIs depends on reliable neural decoding during ongoing behaviors and on a subject's adaptation of activity to achieve function across differing ongoing tasks. To date, most efforts in BMI have worked in mechanically isolated contexts and concentrated on highly-trained manipulation tasks of the forelimb (Chapin et al., 1999; Hochberg et al., 2006; Moritz et al., 2008; Velliste et al., 2008). They have largely neglected locomotion or its augmentation using invasive single unit methods, with notable exceptions (Fitzsimmons et al., 2009; Song et al., 2009; Manohar et al., 2012; Alam et al., 2014). Further, a future BMI application of lower limb control would likely require the user to manage on-line motor adaptations and integrate the lower limb BMI control with their whole body control.
The effect on neural modulation of BMI integration into the body scheme has not been thoroughly investigated. The stability of cortical neural responses remains controversial. Some data showed that cells can be functionally stable and BMI systems maintain performance across days with the same decoder (Serruya et al., 2003; Greenberg and Wilson, 2004; Chestek et al., 2007). However, significant neural plasticity was also reported in non-BMI force-field adaptation experiments and in BMI systems exposed to a given decoder across days (Li et al., 2001; Carmena et al., 2005; Jackson et al., 2006; Rokni et al., 2007; Zacksenhouse et al., 2007; Jarosiewicz et al., 2008; Ganguly and Carmena, 2009; Song and Giszter, 2011). Even when responses become fairly stable, and switching among BMI controls are achieved easily, for example after over-training, issues will remain in integrating and adapting the BMI controls to new tasks and mechanical contexts in activities of daily living. Conceivably, highly-trained BMI designs with complicated decoding algorithms may impede the use of the intrinsic plasticity of the brain to adapt and improve the BMI control in dynamic environments. Current efforts to develop adaptive decoders must balance their potential advantages against the potential for conflict with the user's own adaptation. An alternative strategy may be to provide simpler interfaces (Moritz et al., 2008), and allow the brain's plasticity and processing power to adapt and incorporate the novel actions.
Using a relatively simple interface strategy to generate a neural driven force from the robot, like Fetz and colleagues (Moritz et al., 2008), we examined the use of the BMI in this dynamic environment. Rats were exposed to three conditions during treadmill locomotion:(a) control, (b) simple elastic loading (E), and (c) BMI with elastic load (BMI/E) in which BMI lifting control was made available in parallel with the elastic load used in (b). Previously, we found that cells could modulate their firing patterns differently during each adaptation in different experimental conditions (Song and Giszter, 2011).
To understand the function of neuronal circuits and systems, it is essential to characterize the connections between individual neurons (Brown et al., 2004; Shigeyoshi, 2008; Stevenson and Körding, 2010) and their dynamics across tasks or condition changes. Correlations of cells relate to network connectivity and common inputs and processing. The cross-correlation, coherence and joint peri-stimulus time histogram (JPSTH) methods have been used for pairs of cells (Gerstein and Perkel, 1969; Jarvis and Mitra, 2001; Schneidman et al., 2006; Shigeyoshi, 2008). To characterize the strengths and any dynamics of the connections between neurons, variants of information based methods have been used in computational neuroscience for analyzing spiking neural systems (Strong et al., 1998). However, in many brain areas, each neuron receives input from a large population, and the generalized linear model (GLM) provides another framework to examine connectivity based on the point process representation of the spike trains (Brown et al., 2002; Truccolo et al., 2005; Acharya et al., 2008; Stevenson et al., 2008; Héliot et al., 2010). The GLM attempts to predict a neuron's firing patterns based on its own spikes and the spikes of other neurons, and on external inputs. By combining a KS statistical analysis for the goodness of fit in each model, it provides a powerful tool for neural network functional connectivity analysis (Brown et al., 2002; Truccolo et al., 2005; Acharya et al., 2008; Kositsky et al., 2009; Gerhard et al., 2011). By utilizing a point process framework and GLM, we examined the neural dynamics at the functional network level.
We examined “functional connectivity” which we here define as an analysis and estimation of how firing of each neuron appears to influence each other neuron in a given data set, given the data collected and included in the analysis, with such influences expressed in the most parsimonious way possible. This represents a compact description of firing pattern correlations and apparent influences on one another in the observed data. Because the neural activity is incompletely observed, it is necessarily limited in relation to anatomy and actual circuit structure. Results showed significant differences in network organization as estimated by the GLM analysis of functional connectivity under different conditions, with some fraction of “core connectivity” in the GLM models, and the observed firing pattern features, preserved across the trials.
Methods and materials
Surgical procedure and neural recording
Six adult Sprague-Dawley rats, weighing 250 ~ 300 g, were used in these experiments. Care and treatment of the animals conformed to protocols approved by the University Laboratory Animal Resources and Institutional Animal Care and Use Committee of the College of Medicine of Drexel University. Methods are published in Song and Giszter (2011). The detailed procedures for pelvic and cortical implantations have also been described previously (Song and Giszter, 2011). For short, after anesthesia using KXA (63 mg/Kg Ketamine, 6 mg/Kg Xylazine, 0.05 mg/Kg Acepromazine), rats were implanted with a pelvic orthosis, which allowed a PHANTOM robot (Sensable Devices) to apply forces directly to the skeleton. Tetrode arrays, which consisted of 6 tetrodes positioned around the neck of an etched spear-shaped fine tungsten rod, were implanted stereotactically in the hindlimb / trunk area of the motor cortex (2.0 mm lateral of the midline, 1.6 mm caudal to bregma and 1.0–1.5 mm in depth). Recording sites of all electrodes in a rat were within from 50 to 200 microns of one another in the cortex using our probe design. Intracortical microstimulation of rat M1 in this recorded region generates hindlimb/trunk movements in all rats tested. At the end of the final recording session, strong electrolytic lesions were made and brain slices were cut in 40 μm sections to validate electrode placement. Neural data were recorded using a Cerebus system (Cyberkinetics, Inc. / Blackrock systems) after animals recovered from surgery. Neural signals were band-pass filtered (300–7.5 KHz) and digitized at a sampling frequency of 30 kHz. Spikes were detected online using thresholding. The detected spikes could be automatically classified on-line after setting the templates of each waveform. The on-line sorted spikes were used in a real time “BMI with elastic load” control. The controller and real-time OS code were custom laboratory written code (available on request). They implemented the algorithms in Equation (1) below, with the parameters noted there. The detected spike trains, as well as all the thresholded spike waveforms, were also saved for off-line analysis. Multiple single units were isolated off-line using Off-line Sorter (Plexon Neurotech Com.) after noise removal by cluster cutting method (Shoham et al., 2003). This analysis uses the offline sorted data. Up to 24 channels of neural activity at a time in a single array could be recorded, and 1 or 2 individual cells from most wires of the tetrodes could be recorded; around 15–38 well isolated single units were used in each trial.
Robot controls and training protocols
The robotic system employed and the training protocol used have been described in detail previously (Song and Giszter, 2011). Briefly, different force fields (linear, non-linear, isotropic, anisotropic, piecewise discontinuities etc.) could be applied to the pelvis of the rat using our custom control software. This was achieved through an implanted orthosis, directly interacting with the skeleton using the orthosis attached robot. Robot control was updated at a frequency of 1 KHz, and these controls were synchronized and coupled with neural recordings. Neural data recorded could be used in the robot control scheme after a delay of under 3 ms from spike occurence. In elastic load trials (abbrevationE), unidirectional (vertical forces only, i.e., radially anisotropic) elastic fields were used. Elastic loading (downward) fields Fe were applied in condition E by setting an equilibrium point on the horizontal equilibrium plane of the elastic field around 12.5 mm under the rat's normal pelvic height with a field stiffness of 44 N/m, which gives around 15% of the body weight. In trials termed here “BMI with elastic load” (abbrev. BMI/E), a neural driven lifting elastic force Fn was combined with the above simple elastic force Fe, and both forces were combined and applied simultaneously. The neural driven elastic force was calculated according to the equation where Naf was aggregate firing rate in the prior 100 ms window, Kn = 80 N/m was the stiffness, Xn0 = 55 mm was the equilibrium point, and X the current vertical position of the pelvis with respect to the horizontal equilibrium plane. This gave the rat in BMI/E trials a means to offset the elastic load Fe using neural activity Naf to modulate an opposing force Fn. Experiments except where noted comprised one or more iterations of 3 conditions: 2 min of baseline (BL) with no loading, followed by 2 min of elastic load (E) in which the rat experienced Fe, and then 2 min of BMI + load (BMI/E) in which the rat had access to the BMI driven field Fn and could potentially offset Fe.
Rats were trained to walk on a treadmill at a speed ranging from 0.1 to 0.15 m/s depending on the normal preferred walking speed of individual rats. One daily experimental session used in analysis below was divided into three trials as described above: (i) the BL (baseline) trial, in which rats walked on treadmill without any force; (ii) the E (simple elastic load) trial; (iii) the BMI/E (BMI with elastic load) trial. Each session thus consisted of three 2-min trials of treadmill walking (~120 steps) with 5 min intervals of rest occurred between each trial.
Neural network functional connectivity analysis by using GLM model
We follow Stevenson et al. (2009) and Okatan et al. (2005) in defining functional connectivity: we seek to characterize how each neuron appears to influence each other neuron in the data sets in the most parsimonious way possible. The neural modulation of single cells that was observed during BMI usage and motor adaptation observed in our experimental paradigm was previously reported (Song and Giszter, 2011).
The procedure for functional connectivity analysis was as shown in Figure 1. Briefly, neural spiking activity is modeled as a point process which is completely characterized by its conditional intensity function (Daley and Vere-Jones, 2003) defined as where Ht is all the history information from 0 up to time t, and N(t) is a counting process containing the sum of all the spikes up to time t. The conditional intensity function can be considered a generalization of the “rate” for a homogenous Poisson process. Under the restriction that λ(t|Ht)Δ follows a distribution in the exponential family, the GLM framework can be used to fit statistical models for the conditional intensity function (McCullagh and Nelder, 1989). Goodness of fit can be assessed by Kolmogorov-Smirnov test (KS-test) after the time rescaling theorem (Brown et al., 2002).
Figure 1
The conditional intensity function of the ith spiking neuron was modeled with the spiking history of neighbor cells either at a short timescale (1 ms, L = 1) or long timescale (10 ms, L = 10) as Equation (3), where J is the total number of neurons recorded in the current trial; μi is the baseline level of firing rate; ΔNj(tk) = Nj (tk) − Nj(tk−L) is the number of spikes of the jth neuron between time tk−L and tk, L = 1 or 10 for the short and long timescale model respectively, and βij is the regression coefficient to be estimated representing the strength of effect between the firing of the jth neuron in the short or long timescale and the current firing rate of the ith neuron. We term the βij as the functional connectivity coefficient of neuron j to neuron i. Note that with this definition, βij ≠ βji in general and both that both short and long timescale models have the same number of parameters. We define the functional connectivity map, β, as the matrix containing βij in the ith row and jth column. The structure of β is one measure of the connections between neurons or a representation of the functional network between the neurons.
The activity of each neuron was modeled by its neighboring neurons' immediately preceding history within a 10 ms window (type A in Equation 3) and in a small number of test models by its own history (type B, self-history included - i.e., remove the j ≠ i constraint in Equation 3). The Type B model (with neural self history) was evaluated in 2 rats. Models with the self history inclusion on the timescales tested here differed little in their network neighbor interactions. They showed significant overlap of network connections with the similar networks identified and estimated without self history. However, they generally showed some reduction of external network connections (22% in BL, 11% in E, and 15% in BMI, when using 1 ms time bins) with increasing history parameters but also a decreasing quality metric (see below). Here we present data from the network models without self-history, consistent with our quality metric used (see below).
Statistical methods
After GLM fitting (glmfit, MATLAB) for each neuron, a Kolmogorov-Smirnov (KS) test was applied to test the goodness of fitting. If the fitting was within the 95% confidence interval, we classified the neuron as well fitted. Then, the significant parameters that were nonzero (p < 0.05) were used to construct the functional connectivity map as in Figure 1.
In order to test the functional connectivity map changes between two conditions, and their significance, the functional connectivity map identified and estimated in each was converted to a binary functional connectivity matrix by setting the significant nonzero elements to one and the others to zero as in Figure 4. Connection density was defined as the percentage of significant connected links, in relation to the total possible links and used as a criterion for analysis and comparison of model structures and conditions. In a first pass analysis we modeled all recorded neurons as stationary Poisson processes to test for non-Poisson behavior. In a second pass analysis (type II models), we modeled those neurons whose firing was not fitted by a mean rate parameter, and thus non-Poisson by our test criterion used for model fit assessment (time rescaling theorem/Kolmogorov Smirnov tests with p < 0.05). Such cells could not be well-predicted simply by using a mean rate parameter (type I model) and were thus firing based on locomotion variables or one another. The number of such non-Poisson cells found differed in the data sets, varying based on binning. We found such “non-Poisson patterned” cells using both 1 ms and 10 ms binning. In total 573 neurons were analyzed. Cell numbers that were non-Poisson were as follows: 1 ms binning: 287 (BL), 328 (E), 303(BMI/E); 10 ms: 348 (BL), 368 (E), 361 (BMI/E). The first pass analysis was equivalent to an assumption of the possible presence of neither locomotion task information nor neural interaction information in the cell firing. Cells not fitted in this way would need a more complex fitting, which could further improve conditional intensity function fit and KS statistic if modeled correctly, using neural or locomotion variable effects. The second pass analysis we used examined neural interactions alone. Effectively, we assumed that the first pass Poisson fitted cells were unrelated to the motor tasks, and were simply noise sources in the cortical network, though potentially important predictors of other neural firing. We ignored the external covariate effects, focusing on neural correlation alone. We compared GLM model structures to capture the non-Poisson population of neurons at a short timescale using 1 ms binning and at a longer timescale using 10 ms binning based on the parsimonious selection of GLM fitting. We sought models that captured the most neurons with the best levels of individual neuron parameter parsimony. To assess this model quality we calculated a model parameter Q, where n is the percentage of neurons with non-Poisson firing that were well fitted using the model, N is the square root of the significant connection density (number of possible connections growing as the square of neurons recorded). High Q values indicate good parsimonious fitting of the (non-Poisson) activity in the network, and the sparsest possible connectivity description of firing. If two models had the same numbers of well-predicted neurons total in a data set but one fitting had higher Q (i.e., fewer connections/ parameters required) it was considered a better model form. If two models fitted different numbers of neurons in a data set, but the model fitting of larger number of neurons had a much lower Q this would indicate a more complex individual neural functional connectivity was necessary in the model to capture the greater number of neurons and achieve fitting. When the activity of each neuron was modeled from its neighboring simultaneous firing neurons, but not using self history and recursive self connections, the overall parsimony and Q value obtained was significantly lower, so we only present data using the history effects of neighbor neurons not self history (Equation 3).
From the binary functional connectivity matrix of significant parameters found using models with the best Q, we could then test the significance of functional connectivity maps changes. We did by using a binomial distribution test. That is, by assuming the probability of keeping or changing the original link had the same chance, then if the probability of the pattern of change observed was less than 0.05, then a significant change had occurred. In practice this statistical test was likely unnecessary, since we found that only about 15–27% of model connections persisted across different conditions in an animal. Nonparametric signed rank tests (signrank, MATLAB) were used to compare the significance of such individual changes and differences across sessions and rats. All the tests were set to a significance level of 0.05. All data analysis was performed using custom software written in MATLAB. A suite of refined and related MATLAB tools including these is freely available (Cajigas et al., 2012).
Results
In total 21 robot and BMI interaction sessions were collected in 6 normal rats that were implanted with multi-electrode recording probes. Rats performed treadmill locomotion in three conditions: (1) unloaded baseline (BL), (2) a robot driven elastic load condition (E) in which rats experienced a vertical elastic load, and (3) a robot driven elastic load and BMI condition (BMI/E), see Figure 1A. In the last condition the rat could in principle offset elastic load using neural activity. In BMI/E the recorded neural activity of the rat regulated the stiffness of a second “BMI elastic field.” This could potentially be employed to offset the elastic load, as was described in Song and Giszter (2011). We have reported previously that rats do quite quickly begin to adjust and to offset the load (Song and Giszter, 2011). We sought to assess changes in functional connectivity as rats proceeded from BL to E to BMI/E conditions. In order to do this we compared functional connections in GLM fitted networks for the data (Figures 1A–E) in each successive test condition. We thus separately fitted each condition. 21 fitted networks were here obtained and compared for each condition (BL, E, and BMI/E) using GLM models. We tested fits of the GLM models at two different binning timescales: 1 ms and 10 ms. In total 573 neurons were analyzed in the 21 sessions. Cell numbers that were non-Poisson and supported network connection modeling were as follows: 1 ms binning: 287 (BL), 328 (E), 303 (BMI/E); 10 ms: 348 (BL), 368 (E), 361 (BMI/E). In addition to these sessions, in control experiments we tested repetitions of the baseline, and repetitions of the full sequence of tests in a rat, to assess the connection and network drift (gradual network functional connection changes within a condition), relative to the measures of change we saw between conditions.
Network fitting procedures and network characteristics
We first modeled each neuron in each task condition (BL, E, and BMI/E) by using a 1 step spiking history of the ensemble neurons using either short timescale (1 ms bin) or longer timescale (10 ms bin) steps. Type I models ignored interactions, simply fitting cells independently as point processes to discover non-Poisson pattern cells. Type II models used cell interactions. We found that about 60% of recorded cells were well fitted at the short timescale. However, the number of well-predicted non-Poisson firing cells was not high. About 15% of such non-Poisson pattern cells were well-predicted using the short timescale. Significantly less cells were well-predicted in the long timescale, matching the total cell fitting patterns. The numbers of total and non-Poisson firing pattern cells that were well fitted at each timescale were not significantly different between the three different adaptation conditions. We used a measure Q of fitting complexity to compare the models and binnings (see Methods). The numbers of cells that were well-predicted and the Q statistic in both the shorter timescale (1 ms) and longer timescale (10 ms) analyses are shown in Figure 2. The 10 ms binned fits were almost as good as the 1 ms model fits. Although a simple 1 step history linear filter is presented here, we also tested type I and type II models with basis function filters similar to Truccolo (Truccolo et al., 2010), and tested models with a 10 ms (five basis function) history in two rats. There was no significant improvement in the number of cells which could be well-predicted using KS-criteria, when compared to using the 1 ms binning used here. Thus, we kept the 1 step history window in our subsequent modeling. We present the analyses only for the simpler 1 ms bin and 10 ms history type II model. In the 1 ms bin short timescale, the GLM models captured the binary spike train behaviors, where temporal coding might feature, while the 10 ms bin long timescale GLM model corresponds more to rate coding. More cells could be well fitted using the short timescale models than with the long timescale models. This suggests that with 1 ms binning, the individual cells predicted (or “influenced”) the short term information of the neighboring cells better (more) than was seen on the long timescale. Thus, the better-fitted functional connectivity network structures examined here using 1 ms binning likely represent short timescale processes.
Figure 2
We also examined the fitted networks' significant parameters to see if numbers of excitatory or inhibitory types of connections were dominant, and the average strengths of each type of connection. In each network, we found that the number of significant negative interactions (“inhibition”) was lower than the number of positive ones (“excitation”) constituting about on fifth on average (Figures 2C,D). When we compared these connection numbers for the models between experimental conditions, we found that there was no significant difference in the positive/negative parameter balances in models among the different task conditions. However, the number of negatively modulating interactions in the models using 10 ms binning and timescale were increased overall compared to 1 ms binning and timescale (Figures 2C,D).
Network stability in continuously repeated trials of a condition, and repetitions of conditions after delays and condition switches
In control trials, we found that in successive repetitions of the baseline conditions, the fitted networks showed some connection variability but that overall more than 30% of connections were preserved over the entire series of repetitions, and around 40% or more similarity was found between tests of networks adjacent in time (Figure 3A). Similarly, we found that networks fitted to repetitions of each condition after other interleaved conditions showed more connection similarity with each other (Figure 3B) than with the networks fitted to different conditions that were adjacent in time, and this difference was significant under an assumption of random variations (e.g., for data in Figure 3B, one-tailed t-test p < 0.05).
Figure 3
Network changes across different adaptation conditions
We next analyzed the model connectivity changes occuring between the three adaptation conditions when they followed in close succession in a complete experiment series. Our rationale was that although the numbers of cells, which could be well-predicted by either type I or type II GLM models were not significantly different among each adaptation task condition, the network structure might change or reorganize in these different contexts. Thus, we looked in detail at how the fitted network statistics changed in the transitions between the different task conditions, compared across conditions, and at the different binning timescales. Both the binary connection maps (Figure 4) and the functional connectivity strengths (Figures 5, 6) showed significant differences at the two different model timescales (1 ms, and 10 ms). These also differed among the three adaptation conditions tested (BL, E, and BMI/E). Some fraction of the connections persisted across different task conditions (Figure 4, circled examples). Connections that persisted in common between the three adaptation conditions remained correlated in strengths (Figure 5 red points in each plot), however other patterns of functional connectivity often changed significantly. The binary functional connectivity maps showed distinct patterns depending on timescales analyzed, as seen in Figure 4. Generally, we found that in the longer 10 ms binned data most connections were unique and many fewer were shared with the other adaptation conditions (not shown). We therefore focused accordingly on the short time scale 1 ms binned models (1 ms Type II Models) see Figures 4, 5. We showed previously that rats in BMI/E offset load while preserving more normal pelvic height compared to load alone (Song and Giszter, 2011). When rats experiencing applied loads in BMI/E were able to significantly offset these with the BMI, the network increased the number of connections during simple elastic load and BMI with elastic load conditions compared to baseline (e.g., see Figures 4, 5). Further, significantly more of (almost double the number of) the connections persisted in the transition from Elastic load (E) to BMI (BMI/E) (~27% in Figure 5C) compared to those that seen were in common between Baseline and Elastic load (~16% in Figure 5A) or Baseline and BMI (~15% in Figure 5B). This statistically significant difference in common or shared functional connectivity was biased to positive connections between the two load conditions (Figure 5C, one red negative connection in common out of 25 total common), but instead included higher fractions of negative parameter connections when examining connections that were in common with baseline patterns of firing (Figure 5A, 4/12 negative, and Figure 5B, 4/14).
Figure 4
Figure 5
Figure 6
While the numbers of significant connections increased in the E and BMI/E conditions, the mean parameter strengths also altered. Figure 6 shows the average positive and negative connection strengths tended in 1 ms and 10 ms models. In keeping with the other results the 10 ms binning results had weaker significance, only differing in positive connection strength between BL and BMI/E. In the 1 ms models, all connection strengths tended to decrease in the loading conditions compared to baseline. These changes were significant for the positive connections in both load conditions in the 1 ms models, and for negative connections compared to BMI/E.
By using functional connection density measures and the shared significant parameters as functional connectivity links or edges in a network graph, we compared the network structure changes. We found the number of common connections was significantly decreased in 10 ms timescale binned models compared to 1 ms binned (signed rank test, p < 0.05, MATLAB signrank), as in Figure 7. These differences held across baseline condition and elastic load condition as well as BMI with elastic load. All the networks built from the GLM models showed low numbers of shared connections (15–27%) and significant differences (assessed by signed rank tests, p < 0.05) between any two conditions. However, there were significantly higher percentages of shared connections between the two load adaptation conditions of E and BMI/E than between either of the load with baseline condition shared connections (BL vs. E and BL vs. BMI/E) (Figure 7A). The percentage of shared connections between any two compared conditions was also higher in 1 ms binning than in 10 ms binning Figure 7B. These differences among conditions could not be explained by drift over time in BL e.g., in Figure 3A. This suggests that the active cortical circuitry may in part share a similar common structure when rats adapt under simple elastic load and under BMI with elastic load, and may also indicate that apart from rate encoding (analyzing in long timescale), short term temporal coding (binary spike timing) might capture some information regarding these changes on a short timescale.
Figure 7
In conclusion, the fitted GLM model networks of cells here showed significantly different connection maps between each task condition potentially indicating significant changes in network dynamics with task conditions. A core of between 15 and 27% of network connections were in common between the individual conditions and over time, but this common core differed in extent between different task condition pairs, with baseline having less in common with the other two (loaded) conditions.
Discussion
Using the methods here we previously demonstrated that rats could adapt their locomotion under a simple elastic load and use a BMI to offset elastic load effectively (Song and Giszter, 2011). GLM methods allow us to move beyond our prior analyses of coarse firing rate in this paradigm, and to add point process assessments of functional connectivity. The differences in BMI adaptation compared to the simple load in this paradigm involve alterations in firing patterns and rate based correlation relationships among neurons, but not average firing rates compared with elastic loading (Song and Giszter, 2011). We previously also observed changes in the number of force-related neurons, their peak firing and burst activity timing in the step cycle (Song and Giszter, 2011). Here we focus on neuron-neuron interactions at the point process level among neurons all collected within a range of from 30 to 200 microns of each other in each rats, with the recording electrode sites around layer V of motor cortex. These spatially close neurons may potentially have different connectivity from spatially further separated neurons. As we have noted above the functional connectivity we uncovered here represents the most parsimonious account of apparent neural influences among one another based on the observed neurons and firing. Because not all neurons are observed the account is necessarily incomplete and may infer Granger type causal links where none exist in the complete biology. However, subject to these limitations the functional connectivity may give descriptive insights into aspects of network operation. By using a GLM approach here, our data analysis has shown some features of cortical network dynamics occuring at different timescales during these adaptation processes. The neural network in hindlimb/trunk cortex of rats as assessed here in a subset of well-predicted neurons was extensively reorganized in terms of GLM parameters during adaptation to different elastic load force fields applied in locomotion. The networks shared more common connections between elastic load and BMI with elastic load condition than between any other condition pairs. More of the functional network connections identified were preserved during transitions from elastic load (E) to BMI with elastic load (BMI/E) conditions, than from baseline (BL) to elastic load (E). However, only about 15% of the total population of non-Poisson firing cells were well-predicted by our models here, which were built without reference to the external covariates, and relied only on strong neural firing pattern interactions. Internal network functional connectivity and the network based firing predictions that are presented here thus represent an account of a small fraction of the patterned activity. The models thus also indicate a high degree of independence of much of the non-Poisson pattern firing cells from one another from the GLM modeling perspective, consistent with classical rate coding models and other frameworks (e.g., Sanger, 2010, 2011, 2014). Likely the strongest predictive relationships of the firing of the 85% of unfitted non-Poisson cells will be with external covariates and tuning to feedback or motor drive. Nonetheless, the internal relationships revealed here in well-predicted cells provide some insights into the adaptation processes and dynamics in augmenting BMIs (see Omar et al., 2011). Unfortunately, low firing rates for the GLM point process models preclude a confident analysis of the activity changes within a condition as was possible with other methods in Song and Giszter (2011). The relations of the local activity relations here to overall function of the network remain to be determined.
It should be noted that caution should be taken when interpreting the results from model dynamics and differences here. As noted, the model did not consider external covariates, which might have made a strong contribution to the models. This was especially likely during elastic load conditions, and some if not most of the non-Poisson firing pattern cells that were not well fitted with neural interactions alone can be expected to be captured with inclusion of these. Whether and how the sparse connections identified here are correlated with the overall network states across tasks still needed to be tested. On the other hand, as the model here used spiking history of the ensemble of recorded cells, any effects of the potential external covariates on the well-predicted subset of cells analyzed here might be captured by its being filtered and incorporated into the history effects of connected neighboring neurons in the ensemble. The lagged parameters of GLM models of cells here generally had a more significant effect on a current cells' firing than any immediate (1 ms) synchronization to other firing cells consistent with causal interactions but no proof of such. Similiarly, it should be made clear that the connections or functional connectivity maps constructed here were derived only from “apparent pattern” among neural spikes. There might be no anatomical connectivity representing the apparent connections in the cortical network.
The differences between open loop BMIs, BMIs with feedback, physically connected BMIs and differences between BMIs for proximal locomotion vs. distal reaching are not well understood (Acharya et al., 2008; Héliot et al., 2010). However, these different effects may become crucial as various feedback based BMIs are introduced and the range and scope of available BMI prosthetic devices increases (Moritz et al., 2008; Velliste et al., 2008; Fitzsimmons et al., 2009; Héliot et al., 2010; Song and Giszter, 2011). Recent studies showed that cells in the primary motor cortex demonstrated learning related plasticity during force field adaptation (Li et al., 2001). A stable relation between neural activity and behavior can clearly be established in well trained animals (Serruya et al., 2003; Greenberg and Wilson, 2004; Chestek et al., 2007). Moritz et al. demonstrated that individual cells can be rate modulated to control Functional Electrical Stimulation (Moritz et al., 2008). Variations of neural firing patterns in such differing adaptation processes are not well understood at this point. For example, patterns might differ between novel voluntary tasks and more vegetative “built-in” or evolutionarily older tasks, such as locomotion. The rats adapted to load (E) and adapted differently to load with BMI (BMI/E). The identified functional cortical network parameters, as identified from firing observed here, also clearly adapted, and reorganized differently between conditions. Previously we found the distribution of average firing rate from the whole population was not significantly different among conditions (Song and Giszter, 2011). The numbers of significantly connected cells here were not significantly different across conditions in these models either. However, the numbers of common connections over time were higher in BMI with elastic load than baseline, and the network connection density even decreased during elastic loading alone when the rat adapted from the first half trial to the second half trial. Zacksenhouse et al. showed that there are firing rate changes in the early sessions with other BMI experiments (Zacksenhouse et al., 2007), and we found here that 70–85% of the sparse network connections of well-predicted cells reorganized depending on the context. For elastic load locomotion, the connection density actually decreased here, while in the BMI with elastic load locomotion condition, the network as modeled kept the same connection density. Similar results were obtained examining more standard long timescale correlations of rate in our earlier study (Song and Giszter, 2011). These data might indicate that rats need a longer time to achieve a stable and perhaps more sparse network state during BMI/E adaptation and conditioning when they were tested in our experimental framework, compared to the simpler elastic loaded locomotion. This evolving relationship between cortical firing effects, network changes, and feedback and relationships with external covariates is an area of active investigation using this framework.
When animals adapt their locomotion to new environments, initially cortex becomes more activated and engaged. Engaging a BMI in this period appears to alter and at least briefly stabilize the changes involved in the adaptation of neural network structure. Despite the small role of cortex in the normal locomotion of rats, cortex can be engaged in a BMI augmenting locomotion during this adaptation. Our data thus supports the idea that activity normally involved in monitoring, or simply correlated with and not normally driving a behavior in an animal, can nonetheless be engaged through motor adaptation processes to drive behavior in a BMI. Neuron-neuron correlation metrics estimated here provide one set of measures on the changes in neural dynamics on short adaptation time scales that can be extended to high practice use of BMIs and load adaptation over time, to examine transitions from naive user of an augmenting BMI to an expert practiced user. Understanding the patterns of these adaptive changes better may be essential in order to provide prostheses that can integrate seamlessly with normal motor adaptations and feedback effects across the many contexts encountered in activities of daily living.
Conflict of interest statement
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
Statements
Acknowledgments
This work was supported by NIH NS54894 to SG, NIH 1F31NS058275-01A2 to IC, NIH DP1 OD003646 to EB and R01 GM104948 to EB.
Conflict of interest
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
References
1
AcharyaS.TenoreF.AggarwalV.Etienne-CummingsR.SchieberM. H.ThakorN. V. (2008). Decoding individuated finger movements using volume-constrained neuronal ensembles in the M1 hand area. IEEE Trans. Neural Syst. Rehabil. Eng. 16, 15–23. 10.1109/TNSRE.2007.916269
2
AlamM.ChenX.ZhangZ.LiY.HeJ. (2014). A brain-machine-muscle interface for restoring hindlimb locomotion after complete spinal transection in rats. PLoS ONE9:e103764. 10.1371/journal.pone.0103764
3
BrownE. N.BarbieriR.VenturaV.KassR. E.FrankL. M. (2002). The time-rescaling theorem and its application to neural spike train data analysis. Neural Comput. 14, 325–346. 10.1162/08997660252741149
4
BrownE. N.KassR. E.MitraP. P. (2004). Multiple neural spike train data analysis: state-of-the-art and future challenges. Nat. Neurosci. 7, 456–461. 10.1038/nn1228
5
CajigasI.MalikW. Q.BrownE. N. (2012). nSTAT: open-source neural spike train analysis toolbox for Matlab. J. Neurosci. Methods211, 245–264. 10.1016/j.jneumeth.2012.08.009
6
CarmenaJ. M.LebedevM. A.HenriquezC. S.NicolelisM. A. L. (2005). Stable ensemble performance with single-neuron variability during reaching movements in primates. J. Neurosci. 25, 10172–10176. 10.1523/JNEUROSCI.2772-05.2005
7
ChapinJ. K.MarkowitzR. A.MoxonK. A.NicolelisM. A. L. (1999). Direct real-time control of a robot arm using signals derived from neuronal population recordings in motor cortex. Nat. Neurosci. 2, 664–670. 10.1038/10223
8
ChestekC. A.BatistaA. P.SanthanamG.YuB. M.AfsharA.CunninghamJ. P.et al. (2007). Single-neuron stability during repeated reaching in macaque premotor cortex. J. Neurosci. 27, 10742–10750. 10.1523/JNEUROSCI.0959-07.2007
9
DaleyD.Vere-JonesD. (2003). An Introduction to the Theory of Point Processes. New York, NY: Springer-Verlag.
10
FitzsimmonsN. A.LebedevM. A.PeikonI. D.NicolelisM. A. L. (2009). Extracting kinematic parameters for monkey bipedal walking from cortical neuronal ensemble activity. Front. Integr. Neurosci. 3, 1–19. 10.3389/neuro.07.003.2009
11
GangulyK.CarmenaJ. M. (2009). Emergence of a stable cortical map for neuroprosthetic control. PLoS Biol. 7:e1000153. 10.1371/journal.pbio.1000153
12
GerhardF.PipaG.LimaB.NeuenschwanderS.GerstnerW. (2011). Extraction of network topology from multi-electrode recordings: is there a small-world effect?Front. Comput. Neurosci. 5:4. 10.3389/fncom.2011.00004
13
GersteinG. L.PerkelD. H. (1969). Simultaneously recorded trains of action potentials: analysis and functional interpretation. Science164, 828–830. 10.1126/science.164.3881.828
14
GreenbergP. A.WilsonF. A. W. (2004). Functional stability of dorsolateral prefrontal neurons. J. Neurophysiol. 92, 1042–1055. 10.1152/jn.00062.2004
15
HéliotR.GangulyK.JimenezJ.CarmenaJ. M. (2010). Learning in closed-loop brain-machine interfaces: modeling and experimental validation. IEEE Trans. Syst. Man Cybern. B Cybern. 99, 1–11. 10.1109/TSMCB.2009.2036931
16
HochbergL. R.SerruyaM. D.FriehsG. M.MukandJ. A.SalehM.CaplanA. H.et al. (2006). Neuronal ensemble control of prosthetic devices by a human with tetraplegia. Nature442, 164–171. 10.1038/nature04970
17
JacksonA.MavooriJ.FetzE. E. (2006). Long-term motor cortex plasticity induced by an electronic neural implant. Nature444, 56–60. 10.1038/nature05226
18
JarosiewiczB.ChaseS. M.FraserG. W.VellisteM.KassR. E.SchwartzA. B. (2008). Functional network reorganization during learning in a brain-computer interface paradigm. Proc. Natl. Acad. Sci. U.S.A. 105, 19486–19491. 10.1073/pnas.0808113105
19
JarvisM. R.MitraP. P. (2001). Sampling properties of the spectrum and coherency in sequences of action potentials. Neural Comput. 13, 717–749. 10.1162/089976601300014312
20
KositskyM.ChiappaloneM.AlfordS. T.Mussa-IvaldiF. A. (2009). Brain-machine interactions for assessing the dynamics of neural systems. Front. Neurorobot. 3:1. 10.3389/neuro.12.001.2009
21
LiC. S.Padoa-SchioppaC.BizziE. (2001). Neuronal correlates of motor performance and motor learning in the primary motor cortex of monkeys adapting to an external force field. Neuron30, 594–607. 10.1016/S0896-6273(01)00301-4
22
ManoharA.FlintR. D.KnudsenE.MoxonK. A. (2012). Decoding hindlimb movement for a brain machine interface after a complete spinal transection. PLoS ONE7:e52173. 10.1371/journal.pone.0052173
23
McCullaghP.NelderJ. (1989). Generalized Linear Models, 2nd Edn. Boca Raton, FL: Chapman and Hall/CRC. 10.1007/978-1-4899-3242-6
24
MoritzC. T.PerlmutterS. I.FetzE. E. (2008). Direct control of paralyzed muscles by cortical neurons. Nature456, 639–642. 10.1038/nature07418
25
OkatanM.WilsonM. A.BrownE. N. (2005). Analyzing functional connectivity using a network likelihood model of ensemble neural spiking activity. Neural Comput. 17, 1927–1961. 10.1162/0899766054322973
26
OmarC.AkceA.JohnsonM.BretlT.MaR.MaclinE.et al. (2011). A feedback information-theoretic approach to the design of brain-computer interfaces. Int. J. Hum. Comput. Interact. 27, 5–23. 10.1080/10447318.2011.535749
27
RokniU.RichardsonA. G.BizziE.SeungH. S. (2007). Motor learning with unstable neural representations. Neuron54, 653–666. 10.1016/j.neuron.2007.04.030
28
SangerT. D. (2010). Neuro-mechanical control using differential stochastic operators. Conf. Proc. IEEE Eng. Med. Biol. Soc. 2010, 4494–4497. 10.1109/IEMBS.2010.5626029
29
SangerT. D. (2011). Distributed control of uncertain systems using superpositions of linear operators. Neural Comput. 23, 1911–1934. 10.1162/NECO_a_00151
30
SangerT. D. (2014). Risk-Aware Control. Neural Comput. 26, 2669–2691. 10.1162/NECO_a_00662
31
SchneidmanE.BerryM. J.IISegevR.BialekW. (2006). Weak pairwise correlations imply strongly correlated network states in a neural population. Nature440, 1007–1012. 10.1038/nature04701
32
SerruyaM.HatsopoulosN.FellowsM.PaninshkiL.DonoghueJ. P. (2003). Robustness of neuroprosthetic decoding algorithms. Biol. Cybern. 88, 219–228. 10.1007/s00422-002-0374-6
33
ShigeyoshiF. (2008). behavior-dependent short term assembly dynamics in the medial prefrontal cortex. Nat. Neurosci. 11, 823–833. 10.1038/nn.2134
34
ShohamS.FellowsM. R.NormannR. A. (2003). Robust, automatic spike sorting using mixtures of multivariate t-distributions. J. Neurosci. Methods127, 111–122. 10.1016/S0165-0270(03)00120-1
35
SongW. G.GiszterS. F. (2011). Adaptation to a cortex controlled robot attached at the pelvis and engaged during locomotion in rats. J. Neurosci. 31, 3110–3128. 10.1523/JNEUROSCI.2335-10.2011
36
SongW. G.RamakrishnanA.UdoekwereU. I.GiszterS. F. (2009). Multiple types of movement-related information encoded in hindlimb/trunk cortex in rats and potentially available for brain–machine interface controls. IEEE Trans. Biomed. Eng. 56, 2712–2716. 10.1109/TBME.2009.2026284
37
StevensonI. H.KördingK. P. (2010). On the similarity of functional connectivity between neurons estimated across timescalesPLoS ONE5:e9206. 10.1371/journal.pone.0009206
38
StevensonI. H.RebescoJ. M.HatsopoulosN. G.HagaZ.MillerL. E.KördingK. P. (2009). Bayesian inference of functional connectivity and network structure from spikes. IEEE Trans. Neural Syst. Rehabil. Eng. 17, 203–213. 10.1109/TNSRE.2008.2010471
39
StevensonI. H.RebescoJ. M.MillerL. E.KördingK. P. (2008). Inferring functional connections between neurons. Curr. Opin. Neurobiol. 18, 582–588. 10.1016/j.conb.2008.11.005
40
StrongS. P.KoberleR.de Ruyter van SteveninckR. R.BialekW. (1998). Entropy and information in neural spike trains. Phys. Rev. Lett. 80, 197–200. 10.1103/PhysRevLett.80.197
41
TruccoloW.EdenU. T.FellowsM. R.DonoghueJ. P.BrownE. N. (2005). A point process framework for relating neural spiking activity to spiking history, neural ensemble, and extrinsic covariate effects. J. Neurophysiol. 93, 1074–1089. 10.1152/jn.00697.2004
42
TruccoloW.HochbergL. R.DonoghueJ. P. (2010). Collective dynamics in human and monkey sensorimotor cortex: predicting single neuron spikes. Nat. Neurosci. 13, 105–111. 10.1038/nn.2455
43
VellisteM.PerelS.SpaldingM. C.WhitfordA. S.SchwartzA. B. (2008). Cortical control of a prosthetic arm for self-feeding. Nature453, 1098–1101. 10.1038/nature06996
44
ZacksenhouseM.LebedevM. A.CarmenaJ. M.O'DohertyJ. E.HenriquezC.NecolelisM. A. L. (2007). Cortical modulations increase in early sessions with brain-machine interface. PLoS ONE7, 1–10. 10.1371/journal.pone.0000619
Summary
Keywords
augmenting BMI, elastic field, point-process general linear model, exoskeleton robot model system, motor adaptation
Citation
Song W, Cajigas I, Brown EN and Giszter SF (2015) Adaptation to elastic loads and BMI robot controls during rat locomotion examined with point-process GLMs. Front. Syst. Neurosci. 9:62. doi: 10.3389/fnsys.2015.00062
Received
01 January 2015
Accepted
01 April 2015
Published
28 April 2015
Volume
9 - 2015
Edited by
Mikhail Lebedev, Duke University, USA
Reviewed by
Monzurul Alam, University of California, USA; Dean Robert Freestone, The University of Melbourne, Australia; Matthew D. Golub, Carnegie Mellon University, USA
Copyright
© 2015 Song, Cajigas, Brown and Giszter.
This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) or licensor are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Simon F. Giszter, Department of Neurobiology and Anatomy, Drexel University College of Medicine, Drexel University, 2900 Queen Lane, Philadelphia, PA, USA sgiszter@drexelmed.edu
Disclaimer
All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher.