Abstract
Mammalian locomotion is generated by central pattern generators (CPGs) in the spinal cord, which produce alternating flexor and extensor activities controlling the locomotor movements of each limb. Afferent feedback signals from the limbs are integrated by the CPGs to provide adaptive control of locomotion. Responses of CPG-generated neural activity to afferent feedback stimulation have been previously studied during fictive locomotion in immobilized cats. Yet, locomotion in awake, behaving animals involves dynamic interactions between central neuronal circuits, afferent feedback, musculoskeletal system, and environment. To study these complex interactions, we developed a model simulating interactions between a half-center CPG and the musculoskeletal system of a cat hindlimb. Then, we analyzed the role of afferent feedback in the locomotor adaptation from a dynamic viewpoint using the methods of dynamical systems theory and nullcline analysis. Our model reproduced limb movements during regular cat walking as well as adaptive changes of these movements when the foot steps into a hole. The model generates important insights into the mechanism for adaptive locomotion resulting from dynamic interactions between the CPG-based neural circuits, the musculoskeletal system, and the environment.
1 Introduction
Mammalian locomotion is generated by the central pattern generators (CPGs) located in the spinal cord, which control the movements of each limb (Grillner, 1981; Rossignol, 1996; Orlovsky et al., 1999; Rossignol et al., 2006). CPGs produce the basic locomotor rhythm and create alternating flexor and extensor motoneuron (Mn) activities. Furthermore, they integrate afferent feedback signals to achieve adaptive locomotion.
CPGs can operate without afferent feedback and continuous electrical stimulation of the midbrain locomotor region in immobilized decerebrate cats produces “fictive locomotion” consisting of rhythmic alternating activation of flexor and extensor Mns similar to that occurring during normal locomotion in intact animals (Rossignol, 1996). Such fictive locomotor preparations have been used to investigate the mechanism for the adaptive regulation of locomotor patterns by somatosensory afferent feedback. These studies have shown that stimulation of flexor and extensor sensory afferents can delay or advance flexion-to-extension or extension-to-flexion transitions depending on the timing of the afferent stimulation (Guertin et al., 1995; Perreault et al., 1995; McCrea, 2001; Stecina et al., 2005). In our previous modeling work (Fujiki et al., 2019), we used a half-center type CPG model and analyzed its responses to afferent stimulation using dynamic systems theory based on nullclines. This previous study was limited to the consideration of only neural responses without interaction between the neural and musculoskeletal systems.
However, the mammalian locomotion is a complex phenomenon involving dynamic interactions between the neural circuits, the musculoskeletal system, and the environment. To investigate these interactions and the roles of afferent feedback in adaptive locomotion, investigators studied locomotion in both intact and decerebrate or spinal animals walking on a treadmill by applying various disturbances or introducing holes and obstacles on the treadmill to disturb normal locomotion (Hiebert et al., 1994; Lam and Pearson, 2001; Drew et al., 2002). Although these studies have revealed adaptive responses to such disturbances, the adaptation mechanisms based on the interactions between the neural system, musculoskeletal system, and environment remain poorly understood.
Here, we extended our previous models (Markin et al., 2010, 2016), which integrated a two-level half-center CPG and a musculoskeletal model of the cat hindlimbs and simulated steady walking, to investigate the mechanism of locomotor adaptation in response to perturbations from a dynamical viewpoint. We determined the necessary model parameters through optimization that allows the model to reproduce regular walking movements on a treadmill. We considered locomotion with the presence of holes in the walking surface, which evoked locomotor disturbances that allowed us to analyze the roles of afferent feedback from flexor and extensor muscles to stabilize locomotion. Particularly, the model realistically reproduced adaptive changes in locomotor characteristics observed when the paw of a cat hindlimb stepped into a hole (Hiebert et al., 1994). The model suggests an afferent feedback-based mechanism for locomotor adaptation, which we analyzed based on dynamical systems theory methods using nullclines (Fujiki et al., 2019). Our simulation and analysis provide important insights into the mechanisms for adaptive locomotion based on dynamic interactions between the neural system, the musculoskeletal system, and the environment.
2 Model
Figure 1 shows our neuromusculoskeletal model, which consists of a musculoskeletal model of a cat hindlimb and a spinal CPG model to drive the musculoskeletal model.
FIGURE 1
2.1 Musculoskeletal Model
The skeletal model is two-dimensional and consists of three rigid links representing the thigh, crus, and foot. These links are connected by the knee and ankle joints, and the hip joint is fixed above a treadmill. The model walks on the treadmill with a belt speed of 0.4 m/s based on Prilutsky et al. (2016). When the thigh, crus, and foot are in a straight line and parallel to the vertical line, the hip angle is 135° and the knee and ankle angles are both 180°. The joint angles increase as the joints are extending. The contact between the limb tip and treadmill were modeled using viscoelastic elements. We derived the equations of motion for the skeletal model using Lagrangian equations, where we used the same physical parameters for the skeletal model as those in Ekeberg and Pearson (2005), and solved the equations numerically using the fourth-order Runge-Kutta method with a time step of 0.04 ms.
The skeletal model is driven by seven Hill-type muscles including five uni-articular muscles which are: hip flexor (iliopsoas, IP), hip extensor (gluteus maximus, GM), knee extensor (vastus lateralis, VL), ankle flexor (tibialis anterior, TA), ankle extensor (soleus, SO), and two bi-articular muscles including hip extensor/knee flexor (biceps femoris, BF) and knee flexor/ankle extensor (gastrocnemius, GA). We assumed that the moment arms of all muscles are constant. Each muscle generates the muscle tension through contractile and passive elements. The muscle model consisting of contractile and passive elements is based on the same description and parameters in Ekeberg and Pearson (2005). Specifically, the muscle force is given bywhere is the maximum isometric force, am is the muscle activation , is the force-length relationship, is the force-velocity relationship, and is the passive component. The muscle lengths were normalized by , which was set so that all uni-articular muscles had a length of 85% of and all bi-articular muscles were at 75% at a neutral posture with the hip at 65°, the knee at 90°, and the ankle at 100°. In addition, 2° of joint motion corresponded to 1% of muscle length change, except for the GA muscle, where 1.5° at the ankle or 4.5° at the knee was required. The muscle contractile velocities were normalized by as well.
The muscle activation am determines the muscle tension generated by the contractile element and the dynamics of am is given by a low-pass filter (Yakovenko et al., 2004) as follows:where τact and τdact are activation and deactivation time constants (20 and 32 ms, respectively), and um is the motor command determined from the activities of the corresponding Mn of the CPG model.
2.2 CPG Model
The locomotor CPG has been suggested to consist of hierarchical networks, which include rhythm generator (RG) and pattern formation (PF) networks (Rybak et al., 2006a,b). The RG network generates the rhythmic activities while the PF network generates the spatiotemporal patterns of motor commands. For the RG model, we used two neuron populations of flexor and extensor centers (RG-F and RG-E), which receive a supraspinal drive, and two populations of inhibitory interneurons (In-F and In-E), which provide mutual inhibition between the RG-F and RG-E centers. The PF was modeled using two neuron populations of flexor and extensor centers (PF-F and PF-E). The PF-F and PF-E neuron populations receive the excitatory input from the RG-F and RG-E neuron populations, and inhibitory input from the In-E and In-F neuron populations, respectively. Seven Mn populations provide activation for each muscle in the musculoskeletal model (Mn-m, ). The Mns of flexor muscles Mn-IP, Mn-TA, and Mn-BF receive excitatory input from the PF-F neuron populations, while those of extensor muscles Mn-GM, Mn-VL, Mn-SO, and Mn-GA receive the excitatory input from the PF-E neuron populations. Synaptic interactions between all neuron populations are shown in Figure 1.
Each population is described as an activity-based (non-spiking) neuron model (Ermentrout, 1994; Markin et al., 2010; Molkov et al., 2015; Danner et al., 2016, 2017). The state of each neuron is characterized by the membrane potential Vi for , , , and , where {RG} ={RG-F, RG-E}, {In} ={In-F, In-E}, {PF} ={PF-F, PF-E}, and {Mn}. The RG, PF, and Mn neurons incorporate a persistent (slowly-inactivating) sodium current that defines the intrinsic rhythmogenic properties of these neurons. The intrinsic oscillations in the RG, PF, and Mn neurons depend on the variable hi (, , ) that defines the slow inactivation of the persistent sodium channel. The RG-F and RG-E neurons can produce rhythmic activities. However, if uncoupled, the RG-E neuron is in the tonic regime due to the supraspinal drive and produces sustained activity. Rhythmic oscillations of the RG neurons are defined by the RG-F neuron, which provides rhythmic inhibition of the RG-E neuron through the In-F neuron. The supraspinal drive to the RG-F neuron determines the oscillation frequency. When the PF and Mn neurons are uncoupled, they do not produce rhythmic activities due to the relatively low maximum conductance of the sodium current. Instead, these neurons produce rhythmic activities through the excitatory inputs from the correspondent RG neurons.
For the state variable for this model, we used and . The dynamics of the membrane potential Vi is described aswhere C is the membrane capacitance, INaP is the persistent sodium current, ILeak is the leakage current, and and are the respective currents in excitatory synapses and inhibitory synapses. The ionic current INaP and leakage current ILeak are described aswhere and are the maximum conductances of the corresponding currents, and ENa and the reversal potentials. In addition, mNaP is the activation of the sodium channel of the RG, PF, and Mn neurons and is described as
The dynamics of the inactivation of the sodium channel hi of the RG, PF, and Mn neurons is given bywhere
The currents generated by the synapses and are given bywhere and are the maximum conductances of the corresponding currents; ESynE and are the reversal potentials of the corresponding currents; d is the tonic drive from the supraspinal region; si is the afferent feedback from the musculoskeletal model (as determined in Section 4.1); and αij, βij, and γi are the weight coefficients, where βij = 0 for and γi = 0 for and . Moreover, the output function f translates V into the integrated population activity and is given bywhere Vth and Vmax are the lower and upper threshold potentials, respectively. The motor command is given by . Based on Fujiki et al. (2019) and Markin et al. (2010), we determined the parameters for the CPG model (see Appendix A) except for αij, βij, and γi for , which we determined through optimization, as described in Section 4.2.
2.3 Calculation of Nullcline
The nullcline is a set of points at which the derivative of a differential equation is equal to zero. It reflects the structure of the solution of the differential equation. After the CPG model was integrated with the musculoskeletal model to achieve steady walking, we used a nullcline-based method, as in our previous work (Fujiki et al., 2019), to investigate the mechanism of the response of the CPG model to a disturbance during steady walking. Specifically, the state of the CPG model is given by , and the nullclines for the RG neurons are given by
To clarify the dynamics of each RG neuron, we focused on the Vi-hi space for the nullclines by assuming that the other variables and are stably oscillating during steady walking. Therefore, we modify and in Eq. 10 aswhere x∗ indicates x for the stable oscillation during steady walking.
While has a sigmoid shape and does not change with time, has a cubic curve shape and changes by afferent feedback and input from other neurons. Specifically, mainly has the two different situations shown in Figures 2A,B, one with two different inflection points at which the sign of the slope changes, and one with a monotonic variation. In the former case (Figure 2A), the intersection of and is a saddle equilibrium point. Because the time constant for the dynamics of is smaller than that for , the following two features are present (Fujiki et al., 2019; Molkov et al., 2015; Spardy et al., 2011): 1. near where has positive slope, the state (Vi, hi) is slowly attracted to the inflection point along (slow dynamics) and 2. near the inflection points, the state (Vi, hi) jumps to the opposite part of with a positive slope (fast dynamics). In the latter case (Figure 2B), the intersection of and is a stable node equilibrium point having the following two features (Spardy et al., 2011; Fujiki et al., 2019): 1. when the state (Vi, hi) is away from , it is quickly attracted to (fast dynamics), and 2. near , the state (Vi, hi) is slowly attracted to the stable node along (slow dynamics). As described above, the switch between fast and slow dynamics depends on the relationship between the state and the nullcline, and adaptive responses are achieved through the changes in by afferent feedback.
FIGURE 2
3 Verifying the CPG Model by Phase-Dependent Response in Fictive Locomotion
Even when our CPG model is separated from the musculoskeletal model (or receives no feedback signals), it produces rhythmic activities and exhibits stable oscillations, as shown in Figure 3. Based on these oscillations, we define the active phase for each neuron as the time interval during which the neuron’s potential is higher than Vth, and the silent phase as the time interval when the potential is lower than Vth. We also define the cycle period T as the time interval between two consecutive onsets of the active phase of the PF-F neuron and the phase of the oscillation as ϕ = 2πt/T ∈ [0, 2π).
FIGURE 3
To verify our CPG model, we investigated the phase-dependent response of the CPG activities based on previous studies (Demir et al., 1997; Fujiki et al., 2019) and compared the results with those obtained by experiments with fictive locomotion in cats (Duysens, 1977; Schomburg et al., 1998). Specifically, we used only the CPG model (RG, In, and PF neurons) separated from the musculoskeletal model. After the oscillation of the CPG model stabilized, we applied a 200-ms stimulus to the flexor (RG-F, In-F, and PF-F) or extensor (RG-E, In-E, and PF-E) neurons, where the intensity of the stimulation was set as follows: sRG-F = sIn-F = sPF-F = 0.2 and sRG-E = sIn-E = sPF-E = 0 for the stimulation to the flexor side and sRG-F = sIn-F = sPF-F = 0.0 and sRG-E = sIn-E = sPF-E = 0.2 for the stimulation to the extensor side in Eq. 8. Suppose that the neuron activity is perturbed by stimulation with a phase ϕs ∈ [0, 2π) and the period of the PF-F neuron changes from T to T′(ϕs), as shown in Figure 3. To explain the phase shift of the neuron activity in response to the stimulation, we define
Figure 4A shows the phase shift Δ of the PF-F neuron activity after the stimulation of sensory inputs on the flexor side at ϕs. When the stimulation was applied during the silent phase of the PF-F neuron (2.70 ≤ ϕs ≤ 2π), it caused an earlier transition to the active phase, and this advanced start decreased with ϕs. In contrast, almost no phase shift occurred when the stimulation was applied at the beginning of the active phase of the PF-F neuron (0 ≤ ϕs ≤ 0.44). However, the neuron activity was delayed by the stimulation during the middle and end of the active phase (0.44 ≤ ϕs ≤ 2.70). These trends were similar to those observed during fictive locomotion in spinal cats (Schomburg et al., 1998; Frigon et al., 2010), as shown in Figure 4A.
FIGURE 4
Figure 4B shows Δ after stimulation of the extensor side. The active and silent phase of the PF-F neuron corresponds to the silent and active phase, respectively, of the PF-E neuron. The neuron activity was advanced at the middle of the silent phase of the PF-E neuron (0.63 ≤ ϕs ≤ 2.64) and was delayed at the end of the active phase of the PF-E neuron (4.27 ≤ ϕs ≤ 6.16). The response of the stimulation of the extensor side was qualitatively similar to that for the flexor side. Moreover, the trends were consistent with those observed during fictive locomotion in decerebrate cats (Duysens, 1977; Schomburg et al., 1998; Frigon et al., 2010), as shown in Figure 4B. These results verify the validity of our CPG model.
4 Determining the Motor Control Model by Optimization to Reproduce Normal Walking
We integrated the CPG and musculoskeletal models to determine the remaining parameters for the CPG model through an optimization to produce normal walking on the treadmill.
4.1 Afferent Feedback From the Musculoskeletal Model
We determined the afferent feedback si in Eq. 8 based on Markin et al. (2010) as follows:wherevm, lm, and Fm are the velocity, length, and force of muscle m, respectively, and , , and are the corresponding weight coefficients. The three terms on the right-hand side of Eq. 13 represent the velocity, length, and force feedback from muscle m. The coefficients , , and are given as follows: for the flexor side (i = RG-F, In-F, PF-F),for the extensor side (i = RG-E, In-E, PF-E),and for the Mns ,
We determined , and η through the optimization technique described in the next section.
4.2 Optimization to Determine Motor Control Parameters
We integrated the CPG and musculoskeletal models and determined the motor control parameters through an optimization to produce normal walking on the treadmill based on the measured kinematic data for cats (Prilutsky et al., 2016). Specifically, we determined the following 14 parameters; αMn-IP,PF-F, αMn-GM,PF-E, αMn-VL,PF-E, αMn-TA,PF-F, αMn-SO,PF-E, αMn-BF,PF-F, and αMn-GA,PF-E in Eq. 8 (the other aij’s for are 0) and , and η in Eqs. 18–20. We used the covariance matrix adaptation evolution strategy (CMA-ES) (Hansen et al., 2003) as the optimization method to minimize the following loss function:where , θi and are the simulated and measured joint angles, and t1 and t2 were determined to evaluate the error for two gait cycles after steady walking was achieved.
Figure 5 shows the results obtained by the optimization. The model parameters determined by the optimization are shown in Appendix B. Figure 5A shows the membrane potentials of the RG, PF, and Mn neurons and the velocity, length, and force feedback of the flexor and extensor muscles. The rhythmic activities of the RG-F and RG-E neurons were transmitted to the Mn neurons through the PF neurons and the afferent feedback was used in normal walking. Figures 5B,C show the joint angles and muscle activations, respectively, compared with the data measured for cats (Prilutsky et al., 2016). The simulated joint angles and muscle activities have patterns similar to those for the measured data. These results verify that our model reproduced regular cat walking on a treadmill through the interactions between the neural system, the musculoskeletal system, and the environment by the optimization.
FIGURE 5
5 Adaptive Response to Stepping Into a Hole During Treadmill Walking
To investigate the role of afferent feedback in adaptive locomotion, we applied a disturbance to our model and compared the responses with those measured for cats. Moreover, we clarified the adaptation mechanism based on dynamic systems theory methods.
5.1 Comparison of Simulation Results and Measured Data
Afferent feedback plays important roles in adaptive walking. To clarify these roles, a treadmill with a hole has been used in experiments with cats (Gorassini et al., 1994; Hiebert et al., 1994), where the cat body and forelimbs are supported and the cat walks on the treadmill only with the hindlimbs. When the foot of a hindlimb steps into the hole, it loses ground contact, and an appropriate response based on afferent feedback is required to continue walking. The investigation of the response to stepping into a hole highlights the roles of afferent feedback from the flexor and extensor muscles in generating adaptive walking. Hiebert et al. (1994) showed that when the foot of a hindlimb of a spinal cat entered a hole, the activities of the extensor muscles were shortened and the next onsets of the activities of the flexor and extensor muscles were advanced, which quickly lifted the foot out of the hole. We conducted a simulation of our model in the same situation as Hiebert et al. (1994) using the model parameters determined in the previous section to generate normal walking and compared the results with the measured data from animal experiments. In the simulation, after our model achieved steady walking on a treadmill, we emulated a hole by setting the ground reaction force to zero when the foot touched the treadmill belt until the foot went below the belt and returned back above it.
Figure 6 compares the simulation results when the foot entered a hole with those during normal walking. Specifically, Figure 6A shows the joint angles and stick diagrams. When the foot stepped into the hole, the hip, knee, and ankle joints were first extended. After that, these joints were flexed to lift the foot above the treadmill belt and then the foot landed on the belt. This behavior was consistent with that observed in the animal experiment. Figure 6B shows the activation of the IP and GA muscles representing the flexor and extensor muscles, respectively. The activation of the GA muscle was shortened and the onset of the next activation was advanced compared with those in normal walking. The onset of the next activation of the IP muscle was also advanced. These responses were consistent with those in the animal experiment. These results verify that our model reproduced adaptive responses in cats when a foot steps into a hole during walking, even without changing the model parameters, which were determined to reproduce normal walking.
FIGURE 6
5.2 Investigating the Adaptation Mechanism
We investigated the adaptation mechanism via afferent feedback when the foot stepped into a hole based on the nullclines of the RG neurons in the phase plane. Figure 7 compares the stimulation results for the RG neurons between entering a hole and normal walking. Specifically, Figure 7A shows the time profiles of the membrane potentials of the RG-F and RG-E neurons and the velocity, length, and force feedback from the flexor and extensor muscles. Figures 7B,C show the trajectories of the state of the RG-F neuron and the state of the RG-E neuron, and the changes in the nullclines of the RG-F neuron and of the RG-E neuron (because and do not change, they are not shown), respectively, in their phase planes. Although a stable limit cycle appeared during normal walking, the trajectories diverged after the foot entered the hole. Therefore, just before the foot entered the hole, which corresponds to the touchdown in normal walking (“a” in Figure 7), the trajectories and nullclines were identical between entering a hole and normal walking.
FIGURE 7
In the RG-F neuron, the local maximum of the nullcline decreased 0.1 s after entering the hole (“b” in Figure 7) due to the increased velocity and length feedback from the flexor muscles. The trajectory was attracted to the nullcline while following the slow dynamics. As a result, VRG-F increased slightly. In the RG-E neuron, the nullcline remained almost unchanged from that in “a” due to the loss of the force feedback from the extensor muscles. In other words, the nullcline moved to the left compared to that in normal walking. The trajectory was attracted to the nullcline while following the slow dynamics. As a result, VRG-E decreased slightly.
In the RG-F neuron, the local maximum of the nullcline further decreased 0.29 s after the foot entered the hole (“c” in Figure 7) due to the increase in the length and force feedback from the flexor muscles. The state entered the fast dynamics by passing over the local maximum. As a result, VRG-F rapidly underwent a large increase to initiate the next activity. In the RG-E neuron, the nullcline moved significantly to the left due to the increased inhibition from the RG-F neuron, which made the state enter the fast dynamics. As a result, VRG-E decreased strongly and the activity was rapidly terminated.
As a result of these changes, the onset of the next activity of the RG-F neuron was advanced and the current activity of the RG-E neuron was shortened. The state of the RG-F neuron and the state of the RG-E neuron followed the slow dynamics in “d” in Figure 7 and the trajectories and nullclines in “e” in Figure 7 almost returned to those of “a” in Figure 7 through the fast dynamics to continue normal walking. These results clarify the mechanims how our model produced adaptive responses during stepping into a hole through the interactions between the neural system, the musculoskeletal system, and the environment using dynamic systems theory based on nullclines.
6 Discussion
6.1 Adaptive Responses to Entering a Hole
To continue walking after one of its feet steps into a hole, the cat must quickly pull the foot out of the hole and step onto the treadmill belt again. To provide this behavior the CPG should modify the motor commands based on afferent feedback. Similar to normal walking, the extensor muscles start their activity before touchdown to support the body weight. However, when a foot enters a hole without touchdown, the muscle activity excessively extends the hip, knee, and ankle joints. Therefore, for stable walking it is necessary to quickly terminate extension and start flexion. It has been suggested that unloading of ankle extensor muscles and activation of the Ia and II sensory afferents from flexor muscles play an important role in the transition from stance to swing during normal walking in cats (Duysens and Pearson, 1980; Pearson et al., 1992; Hiebert et al., 1996). Studies of locomotion in spinal cats when holes were present showed that the unloading of the extensor muscle due to the lack of touchdown caused early termination of the extensor activity (Hiebert et al., 1994). In our model, this phase transition was provided by the velocity and length dependent (Ia, II) as well as the force dependent (Ib) feedback. Our simulations have shown that the early termination of extensor activity and early initiation of flexor activity can result from unloading of the extensor muscles (“b” in Figure 7C) and increasing the activity of Ia and II afferent feedback from the flexor muscles of knee and ankle (“c” in Figure 7C) when the foot entering into a hole, which is consistent with the animal experiments. It is important to mention that, although the parameters for afferent feedback were determined during optimization performed to reproduce the normal walking, the afferent feedback incorporated in the model allowed the model to reproduce adaptive changes of locomotor characteristics during stepping into a hole. Furthermore, the mechanism responsible for this adaptive response was explained by the transition from the slow to fast dynamics in the RG neurons induced by the changes in the nullclines due to afferent feedback (Figure 7).
The adaptive locomotor behavior during stepping into a hole can be also interpreted based on the phase-dependent response of the CPG activity. Stimulation of extensor afferents during the active phase in fictive locomotion of decerebrate cats was shown to increase and prolong the extensor activity (Duysens, 1977), and our isolated CPG model was able to reproduce the phase-dependent response (Figure 4B). In the model, during in normal walking, Ib feedback from extensors increased during the stance phase due to the ground reaction force, which increased and prolonged the activities of the extensor half center of the CPG (Figure 5B). However, when the foot entered the hole, the force feedback from the extensor muscles was reduced due to the lack of the ground reaction force and the activity of the extensor half center was reduced (Figures 6B, 7A). Similarly, stimulation of flexors afferents during the silent phase in fictive locomotion in decerebrate cats inhibited the extensor activity and initiated transition to flexion (Schomburg et al., 1998), and our isolated CPG model also reproduced these phase-dependent responses (Figure 4A). The flexor muscles in our model were stretched when the foot entered into a hole and afferent feedback from the flexor side increased (Figure 6B), which inhibited the activities of extensor muscles and shortened the stance phase leading to an advanced onset of the swing phase. As a result, the extension of the joints stopped and they were strongly flexed to pull the foot out of the hole.
6.2 Limitations and Future Works
In this study, we focused only on simulation of walking with a single hole as a source of locomotor disturbance. This allowed us to investigate the roles of afferent feedback from both flexor and extensor muscles because stepping into a hole caused unloading of extensor muscles and stretching of flexor muscles. We have not considered other walking disturbances tested experimentally, such as the presence of obstacles, cutaneous stimulation, and mechanical blockage of limb flexion (Forssberg et al., 1977; Lam and Pearson, 2001; Drew et al., 2002). In particular, while we focused on a hole without a bottom, a foot can have touchdown in a hole with a bottom depending on the depth, which changes the afferent feedback and phase transition. In the future, we would like to simulate walking with these other disturbances to provide mechanistic understanding of adaptation observed during locomotion. In addition, our model would be useful to investigate the responses when afferent feedback does not work well due to the paralysis and provides wrong information.
Because our present model used only one pair of the PF neurons (a PF-F neuron for the flexor side and a PF-E neuron for the extensor side), the motor commands activated the flexor and extensor muscles in strict alternation. However, in the biological system, some muscles show activity in both swing and stance phases and some muscles are active during only part of one phase (Prilutsky et al., 2016). In addition, muscle synergy analysis suggested that muscle activities during animal walking can be explained by the combination of a few basic patterns (Dominici et al., 2011). Several previous CPG models have been proposed to produce such multiple patterns by increasing the complexity of the PF network (Markin et al., 2016). It has been also suggested that some afferent feedback is projected to the contralateral side of the CPG (McCrea, 2001). We will include these components in a more elaborated model in the future.
Also in this work, we only modeled one hindlimb, which did not allow us to consider interlimb coordination. The latter is also known to play an important role in adaptive walking (Forssberg et al., 1980). Particularly, when a foot of one limb enters a hole, the activity of the extensor muscle of the contralateral limb has been shown to increase to compensate for the weight support (Hiebert et al., 1994). In addition, animals change their gait patterns, such as walking, trotting, and galloping, depending on locomotor speed by controlling the interlimb coordination. A neural model simulating coordination between RG circuits controlling each limb has been proposed (Danner et al., 2016, 2017). These interactions will be included in the future extended model simulating locomotion with two forelimbs and two hindlimbs.
Statements
Data availability statement
The raw data supporting the conclusion of this article will be made available by the authors, without undue reservation.
Author contributions
SA developed the study design in consultation with the other co-authors. YK performed simulation experiments and analyzed the data in consultation with SA, SF, SD, SM, JA, and IR. YK and SA wrote the manuscript and SD, SM, JA, and IR revised it. All the authors reviewed and approved it.
Funding
This study was supported in part by JSPS KAKENHI Grant Numbers JP19KK0377, JP20H00229, and JP20KK0226; JST FOREST Program Grant Number JPMJFR2021; NIH grants R01NS100928, R01NS110550, R01NS112304, and R01NS115900; and NSF grant 2113069.
Conflict of interest
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
Publisher’s note
All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.
References
1
DannerS. M.WilshinS. D.ShevtsovaN. A.RybakI. A. (2016). Central Control of Interlimb Coordination and Speed-dependent Gait Expression in Quadrupeds. J. Physiol.594 (23), 6947–6967. 10.1113/jp272787
2
DannerS. M.ShevtsovaN. A.FrigonA.RybakI. A. (2017). Computational Modeling of Spinal Circuits Controlling Limb Coordination and Gaits in Quadrupeds. Elife6, 1–25. 10.7554/eLife.31050
3
DemirS. S.ButeraR. J.DeFranceschiA. A.ClarkJ. W.ByrneJ. H. (1997). Phase Sensitivity and Entrainment in a Modeled Bursting Neuron. Biophysical J.72 (2), 579–594. 10.1016/s0006-3495(97)78697-1
4
DominiciN.IvanenkoY. P.CappelliniG.d’AvellaA.MondìV.CiccheseM.et al (2011). Locomotor Primitives in Newborn Babies and Their Development. Science334 (6058), 997–999. 10.1126/science.1210617
5
DrewT.JiangW.WidajewiczW. (2002). Contributions of the Motor Cortex to the Control of the Hindlimbs during Locomotion in the Cat. Brain Res. Brain Res. Rev.40 (1-3), 178–191. 10.1016/s0165-0173(02)00200-x
6
DuysensJ.PearsonK. G. (1980). Inhibition of Flexor Burst Generation by Loading Ankle Extensor Muscles in Walking Cats. Brain Res.187 (2), 321–332. 10.1016/0006-8993(80)90206-1
7
DuysensJ. (1977). Reflex Control of Locomotion as Revealed by Stimulation of Cutaneous Afferents in Spontaneously Walking Premammillary Cats. J. Neurophysiol.40 (4), 737–751. 10.1152/jn.1977.40.4.737
8
EkebergÖ.PearsonK. (2005). Computer Simulation of Stepping in the Hind Legs of the Cat: An Examination of Mechanisms Regulating the Stance-To-Swing Transition. J. Neurophysiol.94 (6), 4256–4268. 10.1152/jn.00065.2005
9
ErmentroutB. (1994). Reduction of Conductance-Based Models with Slow Synapses to Neural Nets. Neural Comput.6 (4), 679–695. 10.1162/neco.1994.6.4.679
10
ForssbergH.GrillnerS.RossignolS. (1977). Phasic Gain Control of Reflexes from the Dorsum of the Paw during Spinal Locomotion. Brain Res.132 (1), 121–139. 10.1016/0006-8993(77)90710-7
11
ForssbergH.GrillnerS.HalbertsmaJ.RossignolS. (1980). The Locomotion of the Low Spinal Cat. Ii. Interlimb Coordination. Acta Physiol. Scand.108 (3), 283–295. 10.1111/j.1748-1716.1980.tb06534.x
12
FrigonA.SiroisJ.GossardJ.-P. (2010). Effects of Ankle and Hip Muscle Afferent Inputs on Rhythm Generation during Fictive Locomotion. J. Neurophysiol.103 (3), 1591–1605. 10.1152/jn.01028.2009
13
FujikiS.AoiS.TsuchiyaK.DannerS. M.RybakI. A.YanagiharaD. (2019). Phase-dependent Response to Afferent Stimulation during Fictive Locomotion: A Computational Modeling Study. Front. Neurosci.13, 1288. 10.3389/fnins.2019.01288
14
GorassiniM. A.ProchazkaA.HiebertG. W.GauthierM. J. (1994). Corrective Responses to Loss of Ground Support during Walking. I. Intact Cats. J. Neurophysiol.71 (2), 603–610. 10.1152/jn.1994.71.2.603
15
GrillnerS. (1981). “Control of Locomotion in Bipeds, Tetrapods, and Fish,” in Handbook of Physiology, Sect. 1. The Nervous System: Motor Control. Editor BrooksV. B. (Bethesda, MD: American Physiological Society), Vol. II, Pt. 2, 1179–1236. 10.1002/cphy.cp010226
16
GuertinP.AngelM. J.PerreaultM. C.McCreaD. A. (1995). Ankle Extensor Group I Afferents Excite Extensors throughout the Hindlimb during Fictive Locomotion in the Cat. J. Physiol.487, 197–209. 10.1113/jphysiol.1995.sp020871
17
HansenN.MüllerS. D.KoumoutsakosP. (2003). Reducing the Time Complexity of the Derandomized Evolution Strategy with Covariance Matrix Adaptation (CMA-ES). Evol. Comput.11 (1), 1–18. 10.1162/106365603321828970
18
HiebertG. W.GorassiniM. A.JiangW.ProchazkaA.PearsonK. G. (1994). Corrective Responses to Loss of Ground Support during Walking. ii. Comparison of Intact and Chronic Spinal Cats. J. Neurophysiol.71 (2), 611–622. 10.1152/jn.1994.71.2.611
19
HiebertG. W.WhelanP. J.ProchazkaA.PearsonK. G. (1996). Contribution of Hind Limb Flexor Muscle Afferents to the Timing of Phase Transitions in the Cat Step Cycle. J. Neurophysiol.75 (3), 1126–1137. 10.1152/jn.1996.75.3.1126
20
LamT.PearsonK. G. (2001). Proprioceptive Modulation of Hip Flexor Activity during the Swing Phase of Locomotion in Decerebrate Cats. J. Neurophysiol.86 (3), 1321–1332. 10.1152/jn.2001.86.3.1321
21
MarkinS. N.KlishkoA. N.ShevtsovaN. A.LemayM. A.PrilutskyB. I.RybakI. A. (2010). Afferent Control of Locomotor Cpg: Insights from a Simple Neuromechanical Model. Ann. N. Y. Acad. Sci.1198, 21–34. 10.1111/j.1749-6632.2010.05435.x
22
MarkinS. N.KlishkoA. N.ShevtsovaN. A.LemayM. A.PrilutskyB. I.RybakI. A. (2016). “A Neuromechanical Model of Spinal Control of Locomotion,” in Neuromechanical Modeling of Posture and Locomotion. Editors PrilutskyB. I.EdwardsD. H. (New York: Springer Science), 21–65. 10.1007/978-1-4939-3267-2_2
23
McCreaD. A. (2001). Spinal Circuitry of Sensorimotor Control of Locomotion. J. Physiol.533 (1), 41–50. 10.1111/j.1469-7793.2001.0041b.x
24
MolkovY. I.BacakB. J.TalpalarA. E.RybakI. A. (2015). Mechanisms of Left-Right Coordination in Mammalian Locomotor Pattern Generation Circuits: A Mathematical Modeling View. Plos Comput. Biol.11 (5), e1004270–40. 10.1371/journal.pcbi.1004270
25
OrlovskyG.DeliaginaT. G.GrillnerS. (1999). Neuronal Control of Locomotion: From Mollusc to Man. Oxford, United Kingdom: Oxford University Press.
26
PearsonK. G.RamirezJ. M.JiangW. (1992). Entrainment of the Locomotor Rhythm by Group Ib Afferents from Ankle Extensor Muscles in Spinal Cats. Exp. Brain Res.90 (3), 557–566. 10.1007/BF00230939
27
PerreaultM. C.AngelM. J.GuertinP.McCreaD. A. (1995). Effects of Stimulation of Hindlimb Flexor Group Ii Afferents during Fictive Locomotion in the Cat. J. Physiol.487, 211–220. 10.1113/jphysiol.1995.sp020872
28
PrilutskyB. I.KlishkoA. N.WeberD. J.LemayM. A. (2016). “Computing Motion Dependent Afferent Activity during Cat Locomotion Using a Forward Dynamics Musculoskeletal Model,” in Neuromechanical Modeling of Posture and Locomotion. Editors PrilutskyB. I.EdwardsD. H. (New York: Springer Science), 273–307. 10.1007/978-1-4939-3267-2_10
29
RossignolS.DubucR.GossardJ.-P. (2006). Dynamic Sensorimotor Interactions in Locomotion. Physiol. Rev.86 (1), 89–154. 10.1152/physrev.00028.2005
30
RossignolS. (1996). “Neural Control of Stereotypic Limb Movements,” in Handbook of Physiology, Sect. 12. Exercise: Regulation and Integration of Multiple Systems. Editors RowellL. B.SheperdJ. T. (Oxford: American Physiological Society), 173–216. 10.1002/cphy.cp120105
31
RybakI. A.ShevtsovaN. A.Lafreniere-RoulaM.McCreaD. A. (2006a). Modelling Spinal Circuitry Involved in Locomotor Pattern Generation: Insights from Deletions during Fictive Locomotion. J. Physiol.577 (2), 617–639. 10.1113/jphysiol.2006.118703
32
RybakI. A.StecinaK.ShevtsovaN. A.McCreaD. A. (2006b). Modelling Spinal Circuitry Involved in Locomotor Pattern Generation: Insights from the Effects of Afferent Stimulation. J. Physiol.577 (2), 641–658. 10.1113/jphysiol.2006.118711
33
SchomburgE. D.PetersenN.BarajonI.HultbornH. (1998). Flexor Reflex Afferents Reset the Step Cycle during Fictive Locomotion in the Cat. Exp. Brain Res.122 (3), 339–350. 10.1007/s002210050522
34
SpardyL. E.MarkinS. N.ShevtsovaN. A.PrilutskyB. I.RybakI. A.RubinJ. E. (2011). A Dynamical Systems Analysis of Afferent Control in a Neuromechanical Model of Locomotion: I. Rhythm Generation. J. Neural Eng.8 (6), 065003–065031. 10.1088/1741-2560/8/6/065003
35
StecinaK.QuevedoJ.McCreaD. A. (2005). Parallel Reflex Pathways from Flexor Muscle Afferents Evoking Resetting and Flexion Enhancement during Fictive Locomotion and Scratch in the Cat. J. Physiol.569, 275–290. 10.1113/jphysiol.2005.095505
36
YakovenkoS.GritsenkoV.ProchazkaA. (2004). Contribution of Stretch Reflexes to Locomotor Control: A Modeling Study. Biol. Cybernetics90 (2), 146–155. 10.1007/s00422-003-0449-z
Appendix
A Parameters for CPG Model
Based on Molkov et al. (2015), Danner et al. (2016), Danner et al. (2017), Markin et al. (2010), and Fujiki et al. (2019), we determined the parameters for the synaptic connections αij, βij, and γi and those for the currents , , , and as shown in Tables 1, 2, respectively. We used the following parameter values: , , ESynE = − 10 mV, ENa = 55 mV, C = 20 pF, Vth = − 50 mV, Vmax = 0 mV, and d = 1.0.
TABLE 1
| Source j | Target neuron i | |||||
|---|---|---|---|---|---|---|
| RG-F | RG-E | In-F | In-E | PF-F | PF-E | |
| Excitatory connections αij | ||||||
| RG-F | 0 | 0 | 0.4 | 0 | 0.7 | 0 |
| RG-E | 0 | 0 | 0 | 0.4 | 0 | 0.7 |
| Inhibitory connections βij | ||||||
| In-F | 0 | 0.7 | 0 | 0 | 0 | 2.1 |
| In-E | 0.1 | 0 | 0 | 0 | 0.3 | 0 |
| Connections from supraspinal drive γi | 0.02 | 0.15 | 0 | 0 | 0 | 0 |
Parameters for synaptic connections.
TABLE 2
| Target neuron i | ||||
|---|---|---|---|---|
| 4.5 | 2.8 | 1.6 | 1.6 | |
| 4.5 | — | 0.5 | 0.3 | |
| −75 | −75 | −70 | −70 | |
| −62.5 | −60 | −64 | −64 | |
Parameters for currents.
B Parameters Determined by Optimization to Generate Normal Walking
Through the optimization needed to generate normal walking, the parameters for the synaptic connections αij were determined as shown in Table 3 and the weight coefficients for afferent feedback were determined as follows: , , , , , , and η = 0.27.
TABLE 3
| Source j | Target motoneuron i | ||||||
|---|---|---|---|---|---|---|---|
| Mn-IP | Mn-GM | Mn-VL | Mn-TA | Mn-SO | Mn-BF | Mn-GA | |
| Excitatory connections αij | |||||||
| PF-F | 0.084 | 0 | 0 | 0.074 | 0 | 0.077 | 0 |
| PF-E | 0 | 0.82 | 0.13 | 0 | 0.16 | 0 | 0.18 |
Optimized parameters for synaptic connections.
Summary
Keywords
walking, cat, neuromusculoskeletal model, central pattern generator, afferent feedback
Citation
Kim Y, Aoi S, Fujiki S, Danner SM, Markin SN, Ausborn J, Rybak IA, Yanagihara D, Senda K and Tsuchiya K (2022) Contribution of Afferent Feedback to Adaptive Hindlimb Walking in Cats: A Neuromusculoskeletal Modeling Study. Front. Bioeng. Biotechnol. 10:825149. doi: 10.3389/fbioe.2022.825149
Received
30 November 2021
Accepted
04 February 2022
Published
08 April 2022
Volume
10 - 2022
Edited by
Denis J. Marcellin-Little, University of California, Davis, United States
Reviewed by
Epaminondas Rosa, Illinois State University, United States
Michael Georg Metzen, McGill University, Canada
Updates
Copyright
© 2022 Kim, Aoi, Fujiki, Danner, Markin, Ausborn, Rybak, Yanagihara, Senda and Tsuchiya.
This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Shinya Aoi, shinya_aoi@kuaero.kyoto-u.ac.jp
This article was submitted to Biomechanics, a section of the journal Frontiers in Bioengineering and Biotechnology
Disclaimer
All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher.