Stable heteroclinic channels for controlling a simulated aquatic serpentine robot in narrow crevices

Abstract

Stable Heteroclinic Channels (SHCs) are dynamical systems composed of connected saddle equilibria. This work demonstrates a control system that combines SHCs with movement primitives to enable swimming in a simulated six segment snake robot. We identify control system parameters for lateral undulation, where all joints oscillate with the same amplitude, and anguilliform swimming, where joint amplitudes increase linearly from the head to the tail. Swimming speed is improved by learning SHC movement primitive parameters. We also propose a method for adapting the gait amplitude and frequency with tactile sensor input to accommodate obstacles. Then, we evaluate the relationship between SHC movement primitive parameters and the resulting trajectories. The swimming speed and efficiency of SHC controllers for each gait are compared against a conventional serpenoid controller, which derives joint trajectories from sinusoids. Controllers are evaluated first in an unobstructed environment, then in straight passages of various widths, and finally in 65 randomly generated uneven channels. We find that the amplitudes of joint oscillations scale proportionally with the SHC controller parameters. Due to gait optimization, as well as adaptive amplitude and frequency in response to tactile input, the learned SHC control system exhibits an average 28.8% greater speed than a serpenoid controller that only adapts amplitude during contact. This research demonstrates that SHCs benefit from intuitive tuning like serpenoid control, while also effectively incorporating sensory information to generate smooth kinematic trajectories.

1 Introduction

Modeling neuroanatomical structures not only supports biological research, but advances robotics by inspiring frameworks for adaptive, flexible control. Motor primitives (MPs) describe fundamental units of actuation that are assembled to produce complex behavior (Giszter, 2015). MP models in robots offer modular (Paraschos et al., 2013), learnable (Kober and Peters, 2009) control with efficient sensor integration (Bonardi et al., 2012). Meanwhile, central pattern generators (CPGs) are neural circuits that produce rhythms without rhythmic input (Ijspeert, 2008) for locomotion and other functions (Sherrington, 1910; Grillner and Wallén, 2010; Cropper et al., 2004). Hierarchical MP and CPG combinations have been proposed for adaptable rhythms in biological (Guertin, 2013) and mechanical contexts (Moreno and Gomez, 2011). However, relationships between MP parameters and resulting behaviors are nonlinear, complicating modification and analysis (Rouse and Daltorio, 2021). We demonstrate that kinematic MPs incorporating Stable Heteroclinic Channels (SHCs), an emerging CPG model (Daltorio et al., 2013; Brecelj and Petrič, 2023a), enable transparent, learnable, and sensor-adaptable control in a simulated swimming snake robot. In obstacle-free and confined environments, we compare speed and efficiency for SHC controllers with a serpenoid controller, which prescribes joint angles via sinusoids. We further show that incorporating tactile sensing improves speed in confined spaces.

MPs have been used to both model animal behavior (Tresch and Bizzi, 1999; Fod et al., 2002; Tagliabue et al., 2015) and plan robot motion (Ijspeert et al., 2013). MPs arise when modular clusters of neurons and muscle cells reliably produce specific kinematic trajectories or force outputs (Giszter, 2015). Dynamic Movement Primitives (DMPs) are a popular framework for constructing kinematic MPs in robots (Paraschos et al., 2013; Hoffmann et al., 2009; Pastor et al., 2009; Schaal, 2006; Kober and Peters, 2009). They rely on sequentially arranged, weighted Gaussian distributions (kernels), where weights are learned from demonstration to produce arbitrary trajectories (Schaal, 2006; Pastor et al., 2009; Kong et al., 2023). Sensory inputs adapt the planned trajectory, allowing robots to interact with their environment Paraschos et al. (2013). Periodically activating kernels yields rhythmic behavior (Ijspeert et al., 2013). The mapping from learned parameters to the planned trajectory is nonlinear (Rouse and Daltorio, 2021). Thus, the controller behaves as a black box, making it difficult to discern how adjusting the weights may influence robot behavior.

Like MPs, CPGs are an important aspect of biological motor function, and have been modeled for robotic control. Biological CPGs can emerge from a pacemaker neuron that rhythmically self excites (Harris-Warrick, 2010; Marder and Eisen, 1984), or mutually inhibitory, modular neuron clusters (e.g., half-center oscillators) (Ijspeert, 2008; Grillner and Wallén, 2010). The peripheral nervous system can modulate rhythms by inhibiting or exciting CPG neurons (Andersson et al., 1978). In addition to modeling neural connections, biomimetic CPG simulate cellular processes using Hodgkin-Huxley (HH) (Simoni and DeWeerth, 2007) dynamics or approximations such as leaky integrators (Yu et al., 2014). More abstract models use limit cycles, or coupled oscillatory differential equations, to approximate neuron clusters without reproducing cellular dynamics (Wang Z. et al., 2017; Ijspeert et al., 2013). Couplings represent relationships between joints, as well as extensors and flexors for a single joint (Thandiackal et al., 2021). Biomimetic models offer insight into mechanisms for rhythmogenesis, while abstractions address neuron cluster interactions (Ijspeert, 2008). Modularity and sensor integration make both types of CPGs attractive tools for rhythmic control in robots (Hunt et al., 2017; Ijspeert et al., 2007).

Segmental robots based on snakes (Wang J. et al., 2017), salamanders (Ijspeert et al., 2007), and worms (Riddle et al., 2023) are useful for examining CPG controllers due to their modular construction and variety of motor patterns. Biomimetic CPGs have been demonstrated for controlling a biohybrid snake robot, where light responsive cells induce turning by stimulating neurons that control the anterior joint (Cheslet et al., 2024). Additionally, Norman-Tenazas (2021) algorithmically evaluates neuron configurations for CPGs with leaky-integrator dynamics, then applies the best performer to a snake robot with motor torque sensing for navigating peg arrays. More abstract models emphasizing CPG connectivity have been examined as well. For example, Thandiackal et al. (2021) applies Matsuoka oscillators to show that intrinsic joint oscillations, intersegmental coupling, and reflex chains sensitive to fluid forces can all drive undulation, though a combined approach is more robust. Meanwhile, Moreno and Gomez (2011) use motor primitives to adapt CPG amplitude and frequency. Combined with range sensors on the front and sides of the robot, the hierarchical structure enables the robot to avoid and climb over obstacles.

While abstract CPGs based on limit cycles have demonstrated effective control in segmented robots, some research suggests that CPGs constructed with stable heteroclinic channels (SHCs) are more responsive to sensory inputs (Horchler et al., 2015; Rabinovich et al., 2006; Shaw et al., 2015). SHCs consist of saddle equilibria connected cyclically such that the unstable manifold of one flows into the stable manifold of the next (Horchler et al., 2015). Perturbing the system away from equilibria with noise or sensor input causes state transitions, analogous to pushing a ball off of a hill Horchler et al. (2015). Perturbation intensity and timing influence residence times near equilibria (Horchler et al., 2015; Rouse et al., 2024). Ashwin and Postlethwaite (2016); Ashwin et al. (2011) describe heteroclinic cycle stability criteria with consideration to noise. Biological research on Aplysia shows that SHCs tuned for finite state machine-like transitions are responsive to sensor inputs and qualitatively reproduce in vivo feeding behaviors (Shaw et al., 2015). SHCs have also been applied in a simulated worm-like robot, with force sensors modulating transitions between expansion and contraction to improve locomotion through a pipe (Daltorio et al., 2013). Similarly, Brecelj and Petrič (2023b) use SHCs in a humanoid robot, where saddles correspond to stances (e.g., standing, raised hands) and forces on the grasper drive transitions. Recently, Rouse and Daltorio (2021) demonstrated that MPs based on SHCs instead of Gaussian kernels exhibit transparent control. Specifically, weights visually resemble the trajectory in a kinematic model.

Our research demonstrates movement primitives based on SHCs for control of a simulated snake robot, then assesses methods for adapting gaits by scaling and learning weight parameters, as well as incorporating sensory input. We validate the hypothesis that joint trajectories, which collectively constitute the gait, vary proportionally with SHC weight parameters. We exploit this characteristic to construct an anguilliform (eel-like) swimming gait from the lateral undulation gait. The anguilliform gait is characterized by smaller oscillations in anterior joints. We demonstrate that weights are learnable, enabling gait optimization with respect to swimming speed and efficiency. Finally, we show that gaits are enhanced by modifying the rate of progression between saddle points with sensory information. To our knowledge, this is the first work demonstrating correspondence between SHC movement primitive weights and the resulting gait in a nonlinear dynamical system.

To validate our controller, we implement both serpenoid and SHC control in a planar snake robot simulation and demonstrate that the controllers achieve comparable performance (i.e., efficiency and swimming speed) in quiescent fluid. We show that the anguiliform gait emerges by independently scaling the weight amplitudes for each joint, then characterize the relationship between weights and joint amplitudes (Figure 1). Separately, we apply gradient descent to optimize the SHC weights, improving the speed of the robot in an obstacle free environment. Then we integrate tactile sensing to increase the progression rate between saddle points during contact and assess the controller performance as the robot maneuvers through both straight and uneven passages. The efficiency and speed of the simulated robot with SHC control and compliant serpenoid control are compared. Our work serves as a basis for future controllers that adapt to fluid and obstacle interactions in a biologically plausible manner.

FIGURE 1

2 Methods

2.1 Modes of locomotion

Biological snakes use various gaits for different environmental conditions. In uncluttered terrestrial environments, snakes perform lateral undulation, where a transverse wave propagates from the head to the tail (Figure 2A). All points on the body trace the same path because ground forces prevent slipping in the transverse direction (Gray, 1946; Jayne, 2020). Aquatic lateral undulation, or anguilliform locomotion, is also characterized by a similar transverse wave, but the amplitude and wavelength increases from the head to the tail (Figure 2B). Different points trace distinct paths because there are no ground contact forces to facilitate nonholonomic constraints (Gray, 1946; Jayne, 2020). Instead, resistive and reactive fluid forces provide thrust (Piñeirua et al., 2015). Additionally, the muscle activation timing differs from terrestrial lateral undulation (Jayne, 2020).

FIGURE 2

In loose or slippery substrates such as sand, snakes in the Caenophidia clade switch to a sidewinding gait (Mosauer, 1932). Sidewinding is characterized by anchoring some sections of the body on the ground, thrusting the unanchored sections to one side, then repeating, alternating the unanchored and anchored sections to produce lateral locomotion. In tunnel concertina locomotion, a snake will anchor itself against both sides of a narrow passage, extend forward by straightening its joints starting from the head, then anchor itself again (Gray, 1946). A variation of concertina locomotion is also used for arboreal locomotion during climbing or along thin branches (Astley and Jayne, 2007). In spaces too narrow for concertina locomotion, snakes may use a rectilinear gait where portions of the body are lifted off the ground and moved forward, akin to walking (Lissmann, 1950).

2.2 Control

2.2.1 Lateral undulation gait with serpenoid control

In early work parameterizing snake kinematics, Shigeo (1994) proposed the serpenoid curve, wherein sinusoids approximate the shape of an undulating snake. The desired relative joint angle for joint at time follows Equation 1 with joint amplitude , frequency , and phase offset between joints . Biasing the relative joint angles with the steering term induces whole body turning.

Hirose’s model has become popular for snake robots due to its simplicity and versatility. The serpenoid curve has been used for both terrestrial and aquatic lateral undulation (Shigeo, 1994; Ostrowski and Burdick, 1996; Sato et al., 2002; Kelasidi et al., 2014). It has also been adapted for sidewinding (Tesch et al., 2009), concertina (Chen and Roth, 2023), and rectilinear (Tesch et al., 2009) gaits. Additionally, several authors have augmented the serpenoid curve to support obstacle aided locomotion (Rollinson and Choset, 2013; Travers et al., 2018; Travers et al., 2015) and mitigate slipping (Dehghani and Mahjoob, 2009). In our work, we use it as a basis for comparison with our SHC controllers. We select gait parameters rads, frequency rads/s, and rads, consistent with Kelasidi et al. (2017).

To ensure locomotion along the axis, we adapt the steering control in Kelasidi et al. (2017). The simulated robot heading is computed as the average of all linkage angles with respect to the horizontal (See Figure 3; Equation 2). We assign a desired heading using the steering constant (where is the length of one robot segment) and the center of mass displacement from the axis, (Equation 3). Then, the steering term is computed using proportional-integral (PI) control with integral gain and proportional gain (Equation 4; Table 1).

FIGURE 3

The actuator torques for each joint are computed as in Kelasidi et al. (2014) with proportional gain , damping , and relative joint angles (Equation 5).

2.2.2 Tactile sensing with serpenoid control

Trajectory planning is enhanced by considering the interactions between the robot and environmental obstacles. Travers et al. (2015) define shape compliant control, where serpenoid curve parameters vary due to obstacle contact. Specifically, their robot senses externally applied torques on each joint and adjusts the reference joint amplitudes using an admittance controller, enabling the robot to brace against obstacles (Equation 6).In Travers et al. (2015), the admittance controller gains , , and are functions of the robot configuration, and the reference amplitude is held constant for a given joint. Their compliant control produces coordinated locomotion through an environment with regularly spaced pegs. Other methods of shape control have been explored for pipe climbing (Rollinson and Choset, 2013) and navigating rugged terrain (Travers et al., 2018).

We adopt a simplified shape controller based on Travers et al. (2015), where the robot narrows its gait by decreasing joint amplitudes during contact. Once contact ceases, the joint amplitudes return to the reference value (see Equation 7). This method reduces contact with the walls in confined spaces. We choose amplitude gain , amplitude damping , and tactile input gain . Tactile input if any linkages contact an obstacle and otherwise. Joints are uniformly impacted by tactile inputs from all segments.

2.2.3 Lateral undulation gait with SHC control

2.2.3.1 SHC dynamics

To validate SHC-based MPs as a viable control method snake robots, we first emulate the lateral undulation gait employed by the serpenoid controller. SHCs encode rhythmic behavior as cyclic progression between saddle points or kernels. The kernel activity , which denotes proximity to each of the saddle points, is given by Equation 8 (Rouse and Daltorio, 2021; Daltorio et al., 2013). The operator indicates element-wise multiplication. The kernel activity dictates the phase of the rhythmic trajectory. Oscillation of all joints is established by generating two cycles in antiphase, one for counterclockwise and one for clockwise motion. Counterclockwise and clockwise motor commands are analogous to contraction of muscles on the left and right side of a biological snake. Maintaining distinct cycles for each direction allows phase differences between joints to be easily defined and emphasizes how couplings between joints can drive undulation. Connections between counterclockwise and clockwise components should be included in future research, similar to other works (Norman-Tenazas, 2021; Wang Z. et al., 2017).

With a phase offset of radians between joints and separate kernels for each direction, it is convenient to choose kernels.

Considering only the subformula , the activity of the kernel grows exponentially according to its growth rate, and the time scaling factor . Then, we design an inhibition matrix such that each kernel inhibits itself and all other kernels in the same cycle except the next one in the sequence. The inhibition causes kernels to momentarily activate in a winnerless competition (Horchler et al., 2015). To ensure stability, the kernel activity is bounded such that , as in Rouse and Daltorio (2024). Since the proposed SHC controller includes one cycle corresponding to counterclockwise and another for clockwise motion of each joint, we compose the relationship between kernels using a block diagonal connection submatrix as in Equations 9, 10.

We refer to Rouse and Daltorio (2024) as a guideline for tuning the SHC MP controller. The study outlines how inhibition parameters impact kernel activation and trajectories as the controller traces a square. The growth rate influences how quickly the kernels are excited, thereby influencing the frequency of the CPG. The growth magnitude controls the peak amplitude of kernels. When , the kernel and trajectory amplitude are reduced. For , kernels maintain their maximum activity for an extended period, then decay slowly. The resulting trajectory has increased amplitude, slower transitions away from each vertex, and a phase shift. The insensitivity to noise determines how likely perturbations are to induce state transitions. Varying has little impact on the kernel activation or trajectories. Increasing above 1 allows more precision near waypoints, but distorts transitions between waypoints and reduces the frequency of the cycle. We select the growth rate for all joints such that the overall frequency of the CPG is the same as the frequency of the serpenoid controller . To avoid distorting the shape or frequency of the lateral undulation gait, we set and .

In addition to the excitatory and inhibitory components, the heteroclinic dynamics are augmented with Brownian noise via a time invariant Wiener process, (Equation 8) (Daltorio et al., 2013; Ashwin and Postlethwaite, 2016; Shaw et al., 2015). Using Euler-Maruyama integration, the noise term is represented as , where is a scaling parameter, is the simulation time step, and is a vector of normally distributed noise with mean of 0 and standard deviation of 1. The chosen scaling parameter is within ranges used in prior works (Horchler et al., 2015; Rouse and Daltorio, 2024; Daltorio et al., 2013) and is large enough to ensure sustained, regular transitions without causing the kernel activity to appear noisy. Though stability analysis for our controller with respect to noise (see Ashwin et al., 2011) would be valuable, this is left to future work. Parameter values are listed in Table 2.

2.2.3.2 Movement primitives with SHCs

To integrate SHCs with the MP framework, we define the desired joint accelerations as a function of kernel activity and current joint configuration (Equation 11). From the accelerations, desired joint velocities and angles are derived via explicit Euler integration.

The first term constitutes a PD controller with gain parameters and [consistent with Rouse and Daltorio (2021), Rouse and Daltorio (2024)] to ensure reference tracking. We choose an equilibrium joint angle such that the robot progresses in a straight line. The mapping function in Equation 11 dictates the shape of the trajectory. We adapt the mapping function defined in Rouse and Daltorio (2021)(Equation 12).

The weight matrix defines the sensitivity of the joints to the activity of each kernel. We also incorporate Proportional Integral Derivative (PID) steering control with gain matrix , reference signal , and heading parameters . The steering gains are tuned with a Ziegler-Nichols closed loop method adjusted for no overshoot (McCormack and Godfrey, 1998). The forcing term is normalized by the total kernel activity.

The weight submatrix is chosen according to Equation 13 and the overall weights are assigned as in Equation 14. The operators and indicate circulant addition and subtraction, respectively. We assign and . The weight matrix encodes the positive (counterclockwise) and negative (clockwise) trends in joint angles as the corresponding kernels become active or inactive.

Once the desired joint accelerations, velocities, and positions are computed for a given time step, we evaluate the joint torques using the same methods as in Equation 5 in Section 2.2.1.

2.2.4 Anguilliform gait with SHC control

Replicating the anguilliform gait with SHC control provides an opportunity to assess the scalability of SHC movement primitive trajectories. In Rouse and Daltorio (2021), the authors demonstrate that weight parameters for SHC movement primitives visually represent and are proportional to the desired trajectory for a simple kinematic model. Inspired by their work, we examine how gaits can be adapted by scaling the weights. Specifically, we assess weight scaling as a means of switching from the terrestrial lateral undulation gait to anguilliform locomotion. Kelasidi et al. (2014) approximate anguilliform locomotion by linearly scaling the joint amplitudes in their serpenoid controller as in Equations 15, 16.to implement an anguilliform gait with SHC control, we apply the scaling relationship in Equation 15 to the weight matrix (Equation 17). We expect that scaling the weights will proportionally change the amplitude of the trajectories for each joint.

2.2.5 SHC control with tactile sensing

CPGs, both in biological systems and robots, are most useful when they can be adapted by sensory information. Here, we establish a mechanism for incorporating tactile signals into SHC movement primitives, with the goal of improving speed of the simulated snake robot as it undulates through confined spaces. We introduce the term into the SHC canonical state equation, where (Equation18). We assign if any linkage contacts an obstacle and otherwise, as in Section 2.2.2. During contact, kernels progress more quickly such that joints have less time to accelerate and joint amplitudes decline. The increased kernel progression rate also increases joint oscillation frequency, leading to higher thrust (Huang et al., 2019) that may enable the robot to overcome friction if contact persists. Since all tactile sensors affect every kernel, phase differences between joints remain constant and coordinated locomotion is maintained. In future work, we may consider alternative SHC formulations that allow tactile sensors to impact joints independently.

2.2.6 Learned gait with SHC control

Robots, like animals, benefit from optimizing the speed and energy efficiency of locomotion. In (Rouse and Daltorio, 2021), the authors demonstrate that weights in SHC movement primitives can be learned to replicate a known trajectory for a purely kinematic system. Here, we extend their work, improving the robot’s performance by adjusting weights with consideration to the system dynamics. Beginning with the SHC controller for lateral undulation (see Section 2.2.5), we simulate swimming for seconds in an obstacle-free environment. The forward velocity of the center of mass (Equation 19) and energy efficiency of locomotion are assessed. We define efficiency as the overall cost of transport (COT) (Equation 20), where , is the acceleration due to gravity and is the total mass of the robot.

We establish a cost function (Equation 21) rewarding velocity, while penalizing poor efficiency. Note that the velocity is larger than the COT for lateral undulation such that this cost function prioritizes speed.we numerically approximate the gradient of the cost function with respect to for each joint . The weights are improved via gradient descent with a learning rate until the rate of change of weights , requiring 155 iterations (Equation 22). The selected learning rate allows smooth improvement in performance, and changes become relatively small by the time the stop condition is reached (see Supplementary Figure). While our experiments in Sections 2.3.2, 2.3.3 include obstacles, the weights are not relearned for these conditions. The tactile sensing parameters are kept the same as in Section 2.2.5.

2.3 Experimental design

2.3.1 Obstacle-free swimming

We first consider a simulated robot quiescent water with no obstacles. We adopt the framework proposed by Kelasidi et al. (2017), which addresses a submerged planar robot comprised of discrete linkages with elliptical cross sections. Fluid is viscous, incompressible, and irrotational in the reference frame of the robot. The authors develop equations of motion for the center of mass and linkage orientation including linear drag, nonlinear drag, and added mass in an unobstructed environment. Relative joint angles are derived from kinematics as . We consider a robot with segments, where each segment has a major radius , minor radius , half-length of , and a mass of , except the head segment. The head segment is extended ( and ) to accommodate electronic components for a physical robot, which is under development. Fluid parameters and fluid body interaction constants are kept consistent with Kelasidi et al. (2017) (fluid density , added mass coefficient , added inertia coefficient , drag coefficient along link axis , and drag coefficient perpendicular to link = 2). All simulation parameters can be found in Table 3.

The experiment is conducted for the serpenoid, lateral undulation SHC, anguilliform SHC, and learned SHC controllers. The simulation runs for 60 s, recording the robot’s position, joint torques, and joint velocities. Power consumption is approximated as . Then, we compare the swimming speed and COT for each controller. Additionally, we assess the differences in behavior for SHC controllers by examining the joint trajectories, kernel activity, and forcing term . At time , the robot is at rest with all linkage angles and the center of mass located at the origin.

2.3.2 Straight channels

Simulating the robot in structured environments allows us to assess our method for integrating tactile information with SHC control. We examine straight passages ranging from to in width, at intervals of . The minimum width allows of freedom on each side of the robot, while the maximum channel width permits the joints to oscillate freely if the robot is centered. The robot begins entirely in the channel with and no contact with the walls. The overall COT and average velocity are calculated after 30 s of swimming for each case. This experiment addresses the serpenoid and lateral undulation SHC without sensing, as well as the serpenoid, lateral undulation SHC, and learned SHC with tactile sensing (+T).

Obstacles are treated as points connected by flat surfaces with stiffness and damping . We approximate each robot segment as a set of points spaced apart and assume that points colliding with an obstacle penetrated the nearest surface. The normal distance and normal velocity between the point and surface are computed, then the normal force centered at the point is approximated as . We incorporate friction via a linear model with stiction (Marques et al., 2016), where , , , and . The details are replicated in Equation 23. The variables , , and represent the tangential velocity, velocity at maximum static friction, and velocity at which only kinetic friction occurs (Table 3). Torque is obtained by integrating contact forces over the displacement from the link center of mass. The effects of obstacles on fluid behavior are ignored for simplicity, and fluid far from the robot remains quiescent.

2.3.3 Uneven channels

One of the most daunting aspects for exploratory robots is maintaining productive locomotion in complex terrain. We simulate the robot moving through channels with randomly generated feature (see examples in Figure 4). To establish consistent initial conditions, each channel begins with a long and wide straight section. The robot begins completely straight, at rest, and inside the channel. After the straight section, the upper surface of the channel is constructed such that and . Points along the bottom surface are computed likewise. If the distance between or and any point on the opposite boundary is less than the minimum channel width ( times robot width), the upper and lower points are replaced. Similarly, the points are regenerated if the distance between and exceeds (2.8 times robot width) apart so that results do not simply reflect obstacle-free behavior. Due to random walk, the center lines shift laterally up to 1.6–3.0 robot widths over a single length of the robot, depending on the channel.

FIGURE 4

We simulate 60 s of swimming in each channel using the serpenoid and lateral undulation SHC controllers with and without tactile sensing. The learned SHC controller (+T) is also examined. Steering is disabled since the direction of the channel varies. We estimate the minimum number of channels required using power analysis conducted in the software G*Power for 1-way ANOVA with effect size , power , and five groups. To account for invalid results, we increase the sample size to . Specifically, data is excluded if the robot does not enter and remain within the uneven portion of the channel. We compute the COT and velocity using only time steps after the robot has fully entered the uneven section. Since the data does not follow normality assumptions, we assess statistical significance with Kruskal–Wallis testing, followed by Dunn-Šídák post hoc analysis. Furthermore we categorize the progress for each controller as continual, ceased, or intermittent. We specify that progress has ceased if the robot does not move forward by more than 0.1 m for at least 7.2 s (two gait cycles under unimpeded locomotion). We define intermittent progress where forward motion ceases for at least two gait cycles, but later resumes. The rates of continual, ceased, and intermittent progression for each controller are assessed.

3 Results

3.1 Obstacle-free swimming

3.1.1 Lateral undulation gait with SHC control

In quiescent fluid with no obstacles, the SHC controller successfully replicates the lateral undulation gait. The SHC controller produces similar joint oscillations to the serpenoid controller, but with a smoother transition from rest to steady state oscillation (Figure 5A). For both methods, the heading naturally oscillates during undulation. The steering controllers compensate by increasing or decreasing the desired joint trajectories, causing joint amplitudes to differ from the reference value of .

FIGURE 5

Since the serpenoid and lateral undulation SHC controllers generate similar trajectories, they achieve comparable performance. The average velocity of the center of mass for both controllers is . The progression of the robot for all controllers is depicted in Figure 5 (also see Supplementary Files for Supplementary Video recording). (B) Due to differences in steering controller implementations, the SHC controller produces slightly better steady state efficiency than the serpenoid controller (Table 4).

A benefit of SHC control over serpenoid control is apparent when assessing the overall COT including transient effects . The conventional serpenoid curve yields a desired trajectory with nonzero initial joint angles and velocities, whereas most robots realistically start from rest. High accelerations, large joint torques, and high energy consumption are required to reduce the trajectory error, leading to an overall COT of 0.126 ( above steady state value). Shape-based control of the joint amplitude avoids this issue, albeit at increased complexity (Travers et al., 2015; 2018; Rollinson and Choset, 2013). In contrast, the SHC framework natively computes desired accelerations, then the desired velocity and position are evaluated by integration. This yields smooth kinematic trajectories such that the lateral undulation SHC controller achieves an overall COT only greater than its steady state value (Figure 5A).

3.1.2 Anguilliform gait with SHC control

By linearly scaling the SHC weights, we transform the lateral undulation gait to an anguilliform gait, with reduced anterior joint amplitudes. For example, we scale the weights for the anterior-most joint by (Equation 15) relative to weights for the lateral undulation SHC controller. Consequently, the anguilliform SHC controller forcing term magnitude is lower in comparison with the lateral undulation SHC (Figure 6A). This translates to a smaller joint amplitude (Figure 6C). The lateral undulation SHC controller exhibits a joint amplitude of , while the anguilliform SHC controller’s anterior joint amplitude reduces to , showing good correspondence with the scaling factor .

FIGURE 6

Scaling effects are more thoroughly characterized by considering the amplitudes of weights and for all joints (Figures 6B, D). The SHC weight amplitude for joint is defined by the maximum value in the row of the weight matrix (Figure 7). Anguilliform SHC weight amplitudes decrease linearly from the tail to the head, with similar trends emerging in joint amplitudes. The visible correspondence between weights, forcing term , and joint trajectories makes SHC MPs a transparent framework that robot operators can intuitively modify. Because lateral displacement is reduced, the anguilliform gait produces less thrust and slower swimming than the lateral undulation gait. However, the anguilliform gait is more efficient by 26.1% relative to serpenoid control and 17% relative to lateral undulation SHC control . While we only simulate one sample and recommend more comprehensive experiments with hardware, results qualitatively agree with prior work showing that efficiency is optimized at lower amplitudes compared to velocity (Anastasiadis et al., 2023).

FIGURE 7

3.1.3 Learned gait with SHC control

Our gait optimization for SHC control modifies the weight parameters to enhance speed of locomotion, while minimally affecting energy efficiency. The learned SHC controller achieves a higher overall velocity compared with the lateral undulation SHC controller. The steady state efficiency degrades, with the COT increasing from 0.087 in the lateral undulation gait to 0.10 in the learned gait.

The improved speed of locomotion in the learned SHC controller corresponds to changes in the controller weights and joint amplitudes. Relative to the lateral undulation SHC controller, the learned SHC controller possesses higher weight amplitudes for the posterior joints and lower weights for the anterior joints (7 (B)). The learned SHC weight amplitudes correspond loosely to the joint amplitudes (Figure 6D), which show a gradual decrease towards the head of the robot. Compared with anguilliform and lateral undulation SHC controllers, the learned controller shows weaker correspondence between weights and joint amplitudes because the distribution of weights, and thus acceleration patterns, may differ between joints.

When optimizing weight parameters for the learned SHC controller, the distribution of weights for each joint changes along with the peak amplitude. We compute the phases of weight distributions for each of the joints using a centroid method (Equations 24–27).

Gait optimization produces weight phase offsets between joints mostly near , lower than the design value of applied for other controllers (Figure 6E). The phase offset for the anterior joint pair may differ due to the longer segment length and increased mass, or because the has little impact on the optimization cost function. For all controllers, the weight phase offsets identified in the weight matrix are good predictors for phase offsets in the joint trajectories (Figure 6F). Some deviation occurs due to steering and fluid effects in all controllers.

3.2 Straight channels

We assess our method for integrating sensory information in the SHC controller by examining the robot’s progress through straight, narrow passages. Video of the robot in a channel is included in Supplementary Files. In cases where the robot penetrates deeply into obstacles, frictional forces are overestimated such that the robot slows abruptly. In future work, this can be resolved with smaller time steps during contact. Nevertheless, controllers that incorporate tactile information (denoted by (+T)) adapt their behavior to accommodate contact, enabling forward locomotion (Figure 8B). In contrast, unsensorized controllers push backwards against the wall, moving opposite of the intended direction. Speed benefits of gait optimization in an obstacle-free environment are retained in this structured environment.To validate how the sensor integration impacts SHC-generated gaits, we examine the kernel activity. Tactile sensing increases the frequency of kernel activation, forcing term , and joint trajectories (Figures 8C, D). While the forcing term achieves the same magnitude, the joints have less time to accelerate and therefore achieve lower amplitudes. The coupled frequency and amplitude adaptation enables the SHC controllers with tactile sensing to locomote more quickly than sensor-free implementations or the serpenoid (+T) controller, which only adapts joint amplitude.

FIGURE 8

The relative performance of the controllers depends on the width of the crevice (Figure 9). In the narrowest channels all controllers yield backwards net locomotion, as the robot incidentally pushes backwards against the walls. As channel width increases, forward velocity generally increases before saturating when the channels are wide enough that wall contact becomes negligible. Controllers that incorporate tactile sensing achieve forward progress at lower channel widths and maintain higher average velocities than their unsensorized counterparts. Moreover, the SHC controllers with tactile sensing achieve higher average velocities than the serpenoid (+T) controller, suggesting that the frequency and amplitude modulation is more effective than amplitude reduction alone. Consistent with results for the unimpeded swimming study, the learned SHC (+T) controller yields the highest velocity of all controllers in most regimes.

FIGURE 9

The advantages of tactile sensing are similarly evident from COT trends for narrow crevices (Figure 9). For the same channels, COTs for controllers equipped with tactile sensors are consistently lower than for controllers without. The lateral undulation and learned SHC controllers (+T) achieve similar efficiency to the serpenoid controller (+T) in channels narrower than approximately , and better efficiency in wider channels. While the learned SHC controller (+T) offers better speed, the lateral undulation SHC (+T) offers modestly better efficiency in some conditions. Based on the improved average velocity and efficiency, we conclude that scaling kernel progression rates according to tactile data is an effective mechanism for improving SHC performance in straight, narrow channels.

3.3 Uneven channels

In uneven channels, contact detection remains crucial to the performance of the robot. Without tactile sensing, the serpenoid and SHC controllers cannot adapt the body shape and become trapped when the robot contacts both sides of the channel (Figure 10A). With tactile sensing, the controllers reduce the amplitude of the joints, narrowing the gait and allowing the robot to pass obstacles (see video in Supplementary Files). However, the robot may still not progress consistently if it comes into contact with an obstacle head on, for example, the lateral undulation SHC (+T) controller in Figure 10A. In this case, the robot continually retries forward motion, colliding with the channel wall until a more suitable approach configuration occurs by chance and the robot overcomes the obstacle. As in prior experiments, the learned SHC allows the greatest forward progress when it is not trapped in the channel (Figure 10).

FIGURE 10

In the complete set of channels, the serpenoid and SHC controllers with tactile sensing achieve greater progress than those without. Of 65 obstacles, our analyses include 59 (serpenoid), 65 (serpenoid (+T)), 62 (lateral undulation SHC), 64 (lateral undulation SHC (+T)), and 62 (learned SHC (+T)) data points. In of cases where lateral undulation SHC controllers with and without sensing both produce valid results, the sensor equipped controller moves further through the channel. Similar results apply for the serpenoid controllers . The coupled frequency and amplitude response in the lateral undulation (+T) and learned SHC (+T) controllers allow the robot to swim further compared with the serpenoid (+T) controller, as long as the robot does not become trapped in the channel (Figure 10). However, the SHC (+T) controllers also suffer from high variability in performance. The serpenoid controller (+T) shows continual progression in the most channels (62%), followed by the learned SHC (+T) and lateral undulation SHC (+T) (both 45%) controllers (Table 5). The learned SHC (+T) controller is more likely to recover from being trapped (e.g., intermittent progress, than the lateral undulation SHC (+T) controller . Although the SHC controllers with tactile sensing are more likely to become trapped in uneven, confined spaces and operate less efficiently (see Figure 10D) than the serpenoid (+T) controller, they can achieve greater maximal forward progress.

Mean velocities are compared between controllers with a Kruskal–Wallis test, which indicates that one or more controllers differs . Controller pairs are compared with Dunn test with a Šidák correction to account for multiple comparisons, using confidence. The learned SHC (+T) controller outperforms the serpenoid controller (+T), achieving 28.8% higher velocity on average (See Figure 10C and Table 5). The learned SHC (+T) controller performs similarly to the lateral undulation SHC (+T) controller , albeit with slightly higher average velocity and lower variance due to improved rate of recovery from entrapment. Overall, these results indicate that modulating SHC kernel activation rates based on tactile sensing is an effective approach for navigating uneven terrain, particularly when paired with gait optimization techniques.

Incorporating tactile sensing improves efficiency, as well as speed. A Kruskal–Wallis test shows significant differences between the controllers , and we proceed with a Dunn-Šidák post hoc evaluation as before. Compared to the lateral undulation SHC controller without sensing, the learned SHC controller (+T) and lateral undulation SHC controller (+T) are more efficient. The learned and lateral undulation SHC controllers with sensing show similar efficiency . However, the serpenoid controller (+T) is significantly more efficient than either the learned SHC (+T) or lateral undulation SHC controllers (+T) (Figure 10D). The elevated COT for the sensorized SHC controllers is likely because tactile input increases the joint oscillation frequency, which entails higher energy consumption. If the increased motion does not enable the robot to overcome an obstacle, efficiency declines. Reducing efficiency for increased velocity may be acceptable for robots that are powered via tether or have time sensitive objectives, as in search and rescue.

4 Discussion

In this work, we implement movement primitives based on stable heteroclinic channels to control a simulated aquatic snake robot. The SHC controller provides comparable performance to a conventional serpenoid controller. We demonstrate that MP weights relate proportionally to joint trajectories by linearly scaling the weights from the lateral undulation SHC controller to achieve an anguilliform gait. We optimize the SHC controller by modeling the system dynamics and iteratively tuning the weights, resulting in a speed increase when the robot swims in an obstacle-free environment. Furthermore, we show that modulating transitions between SHC kernels with tactile sensing adapts the gait frequency and amplitudes to improve locomotion in straight passages (Figure 8). Finally, we examine locomotion over a diverse set of randomly generated channels that are between 1.7 and 2.8 times wider than the robot, and wander laterally up to three times the robot width over the robot’s length. Even for the most consistent controller examined (serpenoid (+T)), channel geometry considerably impacts velocity and cost of transport . Applying sensory information to regulate the pace of kernel transitions in SHC movement primitives improves average velocity by compared to a serpenoid controller that only alters the gait amplitude during contact in a variety of uneven, confined environments. SHC movement primitives thus constitute a transparent, learnable, and adaptable framework for establishing rhythmic gaits.

Our research serves as a practical demonstration of controlling a nonlinear dynamical system with SHC movement primitives and adapting its behavior by incorporationg sensory information. By showing that the weight parameters in SHC movement primitive relate proportionally to the resulting joint trajectories, we provide a pathway for robot operators to intuitively visualize, alter, and design gaits. In optimized controllers, the same visualizations may permit operators to heuristically predict emergent behavior without extensive testing. Thus, the SHC movement primitive controller offers a transparent approach to modeling CPGs, enabling faster development of bio-inspired systems. The abstract, visualizable approach allows researchers to address how CPG modules, represented by saddle equilibria, interact with sensory inputs and other modules to produce complex rhythmic motor patterns.

The present work demonstrates that SHCs are a promising control framework for replicating rhythmic behavior, and suggests that other locomotion patterns may be constructed by tuning weights and modulating progression between kernels. Future research may examine more advanced methods for incorporating sensory feedback to adapt individual joint trajectories, rather than regulating the entire network. Investigating weights and arrangements of saddle equilibria that enable other gaits, such as concertina locomotion would also be worthwhile. Transitioning between gaits may be achievable by expanding upon research by Rouse and Daltorio (2024), which explores the effects of sensor noise on decision making. Additionally, integration of more complex sensory information, such as vision, for localization and long term path planning would be beneficial. The effects of multisensory joint adaptation and gait transitions could be analyzed in environments with abrupt directional changes or multiple paths, such as S or T-shaped channels. With these improvements, movement primitives based on SHCs may contribute to research in biology by providing a convenient method for abstractly modeling neurological functions that support locomotion without detailed simulation of underlying cellular dynamics.

References

• 1

  AnastasiadisA.PaezL.MeloK.TytellE. D.IjspeertA. J.MullenersK. (2023). Identification of the trade-off between speed and efficiency in undulatory swimming using a bio-inspired robot. Sci. Rep.13, 15032. 10.1038/s41598-023-41074-9

  • CrossRef
  • Google Scholar

• 2

  AnderssonO.GrillnerS.LindquistM.ZomleferM. (1978). Peripheral control of the spinal pattern generators for locomotion in cat. Brain Res.150, 625–630. 10.1016/0006-8993(78)90827-2

  • CrossRef
  • Google Scholar

• 3

  AshwinP.KarabacakÃ.NowotnyT. (2011). Criteria for robustness of heteroclinic cycles in neural microcircuits. J. Math. Neurosci.1, 13. 10.1186/2190-8567-1-13

  • CrossRef
  • Google Scholar

• 4

  AshwinP.PostlethwaiteC. (2016). Quantifying noisy attractors: from heteroclinic to excitable networks. SIAM J. Appl. Dyn. Syst.15, 1989–2016. 10.1137/16M1061813

  • CrossRef
  • Google Scholar

• 5

  AstleyH. C.JayneB. C. (2007). Effects of perch diameter and incline on the kinematics, performance and modes of arboreal locomotion of corn snakes (Elaphe guttata). J. Exp. Biol.210, 3862–3872. 10.1242/jeb.009050

  • CrossRef
  • Google Scholar

• 6

  BechtoldB. (2016). Violin plots for matlab. 10.5281/zenodo.4559847

  • CrossRef
  • Google Scholar

• 7

  BonardiS.MoeckelR.SproewitzA.VespignaniM.IjspeertA. J. (2012). “Locomotion through reconfiguration based on motor primitives for roombots self-reconfigurable modular robots,” in ROBOTIK 2012; 7th German conference on robotics, 1–6.

  • Google Scholar

• 8

  BreceljT.PetričT. (2023a). Stable heteroclinic channel networks for physical human-humanoid robot collaboration. Sensors23, 1396. 10.3390/s23031396

  • CrossRef
  • Google Scholar

• 9

  BreceljT.PetričT. (2023b). “Utilizing a phase state system for reliable physical assistance in human-humanoid robot collaboration,” in 2023 21st international conference on advanced robotics (ICAR), 258–263. 10.1109/ICAR58858.2023.10406553

  • CrossRef
  • Google Scholar

• 10

  ChenS.RothA. (2023). Gait design of a novel arboreal concertina locomotion for snake-like robots. ArXiv:2309.06000. 10.48550/arXiv.2309.06000

  • CrossRef
  • Google Scholar

• 11

  ChesletJ.BeauboisR.KhoyrateeF.KohnoT.IkeuchiY.LeviT. (2024). “Biomimetic snake locomotion using Central Pattern Generators network and bio-hybrid robot perspective,” in Isarob (Beppu, Japan).

  • Google Scholar

• 12

  CropperE. C.EvansC. G.HurwitzI.JingJ.ProektA.RomeroA.et al (2004). Feeding neural networks in the mollusc Aplysia. Neurosignals13, 70–86. 10.1159/000076159

  • CrossRef
  • Google Scholar

• 13

  DaltorioK. A.BoxerbaumA. S.HorchlerA. D.ShawK. M.ChielH. J.QuinnR. D. (2013). Efficient worm-like locomotion: slip and control of soft-bodied peristaltic robots. Bioinspiration and Biomimetics8, 035003. 10.1088/1748-3182/8/3/035003

  • CrossRef
  • Google Scholar

• 14

  [Dataset] RouseN.HorchlerA.ChielH.DaltorioK. (2024). Sttable heteroclinic channels as a decision-making model: overcoming low signal-to-noise ratio with mutual inhibition.

  • Google Scholar

• 15

  DehghaniM.MahjoobM. J. (2009). “A modified serpenoid equation for snake robots,” in 2008 IEEE international conference on robotics and biomimetics, 1647–1652. 10.1109/ROBIO.2009.4913248

  • CrossRef
  • Google Scholar

• 16

  FodA.MatarićM. J.JenkinsO. C. (2002). Automated derivation of primitives for movement classification. Aut. Robots12, 39–54. 10.1023/A:1013254724861

  • CrossRef
  • Google Scholar

• 17

  GiszterS. (2015). Motor primitives—new data and future questions. Curr. Opin. Neurobiol.33, 156–165. 10.1016/j.conb.2015.04.004

  • CrossRef
  • Google Scholar

• 18

  GrayJ. (1946). The mechanism of locomotion in snakes. J. Exp. Biol.23, 101–120. 10.1242/jeb.23.2.101

  • CrossRef
  • Google Scholar

• 19

  GrillnerS.WallénP. (2010). “The lamprey locomotor central pattern generator,” in Handbook of brain microcircuits. Editors ShepherdD.GrillnerS.GordonP. (Oxford University Press). 10.1093/med/9780195389883.003.0032

  • CrossRef
  • Google Scholar

• 20

  GuertinP. A. (2013). Central pattern generator for locomotion: anatomical, physiological, and pathophysiological considerations. Front. Neurology3, 183. 10.3389/fneur.2012.00183

  • CrossRef
  • Google Scholar

• 21

  Harris-WarrickR. M. (2010). General principles of rhythmogenesis in central pattern generator networks. Prog. Brain Res.187, 213–222. 10.1016/B978-0-444-53613-6.00014-9

  • CrossRef
  • Google Scholar

• 22

  HoffmannH.PastorP.ParkD.-H.SchaalS. (2009). “Biologically-inspired dynamical systems for movement generation: automatic real-time goal adaptation and obstacle avoidance,” in 2009 IEEE international conference on robotics and automation, 2587–2592. 10.1109/ROBOT.2009.5152423

  • CrossRef
  • Google Scholar

• 23

  HorchlerA. D.DaltorioK. A.ChielH. J.QuinnR. D. (2015). Designing responsive pattern generators: stable heteroclinic channel cycles for modeling and control. Bioinspiration and Biomimetics10, 026001. 10.1088/1748-3190/10/2/026001

  • CrossRef
  • Google Scholar

• 24

  HuangZ.KongD.RenC.LiS.MaS. (2019). “Performance study of an underwater snake-like robot with a flexible caudal fin,” in 2019 IEEE international conference on mechatronics and automation (ICMA), 1–5. 10.1109/ICMA.2019.8816412

  • CrossRef
  • Google Scholar

• 25

  HuntA.SzczecinskiN.QuinnR. (2017). Development and training of a neural controller for hind leg walking in a dog robot. Front. Neurorobotics11, 18. 10.3389/fnbot.2017.00018

  • CrossRef
  • Google Scholar

• 26

  IjspeertA. J. (2008). Central pattern generators for locomotion control in animals and robots: a review. Neural Netw.21, 642–653. 10.1016/j.neunet.2008.03.014

  • CrossRef
  • Google Scholar

• 27

  IjspeertA. J.CrespiA.RyczkoD.CabelguenJ.-M. (2007). From swimming to walking with a salamander robot driven by a spinal cord model. Science315, 1416–1420. 10.1126/science.1138353

  • CrossRef
  • Google Scholar

• 28

  IjspeertA. J.NakanishiJ.HoffmannH.PastorP.SchaalS. (2013). Dynamical movement primitives: learning attractor models for motor behaviors. Neural Comput.25, 328–373. 10.1162/NECO_a_00393

  • CrossRef
  • Google Scholar

• 29

  JayneB. C. (2020). What defines different modes of snake locomotion?Integr. Comp. Biol.60, 156–170. 10.1093/icb/icaa017

  • CrossRef
  • Google Scholar

• 30

  KelasidiE.JesmaniM.PettersenK. Y.GravdahlJ. T. (2018). Locomotion efficiency optimization of biologically inspired snake robots. Appl. Sci.8, 80. 10.3390/app8010080

  • CrossRef
  • Google Scholar

• 31

  KelasidiE.PettersenK. Y.GravdahlJ. T.LiljebäckP. (2014). “Modeling of underwater snake robots,” in 2014 IEEE international conference on robotics and automation (ICRA), 4540–4547. 10.1109/ICRA.2014.6907522

  • CrossRef
  • Google Scholar

• 32

  KelasidiE.PettersenK. Y.GravdahlJ. T.StrømsøyenS.SørensenA. (2017). “Modeling and propulsion methods of underwater snake robots,” in 2017 IEEE conference on control technology and applications (CCTA), 819–826. 10.1109/CCTA.2017.8062561

  • CrossRef
  • Google Scholar

• 33

  KoberJ.PetersJ. (2009). “Learning motor primitives for robotics,” in 2009 IEEE international conference on robotics and automation, 2112–2118. 10.1109/ROBOT.2009.5152577

  • CrossRef
  • Google Scholar

• 34

  KongL.-H.HeW.ChenW.-S.ZhangH.WangY.-N. (2023). Dynamic movement primitives based robot skills learning. Mach. Intell. Res.20, 396–407. 10.1007/s11633-022-1346-z

  • CrossRef
  • Google Scholar

• 35

  LissmannH. W. (1950). Rectilinear locomotion in a snake (Boa occidentalis). J. Exp. Biol.26, 368–379. 10.1242/jeb.26.4.368

  • CrossRef
  • Google Scholar

• 36

  MarderE.EisenJ. S. (1984). Electrically coupled pacemaker neurons respond differently to same physiological inputs and neurotransmitters. J. Neurophysiology51, 1362–1374. 10.1152/jn.1984.51.6.1362

  • CrossRef
  • Google Scholar

• 37

  MarquesF.FloresP.ClaroJ.LankaraniH. (2016). A survey and comparison of several friction force models for dynamic analysis of multibody mechanical systems. Nonlinear Dyn.86, 1407–1443. 10.1007/s11071-016-2999-3

  • CrossRef
  • Google Scholar

• 38

  McCormackA.GodfreyK. (1998). Rule-based autotuning based on frequency domain identification. IEEE Trans. Control Syst. Technol.6, 43–61. 10.1109/87.654876

  • CrossRef
  • Google Scholar

• 39

  MorenoR.GomezJ. (2011). “Central pattern generators and hormone inspired messages: a hybrid control strategy to implement motor primitives on chain type modular reconfigurable robots,” in 2011 IEEE international conference on robotics and automation, 1014–1019. 10.1109/ICRA.2011.5980149

  • CrossRef
  • Google Scholar

• 40

  MosauerW. (1932). On the locomotion of snakes. Science76, 583–585. 10.1126/science.76.1982.583

  • CrossRef
  • Google Scholar

• 41

  Norman-TenazasR. (2021). Robust snake robot control via A spiking neuron central pattern generator. Baltimore, MD: Johns Hopkins University. Master’s thesis.

  • Google Scholar

• 42

  OstrowskiJ.BurdickJ. (1996). Gait kinematics for a serpentine robot. In , Proceedings of IEEE international conference on robotics and automation. 1294–1299. 10.1109/ROBOT.1996.506885

  • CrossRef
  • Google Scholar

• 43

  ParaschosA.DanielC.PetersJ. R.NeumannG. (2013). “Probabilistic movement primitives,” in Advances in neural information processing systems (San Diego, CA: Neural Information Processing Systems, Inc.), 26.

  • Google Scholar

• 44

  PastorP.HoffmannH.AsfourT.SchaalS. (2009). “Learning and generalization of motor skills by learning from demonstration,” in 2009 IEEE international conference on robotics and automation, 763–768. 10.1109/ROBOT.2009.5152385

  • CrossRef
  • Google Scholar

• 45

  PiñeiruaM.Godoy-DianaR.ThiriaB. (2015). Resistive thrust production can be as crucial as added mass mechanisms for inertial undulatory swimmers. Phys. Rev. E92, 021001. 10.1103/PhysRevE.92.021001

  • CrossRef
  • Google Scholar

• 46

  RabinovichM. I.HuertaR.VaronaP.AfraimovichV. S. (2006). Generation and reshaping of sequences in neural systems. Biol. Cybern.95, 519–536. 10.1007/s00422-006-0121-5

  • CrossRef
  • Google Scholar

• 47

  RiddleS.JacksonC.DaltorioK. A.QuinnR. D. (2023). “A dynamic simulation of a compliant worm robot amenable to neural control,” in Biomimetic and biohybrid systems. Editors MederF.HuntA.MargheriL.MuraA.MazzolaiB. (Cham: Springer Nature Switzerland), 338–352. 10.1007/978-3-031-38857-6_25

  • CrossRef
  • Google Scholar

• 48

  RollinsonD.ChosetH. (2013). “Gait-based compliant control for snake robots,” in 2013 IEEE international conference on robotics and automation, 5138–5143. 10.1109/ICRA.2013.6631311

  • CrossRef
  • Google Scholar

• 49

  RouseN.DaltorioK. (2024). Stable heteroclinic channel-based movement primitives: tuning trajectories using saddle parameters. Appl. Sci.14, 2523. 10.3390/app14062523

  • CrossRef
  • Google Scholar

• 50

  RouseN. A.DaltorioK. A. (2021). Visualization of stable heteroclinic channel-based movement primitives. IEEE Robotics Automation Lett.6, 2343–2348. 10.1109/LRA.2021.3061382

  • CrossRef
  • Google Scholar

• 51

  SatoM.FukayaM.IwasakiT. (2002). Serpentine locomotion with robotic snakes. IEEE Control Syst. Mag.22, 64–81. 10.1109/37.980248

  • CrossRef
  • Google Scholar

• 52

  SchaalS. (2006). “Dynamic movement primitives -A framework for motor control in humans and humanoid robotics,” in Adaptive motion of animals and machines. Editors KimuraH.TsuchiyaK.IshiguroA.WitteH. (Tokyo: Springer), 261–280. 10.1007/4-431-31381-8_23

  • CrossRef
  • Google Scholar

• 53

  ShawK. M.LyttleD. N.GillJ. P.CullinsM. J.McManusJ. M.LuH.et al (2015). The significance of dynamical architecture for adaptive responses to mechanical loads during rhythmic behavior. J. Comput. Neurosci.38, 25–51. 10.1007/s10827-014-0519-3

  • CrossRef
  • Google Scholar

• 54

  SherringtonC. S. (1910). Flexion-reflex of the limb, crossed extension-reflex, and reflex stepping and standing. J. Physiology40, 28–121. 10.1113/jphysiol.1910.sp001362

  • CrossRef
  • Google Scholar

• 55

  ShigeoH. (1994). Biologically inspired robots: snake-like locomotors and manipulators by Shigeo hirose oxford university press, oxford, 1993, 220pages, incl. Index (£40). Robotica12, 282. 10.1017/S0263574700017264

  • CrossRef
  • Google Scholar

• 56

  SimoniM. F.DeWeerthS. P. (2007). Sensory feedback in a half-center oscillator model. IEEE Trans. Biomed. Eng.54, 193–204. 10.1109/TBME.2006.886868

  • CrossRef
  • Google Scholar

• 57

  TagliabueM.CiancioA. L.BrochierT.EskiizmirlilerS.MaierM. A. (2015). Differences between kinematic synergies and muscle synergies during two-digit grasping. Front. Hum. Neurosci.9, 165. 10.3389/fnhum.2015.00165

  • CrossRef
  • Google Scholar

• 58

  TeschM.LipkinK.BrownI.HattonR.PeckA.RembiszJ.et al (2009). Parameterized and scripted gaits for modular snake robots. Adv. Robot.23, 1131–1158. 10.1163/156855309X452566

  • CrossRef
  • Google Scholar

• 59

  ThandiackalR.MeloK.PaezL.HeraultJ.KanoT.AkiyamaK.et al (2021). Emergence of robust self-organized undulatory swimming based on local hydrodynamic force sensing. Sci. Robotics6, eabf6354. 10.1126/scirobotics.abf6354

  • CrossRef
  • Google Scholar

• 60

  TraversM.GongC.ChosetH. (2015). “Shape-constrained whole-body adaptivity,” in 2015 IEEE international symposium on safety, security, and rescue robotics (SSRR), 1–6. 10.1109/SSRR.2015.7442945

  • CrossRef
  • Google Scholar

• 61

  TraversM.WhitmanJ.ChosetH. (2018). Shape-based coordination in locomotion control. Int. J. Robotics Res.37, 1253–1268. 10.1177/0278364918761569

  • CrossRef
  • Google Scholar

• 62

  TreschM. C.BizziE. (1999). Responses to spinal microstimulation in the chronically spinalized rat and their relationship to spinal systems activated by low threshold cutaneous stimulation. Exp. Brain Res.129, 0401–0416. 10.1007/s002210050908

  • CrossRef
  • Google Scholar

• 63

  WangJ.OuyangW.GaoW.RenQ. (2017a). “Locomotion control of a serpentine crawling robot inspired by central pattern generators,” in 2017 asia-pacific signal and information processing association annual summit and conference (APSIPA ASC), 414–419. 10.1109/APSIPA.2017.8282067

  • CrossRef
  • Google Scholar

• 64

  WangZ.GaoQ.ZhaoH. (2017b). CPG-inspired locomotion control for a snake robot basing on nonlinear oscillators. J. Intelligent and Robotic Syst.85, 209–227. 10.1007/s10846-016-0373-9

  • CrossRef
  • Google Scholar

• 65

  YuJ.TanM.ChenJ.ZhangJ. (2014). A survey on CPG-inspired control models and system implementation. IEEE Trans. Neural Netw. Learn. Syst.25, 441–456. 10.1109/TNNLS.2013.2280596

  • CrossRef
  • Google Scholar