Encouraging Volitional Pedaling in Functional Electrical Stimulation-Assisted Cycling Using Barrier Functions

1 Introduction

Stationary cycling assisted by functional electrical stimulation (FES) can lead to long-term benefits for people with movement impairments due to neurological conditions such as stroke, spinal cord injury, traumatic brain injury, cerebral palsy, multiple sclerosis, and others Johnston et al. (2008); Ferrante et al. (2008); Hooker et al. (1992); Janssen et al. (2008); Trevisi et al. (2012). Individuals with neurological conditions can exhibit varying degrees of muscle control. For people with little to no volitional control, the FES cycling therapy must be supported by an electric motor, which provides additional torque about the pedal crank to maintain a beneficial cadence, as in studies such as Cousin et al. (2020); Hooker et al. (1992); Bellman et al. (2017); Duenas et al. (2020); Trevisi et al. (2012). When possible, electric motor support should be minimized in lieu of torque produced by the rider’s muscles via either FES or their own volition, which leads to higher intensity training by increasing the rider’s heart rate and oxygen uptake Hooker et al. (1992). Higher intensity training is a key factor in attaining long-term outcomes like increased muscular strength, cardiovascular endurance, bone mineral density, and caloric consumption Ouellette et al. (2004); MacKay-Lyons and Makrides (2002); Mohr et al. (1997). In the rehabilitation literature outside of cycling, various assist-as-needed approaches such as Asl et al. (2020); Dao and Yamamoto (2018); Pehlivan et al. (2015); Ding et al. (2014) encourage volitional contributions from the user. Relatively few works have investigated FES- and motor-assisted cycling programs where the primary objective is to encourage volitional contributions Harrington et al. (2012); Rouse et al. (2020); Johnston and Wainwright (2011). The objective of this work is to design controllers for both the electric motor and FES stimulation that facilitate volitional cycling by minimizing machine assistance while ensuring that the rider’s cadence is constrained to a user-defined range.

The kinematics of the rider’s legs during stationary cycling are such that applying FES to their muscles produces non-negligible torque only in certain regions of the crank cycle. To maximize torque production, stimulation patterns often feature discontinuous jumps triggered as a function of the crank angle by discrete logic variables. The interaction of the resulting continuous-time and discrete dynamics results in a hybrid control system. Barrier functions, or control barrier functions (CBF), can be used to design controllers for hybrid systems that ensure safety by rendering sets of states either forward invariant or asymptotically stable Ames et al. (2019); Maghenem and Sanfelice (2021); Glotfelter et al. (2017). This technique builds on ideas from the theory of control Lyapunov functions (CLF). CLFs are used to enforce particular constraints on the control input that result in a decrease in a Lyapunov function for states outside of the safe set Freeman and Kokotovic (1996); Sanfelice (2013). However, CLF-based approaches have typically not provided constructive methods for designing the control input at states in the safe set. Recent developments regarding CBFs have filled this gap by providing a systematic approach for extending the input constraints onto the safe set in a way that reduces the control effort on the interior of the set Ames et al. (2016). A popular approach for implementing CLF- or CBF-induced input constraints is with pointwise optimal control laws which, for certain classes of dynamics, take the form of quadratic programs (QP). Compared to past assist-as-needed control schemes, which have used methods such as deadzone functions Asl et al. (2020) or impedance control Ding et al. (2014), barrier functions can constrain the state within a broader class of safe sets. Moreover, the cost function in the accompanying pointwise optimal control law is customizable, leading to a range of possible controllers. Our preliminary work in Isaly et al. (2020) integrated zeroing CBFs with robust control tools from Lyapunov theory to synthesize a QP for an uncertain, continuous-time, motor-only cycling system. The controller in Isaly et al. (2020) constrains the rider’s cadence within a user-defined range while encouraging volitional pedaling by using minimal motor control effort. However, the more complex case where the rider is also stimulated by FES was not considered.

In this work, we extend the development of Isaly et al. (2020) to account for the hybrid dynamics introduced by adding FES stimulation. The resulting controller applies assistance based on the rider’s performance. FES assistance is only applied when the cadence cannot be maintained at a target value through volitional effort alone. Similarly, assistance from the electric motor is applied only when the combined FES and volitional efforts are insufficient. The controller accommodates a broad range of functional impairments and volitional ability by featuring customizable parameters, including nominal control inputs and tunable width of the safe range. Moreover, the rider’s safety is assured because the electric motor constrains the rider’s cadence to a uniformly globally asymptotically stable set through a continuous feedback controller. The continuity of the motor control law is an improvement upon the breakthrough strategy in Rouse et al. (2020) for encouraging volitional pedaling. In that work, no control effort was applied within a user-defined region, while the electric motor and FES were turned on discontinuously at the boundary of the region. Outside the region, assistive control effort switched discretely between FES and electric motor assistance to ensure that the electric motor did not prevent FES from inducing power output by the rider. In contrast, we decouple the motor and FES controllers and use more sophisticated design tools to develop a motor control law that is a continuous function of the cadence tracking error. The result is more comfortable training for the rider, while the staggered application of FES before motor effort still allows power output from the rider to be prioritized.

Experimental trials were performed on five able-bodied participants to demonstrate the effectiveness and versatility of the developed control system. The barrier function controller was shown to effectively constrain the cadence to a range of 50 ± 5 RPM for all but a negligible amount of time, and to outperform the controller in Rouse et al. (2020) and uncontrolled volitional pedaling for a protocol where minimal cadence variation was prioritized. The barrier function controller had a lower cadence standard deviation (Avg. 1.4 RPM) and constrained the cadence to a smaller range relative to the comparison cases, but generally produced more assistive torque from the motor than the controller in Rouse et al. (2020). To show how motor assistance can be reduced to prioritize power output from the rider, an alternative protocol was designed where the customizable parameters were configured with a wider safe range and a nominal amount of resistance from the motor. In the alternative trial, the motor was producing assistive torque for only 4.1% of the entire trial duration.

2 Dynamic Model

2.1 Hybrid Systems

The development in this work is based on the hybrid systems framework described in Goebel et al. (2012). A hybrid system $\mathcal{H}=\left(C,F,D,G\right)$ with state $x\in \mathcal{X}\subset {\mathbb{R}}^n$ is modeled by

$\mathcal{H}:\left\{\begin{array}{cc}\dot{x}\in F\left(x\right)\hfill & x\in C\hfill \\ x^{+}\in G\left(x\right)\hfill & x\in D.\hfill \end{array}\right.(1)$

When the state is in the flow set $C\subset {\mathbb{R}}^n$, it is allowed to evolve continuously according to the set-valued flow map $F:{\mathbb{R}}^n\rightrightarrows {\mathbb{R}}^n$. When the state is in the jump set $D\subset {\mathbb{R}}^n$, it is allowed to change discretely according to the jump map $G:{\mathbb{R}}^n\rightrightarrows {\mathbb{R}}^n$. When x ∈ C ∩ D, either behavior is possible. The notion of a solution to $\mathcal{H}$ is defined precisely in Goebel et al. (2012), Def. 2.6. Briefly, a solution to $\mathcal{H}$ is a function $\left(t,j\right)\mapsto \varphi \left(t,j\right)$ defined on a hybrid time domain $\text{dom}\varphi \subset {\mathbb{R}}_{\ge 0}\times \mathbb{N}$ and is parameterized by the ordinary time variable $t\in {\mathbb{R}}_{\ge 0}$ and the discrete jump variable $j\in \mathbb{N}$. The set-valued mappings F and G map points in ${\mathbb{R}}^n$ to subsets of ${\mathbb{R}}^n$ so that, for example, the inclusion $x^{+}\in G\left(x\right)$ represents the fact that if a trajectory jumps from the state $\varphi \left(t,j\right)$, then its state $\varphi \left(t,j+1\right)$ at the next discrete time instant is a point in the set $G\left(\varphi \left(t,j\right)\right)$.

Remark 1. Previous results (cf. Rouse et al. (2020); Bellman et al. (2017); Rouse et al. (2021)) have analyzed the dynamic model in the subsequent section using switched-systems tools. The decision to use a hybrid model here was motivated by the fact that forward invariance via barrier functions is not well characterized for switched systems, nor are many results available regarding the stability of noncompact sets. Hybrid systems can model broad classes of switched systems Goebel et al. (2012, Section 2.4).

2.2 Open-Loop Dynamics

Analogous to Eq. 1, one can also consider hybrid systems with inputs Sanfelice (2013). We use such a system to describe the control design but present our stability analysis in terms of a closed-loop system with the form in Eq. 1. The open-loop cycle-rider system is modeled as a continuous-time system ${\mathcal{H}}_u=\left(C_u,F_u\right)$. Subsequently, discrete dynamics will be introduced due to the design of the controller. Adapting the model from our previous work in Bellman et al. (2017) and Isaly et al. (2020), the cycle’s Euler-Lagrange dynamics are modeled using the flow map

$\dot{z}\in \left[\begin{array}{c}\hfill z_2\hfill \\ \hfill M^{-1}\left(z_1\right)\left[{\tau }_u\left(z,u\right)-{\tau }_F\left(z\right)\right]\hfill \end{array}\right]\triangleq F_u\left(z,u\right),(2)$

and flow set $C_u\triangleq {\mathbb{R}}^2\times \mathcal{U}$. In (2), the state is $z\in {\mathbb{R}}^2$, where z₁ denotes the cycle’s measurable crank angle, and z₂ is the calculable angular velocity (equivalently, the rider’s cadence). The system has control inputs¹ $u\triangleq \left(u_e,u_M\right)$, where $u_e\in \mathbb{R}$ is the current input to the cycle’s electric motor, and $u_M\in {\mathbb{R}}^6$ is a vector of the electrical stimulation intensity inputs $u_m\in \mathbb{R}$, for each muscle $m\in \mathcal{M}\triangleq \left\{LQ,LG,LH,RQ,RG,RH\right\}$. The elements of $\mathcal{M}$ indicate the quadriceps femoris (Q), gluteal (G), and hamstring (H) muscle groups for the left and right legs, respectively. The control inputs take values in the set $\mathcal{U}\triangleq \mathbb{R}\times {\mathcal{U}}_M$, where ${\mathcal{U}}_M\triangleq {\left[0,\bar{u}\right]}^6\subset {\mathbb{R}}^6$ indicates that the muscle control inputs are bounded by the constant $\bar{u}>0$ for the rider’s safety and comfort. The continuously differentiable function $M:\mathbb{R}\to {\mathbb{R}}_{>0}$ denotes the inertial forces from the cycle and rider’s legs. The set-valued mapping ${\tau }_F:{\mathbb{R}}^2\rightrightarrows \mathbb{R}$ defines the dynamics of the system as

${\tau }_F\left(z\right)\triangleq {\tau }_b\left(z_2\right)+V_p\left(z\right)z_2+G\left(z_1\right)+P\left(z\right)+{\mathcal{T}}_d+{\mathcal{T}}_{vol},(3)$

where ${\tau }_b:\mathbb{R}\to \mathbb{R}$ denotes the unknown torque due to viscous damping in the cycle, and $V_p:{\mathbb{R}}^2\to \mathbb{R}$, $G:\mathbb{R}\to \mathbb{R}$, and $P:{\mathbb{R}}^2\to \mathbb{R}$ are the unknown centripetal-Coriolis, gravitational, and passive viscoelastic tissue forces, respectively, applied by the combined human-cycle system. The aforementioned functions are continuous according to the dynamic models in Bellman et al. (2017) and Idsø (2002). According to the model in Bellman et al. (2017), the centripetal-Coriolis term is related to the mass and cadence by $V_p\left(z\right)=\frac{1}{2}\nabla M\left(z_1\right)z_2$. In Eq. 3, ${\mathcal{T}}_{vol}\subset \mathbb{R}$ and ${\mathcal{T}}_d\subset \mathbb{R}$ are sets used to model all of the possible values of the rider’s volitional effort and other unknown disturbances, respectively². The continuous function ${\tau }_u:{\mathbb{R}}^2\times \mathcal{U}\to \mathbb{R}$ describes the torque produced by the control inputs and is defined as

${\tau }_u\left(z,u\right)\triangleq c_e{u}_e+{\tau }_{FES}\left(z,u_M\right),$

where c_e > 0 is the known electric motor control constant relating input current to output torque. The torque generated from FES inputs to the rider’s muscles ${\tau }_{FES}:{\mathbb{R}}^2\times {\mathcal{U}}_M\to \mathbb{R}$ is given by

${\tau }_{FES}\left(z,u_M\right)\triangleq \sum _{m\in \mathcal{M}}{g}_m\left(z\right)u_m,(4)$

where the continuous functions $g_m:{\mathbb{R}}^2\to \mathbb{R}$ denote the uncertain control effectiveness of each muscle. For each $m\in \mathcal{M}$, let the closed set ${\mathcal{Q}}_m\subset \mathbb{R}$ denote the portion of the crank cycle when a particular muscle m is stimulated, which is selected based on a minimum threshold for the torque transfer ratio of each muscle group. In particular, there exist kinematic deadzones in the crank cycle where no muscle is able to produce useful torque Cousin et al. (2020).

The following properties of the cycle-rider system in Eq. 2 are derived from a detailed dynamic model, as discussed in Bellman et al. (2017).

Property 1. The inertial term is upper- and lower-bounded as ${\underline{c}}_I\le M\left(z_1\right)\le {\bar{c}}_I$ for all $z_1\in \mathbb{R}$, where ${\underline{c}}_I,{\bar{c}}_I>0$ are known constants.

Property 2. The centripetal-Coriolis parameter is upper-bounded as $\left|V_p\left(z\right)\right|\le c_V\left|z_2\right|$ for all $z\in {\mathbb{R}}^2$, where c_V > 0 is a known constant.

Property 3. The torque generated by gravity is upper-bounded as $\left|G\left(z_1\right)\right|\le c_G$ for all $z_1\in \mathbb{R}$, where c_G > 0 is a known constant.

Property 4. The torque generated by the rider’s viscoelastic tissues is upper-bounded as $\left|P\left(z\right)\right|\le c_{P1}+c_{P2}\left|z_2\right|$ for all $z\in {\mathbb{R}}^2$, where c_P1, c_P2 > 0 are known constants.

Property 5. The torque due to viscous damping is upper-bounded as $\left|{\tau }_b\left(z_2\right)\right|\le c_b\left|z_2\right|$ for all $z_2\in \mathbb{R}$, where c_b > 0 is a known constant.

Property 6. The torques generated by system disturbances are bounded so that ${\mathcal{T}}_d=\left[-c_d,c_d\right]$, where c_d > 0 is a known constant.

Property 7. Due to physical limitations of the rider, the volitional muscle torque is bounded so that ${\mathcal{T}}_{vol}=\left[-c_{vol},c_{vol}\right]$, where c_vol > 0 is a known constant.

Property 8. For each $m\in \mathcal{M}$, the muscle control effectiveness is upper-bounded so that $\left|g_m\left(z\right)\right|\le {\bar{c}}_m$ for all $z\in {\mathbb{R}}^2$, where ${\bar{c}}_m>0$ is a known constant.

Property 9. The set-valued mapping $F_u:{\mathbb{R}}^2\times \mathcal{U}\rightrightarrows {\mathbb{R}}^2$ is outer semicontinuous, locally bounded, and convex-valued. These properties follow from continuity of the defining functions and from Properties 6 and 7.

3 Control Design

Figure 1 shows a schematic of the staggered control regions for the developed system. The volitional range is a region near the setpoint z_2d where the control inputs are zero, thereby forcing the rider to pedal on their own volition (optionally, a nominal amount of assistance or resistance can be provided based on the needs of the rider). When the cadence is slower than z_2d, FES assistance is provided before assistance from the electric motor. When the cadence is faster than the setpoint, only the electric motor is used because creating resistive torque with FES by stimulating antagonistic muscles is undesirable. The rider or clinician can modify the amount of control effort provided and the size of the controlled regions using parameters adjusted for the specific individual.

FIGURE 1

FIGURE 1. Illustration of the regions of applied control effort as a function of cadence. No control effort is applied in the volitional range near the setpoint z_2d. The electric motor control input increases when the cadence approaches the boundaries defined by e_H and e_L, and the FES control signal does the same near e_FES. The size of each region is adjustable. The cadence range between e_H and e_L is rendered asymptotically stable by the developed control system.

3.1 Control Objective

To formalize the control objective, we define the tracking error e as the deviation of the cadence state z₂ from a constant setpoint z_2d > 0,³

$e\triangleq z_2-z_{2d}.(5)$

The primary control objective is to guarantee a safe and effective therapy by constraining the rider’s cadence to the safe set $\mathcal{S}\triangleq \{z\in {\mathbb{R}}^2:e_L\le e\le e_H\}$, where e_L < 0 < e_H are user-defined constants. The FES control inputs attempt to constrain the rider’s cadence to the secondary set ${\mathcal{S}}_{FES}\triangleq \{z\in {\mathbb{R}}^2:e\ge e_{FES}\}$. Because the FES inputs are only intermittently available and must be less than the comfort threshold $\bar{u}$, the cadence may not remain within ${\mathcal{S}}_{FES}$. However, this construction is useful for design purposes. To ensure that FES stimulation is active before torque is added by the electric motor, the design specifies that e_L < e_FES < 0.

The goal is to synthesize, in a systematic way, controllers that render a given set of states uniformly globally asymptotically stable (UGAS) while using the minimum required effort inside the set of interest.⁴ Combining ideas from CLF theory with recent developments regarding CBFs, this task is accomplished by using a QP to enforce a constraint on the control input that is induced by a candidate barrier function. The following lemma, presented in a more generic form than in our preliminary work in Isaly et al. (2020), gives conditions under which a QP-based control law with a single constraint is feasible and locally Lipschitz continuous. The closed-form solution of the QP in the absence of a nominal controller (but including the case of multiple control inputs) has also been presented in Freeman and Kokotovic (1996, Section 4.2.2) and was developed in detail in Xu et al. (2015), Thm. 8. In those works, the feasibility condition was guaranteed by assuming the existence of a CLF or CBF, respectively. Because the addition of a nominal controller is a minor extension of the available literature, we do not present a proof of the result. Lemma 1 applies to the control laws developed in the subsequent sections.

Lemma 1. Let the functions $a:{\mathbb{R}}^n\to \mathbb{R}$, $b:{\mathbb{R}}^n\to \mathbb{R}$, and $u_{nom}:{\mathbb{R}}^n\to \mathbb{R}$ be locally Lipschitz on ${\mathbb{R}}^n$ and satisfy the following feasibility condition:

$a\left(z\right)=0\Rightarrow b\left(z\right)<0.(6)$

Then the set-valued mapping $\bar{\mathcal{U}}:{\mathbb{R}}^n\rightrightarrows \mathbb{R}$ defined by $\bar{\mathcal{U}}\left(z\right)\triangleq \left\{u\in \mathbb{R}:a\left(z\right)u+b\left(z\right)\le 0\right\}$ is non-empty for all $z\in {\mathbb{R}}^n$ and the controller

$\begin{array}{ll}\hfill u^{\ast }\left(z\right)\triangleq \underset{u\in \mathbb{R}}{\text{arg\hspace{0.17em}min}}& {\left|u-u_{nom}\left(z\right)\right|}^2\hfill \\ \hfill s.t.& a\left(z\right)u+b\left(z\right)\le 0\hfill \end{array}(7)$

is locally Lipschitz on ${\mathbb{R}}^n$, and, for any point z^∗ such that $a\left(z^{\ast }\right)=0$, there exists a neighborhood $\mathcal{N}\left(z^{\ast }\right)$ such that $u^{*}\left(z\right)=u_{nom}\left(z\right)$ for all $z\in \mathcal{N}\left(z^{*}\right)$. Furthermore, the controller in Eq. 7 has a closed-form solution given by

$u^{\ast }\left(z\right)=\left\{\begin{array}{cc}-\frac{b\left(z\right)}{a\left(z\right)}\hfill & a\left(z\right)u_{nom}\left(z\right)+b\left(z\right)>0\hfill \\ u_{nom}\left(z\right)\hfill & otherwise.\hfill \end{array}\right.(8)$

Note that there is no division by zero in Eq. 8 since Eq. 6 implies that $u^{*}\left(z\right)=u_{nom}\left(z\right)$ when $a\left(z\right)=0$. Also note that the claim regarding the neighborhood about points for which $a\left(z^{*}\right)=0$ does not hold in general if the inequality in Eq. 6 is changed to $b\left(z\right)\le 0$.

3.2 Motor Control Design

In this section, the electric motor control input is designed to ensure that the safe set $\mathcal{S}=\{z\in {\mathbb{R}}^2:e_L\le e\le e_H\}$ is UGAS for a given z_2d > 0. Our development is based on the design procedure described in Isaly et al. (2020) and the theoretical results for hybrid systems in Maghenem and Sanfelice (2021) and Goebel et al. (2012), where Maghenem and Sanfelice (2021) considers barrier functions specifically. The safe set $\mathcal{S}$ is encoded by the barrier function candidate $B_e:{\mathbb{R}}^2\to \mathbb{R}$ defined as

$B_e\left(z\right)\triangleq \frac{1}{2}M\left(z_1\right)\left(\frac{e^2}{\beta \left(e\right)}-1\right)(9)$

where

$\beta \left(e\right)\triangleq \left\{\begin{array}{cc}{e}_L^2\hfill & e\le 0\hfill \\ e_H^2\hfill & e>0.\hfill \end{array}\right.$

Equivalent to the original definition, we have $\mathcal{S}=\{z\in {\mathbb{R}}^2:B_e\left(z\right)\le 0\}$. The barrier function is designed to be continuously differentiable while encoding the potentially asymmetric (about e = 0) boundary of the set $\mathcal{S}$.

While barrier functions are typically associated with forward invariance, they are naturally extensible to enforcing the stronger property of asymptotic stability. Asymptotic stability is beneficial for real-world applications since it guarantees robustness to perturbations from the safe set. For continuous-time systems, the stronger asymptotic stability condition is embodied in the definition of a zeroing CBF (ZCBF) Xu et al. (2015). Inspired by the ZCBF approach in our preliminary work in Isaly et al. (2020) and the work regarding CLFs for hybrid systems in Sanfelice (2013), we constrain the control input according to the so-called regulation map $\tilde{\mathcal{U}}:{\mathbb{R}}^2\rightrightarrows \mathcal{U}$ defined as

$\tilde{\mathcal{U}}\left(z\right)\triangleq \left\{u\in \mathcal{U}:⟨\nabla B_e\left(z\right),f⟩\le -{\gamma }_e\left(e\right),\forall f\in F_u\left(z,u\right)\right\},(10)$

where

${\gamma }_e\left(e\right)\triangleq k_{b1}\left(\frac{e^2}{\beta \left(e\right)}-1\right),(11)$

and k_b1 > 0 is a control gain. In the stability analysis of Section 4, we show that selecting a continuous controller from $\tilde{\mathcal{U}}$ ensures that B_e acts as a Lyapunov function for the closed-loop dynamics outside the set $\mathcal{S}$. In particular, the condition in Eq. 10 will be used to apply Proposition 3.27 of Goebel et al. (2012) to conclude that $\mathcal{S}$, redefined to include some additional states, is UGAS.

Remark 2. The definition of a ZCBF requires that ${\gamma }_e\left(z\right)\triangleq \alpha \left(B_e\left(z\right)\right)$ for an extended class $\mathcal{K}$ function a Xu et al. (2015). However, requiring dependence of γ_e on the barrier function candidate can be restrictive, and is not necessary to obtain theoretical guarantees. Because the value of the function M in B_e is unknown and cannot be implemented in a control law, we use γ_e instead of the typical ZCBF-based selection when defining $\tilde{\mathcal{U}}$ in Eq. 10. For both ZCBFs and the choice of γ_e in Eq. 11, the mapping in Eq. 10 enforces asymptotically stabilizing conditions on the barrier function at states outside the safe set.

The regulation map in Eq. 10 is not directly useful for design purposes because uncertainty in the dynamics prevents computation of the inequality (i.e., constraint) used to define $\tilde{\mathcal{U}}$. In the rest of this section, we develop a new regulation map based on a computable constraint that is implementable in a QP like Eq. 7. The resulting QP-based controller is a locally Lipschitz selection of $\tilde{\mathcal{U}}$. To compensate for the uncertainty introduced in Eq. 10 by F_u, we employ Lyapunov-based robust control techniques to develop a worst-case upper bound of the inner product in Eq. 10. For any $\left(z,u\right)\in C_u$ and $f\in F_u\left(z,u\right)$,

$\begin{array}{ll}\hfill ⟨\nabla B_e\left(z\right),f⟩& \in \frac{1}{2}\nabla M\left(z_1\right)z_2\left(\frac{e^2}{\beta \left(e\right)}-1\right)\hfill \\ \hfill & +\frac{1}{\beta \left(e\right)}e\left({\tau }_u\left(z,u\right)-{\tau }_F\left(z\right)\right).\hfill \end{array}(12)$

The product $\frac{1}{\beta \left(e\right)}e{\tau }_F\left(z\right)$ contains the term $\frac{1}{\beta \left(e\right)}e{V}_p\left(z\right)z_2=\frac{1}{\beta \left(e\right)}e\left(V_p\left(z\right)e+V_p\left(z\right)z_{2d}\right)$, leading to a cancellation with the term $\frac{1}{2}\nabla M\left(z_1\right)z_2\left(\frac{e^2}{\beta \left(e\right)}\right)$ since $\frac{1}{2}\nabla M\left(z_1\right)z_2=V_p\left(z\right)$. Using Properties 2-7, it can then be shown that the unknown terms in Eq. 12 are upper bounded, for some constants c₁ − c₃, as

$⟨\nabla B_e\left(z\right),f⟩\le {\mathcal{C}}_e\left(e\right)+\frac{1}{\beta \left(e\right)}e{\tau }_u\left(z,u\right),(13)$

for each $\left(z,u\right)\in C_u$ and each $f\in F_u\left(z,u\right)$, where

${\mathcal{C}}_e\left(e\right)\triangleq c_1+c_2\left|e\right|+c_3{e}^2.$

In Eq. 13, the function τ_u depends on the motor control input u_e and the muscle control inputs u_M. Because the value of the subsequently designed muscle control input will jump at discrete instances, it is desirable to decouple the motor input from the muscle input to ensure the continuity of the motor controller. A continuous motor controller will be more predictable and comfortable for the rider. Using Property 8, there exists a constant c_M > 0 such that

$\begin{array}{ll}\hfill \frac{1}{\beta \left(e\right)}e{\tau }_u\left(z,u\right)=\frac{1}{\beta \left(e\right)}e& \left(c_e{u}_e+{\tau }_{FES}\left(z,u_M\right)\right)\hfill \\ \hfill & \le \frac{c_e}{\beta \left(e\right)}e{u}_e+c_M\left|e\right|,\hfill \end{array}(14)$

for all $z\in {\mathbb{R}}^2$, $u_e\in \mathbb{R}$, and $u_M\in {\mathcal{U}}_M$. Using the definition of ${\mathcal{U}}_M$ in Section 2, Eq. 14 applies to any muscle controller for which the inputs are bounded by the positive constant $\bar{u}$. One can then define

$K_e\left(e\right)\triangleq k_1+k_2\left|e\right|+k_3{e}^2.(15)$

Selecting⁵

$k_1\ge c_1,k_2\ge c_2+c_M,k_3\ge c_3,(16)$

implies that

${\mathcal{C}}_e\left(e\right)+\frac{1}{\beta \left(e\right)}e{\tau }_u\left(z,u\right)\le K_e\left(e\right)+\frac{c_e}{\beta \left(e\right)}e{u}_e(17)$

for all $z\in {\mathbb{R}}^2$, $u_e\in \mathbb{R}$, and $u_M\in {\mathcal{U}}_M$. Since Eq. 17 is an upper bound for Eq. 13, we define a new regulation map ${\bar{\mathcal{U}}}_e:\mathbb{R}\rightrightarrows \mathbb{R}$ as

${\bar{\mathcal{U}}}_e\left(e\right)\triangleq \left\{u_e\in \mathbb{R}:K_e\left(e\right)+\frac{c_e}{\beta \left(e\right)}e{u}_e\le -{\gamma }_e\left(e\right)\right\}.(18)$

The following result summarizes the preceding development and explains the utility of ${\bar{\mathcal{U}}}_e$.

Proposition 1. Assume k₁, k₂, and k₃ satisfy the gain conditions in Eq. 16 and z_2d > 0. Then, for any $z\in {\mathbb{R}}^2$ and $u_M\in {\mathcal{U}}_M$, if $u_e\in {\bar{\mathcal{U}}}_e\left(e\right)$, it follows that $\left(u_e,u_M\right)\in \tilde{\mathcal{U}}\left(z\right)$.

The constraint used to define ${\bar{\mathcal{U}}}_e$ in Eq. 18 can be written in the generic form of Lemma 1. Additionally, since the terms in Eq. 18 are no longer uncertain, the constraint can be enforced with the following implementable QP:

$\begin{array}{ll}\hfill u_e^{\ast }\left(e\right)& \triangleq \underset{u_e\in \mathbb{R}}{\mathrm{arg\; min}}{\left|u_e-u_e^{nom}\left(e\right)\right|}^2\hfill \\ \hfill & s.t.K_e\left(e\right)+\frac{c_e}{\beta \left(e\right)}e{u}_e\le -{\gamma }_e\left(e\right),\hfill \end{array}(19)$

where $u_e^{nom}:\mathbb{R}\to \mathbb{R}$ is any locally Lipschitz nominal controller. According to Lemma 1, with $b\left(z\right)=K_e\left(e\right)+{\gamma }_e\left(e\right)$, the controller is feasible if e = 0 implies that

$K_e\left(0\right)+{\gamma }_e\left(0\right)=k_1-k_{b1}<0.(20)$

Since the parameters in Eq. 20 are user-selected, they can be designed to ensure the inequality holds. Given this gain condition, the controller has the properties described in Lemma 1, in particular, it is continuous. The closed-form solution to Eq. 19 can be developed from Eq. 8. The controller is implementable in either form but the closed-form solution is computationally faster and does not require an optimization package. Note that the piecewise linear function $e\mapsto \left(c_e/\beta \left(e\right)\right)e$ is locally Lipschitz, from which we derive local Lipschitz continuity of the controller.

Remark 3. During the experiments in Section 5, we investigated constant nominal controllers $u_e^{nom}\triangleq u_0$ for some $u_0\in \mathbb{R}$. When u₀ = 0, the controller is a minimum norm controller and the motor is off whenever possible while still ensuring safety. When the rider requires additional assistance, selecting a positive u₀ leads to the motor being biased to assist, while a negative u₀ leads to additional resistance and a more challenging training program. However, there is no theoretical obstacle to using a more complex nominal controller (e.g., one that tracks power).

3.3 Functional Electrical Stimulation Design

To describe the FES control input, we define a concatenated state vector $x\triangleq \left(z,{\sigma }_M,\tau \right)\in \mathcal{X}$, where ${\sigma }_M\in {\left\{\mathrm{0,1}\right\}}^6$ is a vector of switching signals ${\sigma }_m\in \left\{\mathrm{0,1}\right\}$ defined for each muscle $m\in \mathcal{M}$, $\tau \in \mathbb{R}$ is a timer variable, and $\mathcal{X}\triangleq {\mathbb{R}}^2\times {\left\{\mathrm{0,1}\right\}}^6\times \mathbb{R}$ is the state space. The stimulation input to the rider’s muscle groups $u_M^{\ast }:\mathcal{X}\to {\mathbb{R}}^6$ is defined for each muscle as⁶

$u_m^{\ast }\left(x\right)\triangleq {\text{sat}}_{\bar{u}}^{+}\left({\sigma }_m{u}_{FES}^{\ast }\left(e\right)\right),(21)$

where $u_{FES}^{\ast }:\mathbb{R}\to \mathbb{R}$ will be defined subsequently. The switching signals are updated at jumps according to the rule

${\sigma }_m^{+}=\left\{\begin{array}{cc}1\hfill & z_1\in {\mathcal{Q}}_m\hfill \\ 0\hfill & z_1\notin {\mathcal{Q}}_m,\hfill \end{array}\right.(22)$

where ${\mathcal{Q}}_m$ was defined in Section 2. The update rule specifies that the rider’s muscles are stimulated in regions where they are able to produce positive torque. The rule for σ_m and the timer variable τ will be used to define a hybrid system in Section 4.

As discussed in Section 3.1, it is generally not possible to maintain the cadence in the set ${\mathcal{S}}_{FES}=\{z\in {\mathbb{R}}^2:e\ge e_{FES}\}$ because the stimulation input $u_m^{\ast }$ is limited in magnitude and only intermittently available. The function $u_{FES}^{\ast }$ in Eq. 21 represents a selection of the input that would render the set ${\mathcal{S}}_{FES}$ asymptotically stable in the absence of these obstacles (and subject to some gain conditions). The development of $u_{FES}^{\ast }$ is very similar to the one in Section 3.2 and is therefore omitted to avoid redundancy. Moreover, we do not make claims in the forthcoming stability analysis regarding ${\mathcal{S}}_{FES}$. The FES input is defined by the following QP:

$\begin{array}{ll}\hfill u_{FES}^{\ast }\left(e\right)& \triangleq \underset{u_{FES}\in \mathbb{R}}{\mathrm{arg\; min}}\left|u_{FES}-u_{FES}^{nom}\left(e\right)\right|\hfill \\ \hfill & s.t.K_{FES}\left(e\right)+\frac{1}{{\beta }_2\left(e\right)}e{u}_{FES}\le -{\gamma }_{FES}\left(e\right).\hfill \end{array}(23)$

where $u_{FES}^{nom}:\mathbb{R}\to \mathbb{R}$ is any locally Lipschitz nominal controller,

$K_{FES}\left(e\right)\triangleq k_4+k_5\left|e\right|+k_6{e}^2,$

${\gamma }_{FES}\left(e\right)\triangleq k_{b2}\left(\frac{e^2}{{\beta }_2\left(e\right)}-1\right),$

and

${\beta }_2\left(e\right)\triangleq \left\{\begin{array}{cc}{e}_{FES}^2\hfill & e\le 0\hfill \\ e_H^2\hfill & e>0.\hfill \end{array}\right.$

When e = 0, the feasibility condition (6) in Lemma 1 requires that

$K_{FES}\left(0\right)+{\gamma }_{FES}\left(0\right)=k_4-k_{b2}<0,(24)$

under which the function $u_{FES}^{\ast }$ has the properties described in the lemma. Similar to the previous section, the parameters in Eq. 24 are user-selected and can be designed to ensure the inequality holds.

When the nominal controller in Eq. 23 is set to $u_{FES}^{nom}\triangleq 0$, then from the closed-form solution in Eq. 8 it can be determined that $u_{FES}^{\ast }\left(e\right)\le 0$ for all e ≥ 0. In this case, because of the use of the saturation function in Eq. 21, it follows that $u_m^{*}\left(x\right)=0$ for all $x\in \mathcal{X}$ such that e ≥ 0. The inclusion of a nominal controller in the QP defining $u_{FES}^{*}$ gives the operator flexibility to provide stimulation at points where e ≥ 0. When using a nominal controller with $u_{FES}^{nom}\left(e\right)>0$ for e ≥ 0, FES stimulation produces torque to increase the cadence above the setpoint z_2d. However, it is always the case that $u_{FES}^{*}\left(e\right)\to 0$ as e → e_H. By combining nominal assistance from FES with nominal resistance from the electric motor, a more intense training program can be designed where the rider must work against resistive torque from the electric motor to stay near the setpoint. We provide experimental results for a higher intensity configuration of the control system in Section 5.

4 Stability Analysis

We model the closed-loop system as a hybrid system $\mathcal{H}=\left(C,F,D,G\right)$ with state $x=\left(z,{\sigma }_M,\tau \right)\in \mathcal{X}$, where the state space $\mathcal{X}$ was defined in Section 3.3. The hybrid system will periodically update the muscle switching signals σ_m according to the rule in Eq. 22. The timer variable τ increases at a constant rate until reaching a dwell-time τ_D > 0, at which point a jump occurs and each signal in σ_M is updated. Governing jumps by a dwell-time prevents multiple jumps from occurring in the same time instant, and models a computational implementation of the switching signals, where the values of the logic variables would be updated periodically at a fixed sampling frequency. In practice, the dwell-time τ_D will be the sampling frequency.

The hybrid system $\mathcal{H}$ is defined as follows. The flow map $F:\mathcal{X}\rightrightarrows \mathcal{X}$ is

$\left[\begin{array}{c}\hfill \dot{z}\hfill \\ \hfill {\dot{\sigma }}_M\hfill \\ \hfill \dot{\tau }\hfill \end{array}\right]\in \left[\begin{array}{c}\hfill F_u\left(z,u^{\ast }\left(x\right)\right)\hfill \\ \hfill 0\hfill \\ \hfill 1\hfill \end{array}\right]\triangleq F\left(x\right),$

where $u^{\ast }\left(x\right)\triangleq \left(u_e^{\ast }\left(e\right),u_M^{\ast }\left(x\right)\right)$ and F_u is defined in Eq. 2. The flow set is

$C\triangleq \left\{x\in \mathcal{X}:\tau \in \left[0,{\tau }_D\right]\right\}.$

Jumps occur when the timer state τ grows to τ_D,

$D\triangleq \left\{x\in \mathcal{X}:\tau ={\tau }_D\right\}.$

The jump map $G:\mathcal{X}\rightrightarrows \mathcal{X}$ is defined component-wise as $G\left(x\right)\triangleq \left(z,G_{\sigma }\left(x\right),0\right)$, where the state z does not change at jumps (z⁺ = z), the timer τ resets to zero at jumps (τ⁺ = 0), and $G_{\sigma }:\mathcal{X}\rightrightarrows {\left\{\mathrm{0,1}\right\}}^6$ is the outer semicontinuous Krasovskii regularization of the map in Eq. 22 Goebel et al. (2012), Def. 4.13. For each $m\in \mathcal{M}$, the corresponding component of G_σ is equal to

$G_{{\sigma }_m}\left(x\right)=\left\{\begin{array}{cc}1\hfill & z_1\in {\mathcal{Q}}_m\hfill \\ \left\{\mathrm{0,1}\right\}\hfill & z_1\in \partial {\mathcal{Q}}_m\hfill \\ 0\hfill & \text{otherwise.}\hfill \end{array}\right.(25)$

The set-valued case in Eq. 25 indicates that if τ reaches τ_D when the state z₁ is precisely on the boundary of ${\mathcal{Q}}_m$, the signal σ_m may or may not jump. Performing such a regularization leads to some robustness properties due to the fact that $\mathcal{H}$ is a well-posed hybrid system Goebel et al. (2012, Ch. 6).

Remark 4. The gain conditions in Eqs. 20, 24 must be satisfied because they lead to the feasibility of the QP-based controllers. The conditions are restated here for emphasis:

$k_1<k_{b1},k_4<k_{b2}.$

Theorem 1. Consider the closed-loop cycle-rider system $\mathcal{H}$. Assume the control gains satisfy the conditions in Eqs. 16, 20, 24, and z_2d > 0. Then the safe set $\tilde{\mathcal{S}}\triangleq \left\{x\in C\cup D:e_L\le e\le e_H\right\}$ is UGAS for $\mathcal{H}$. Additionally, $\mathcal{H}$ is a well-posed hybrid system.

Proof. Since B_e in Eq. 9 is such that $\tilde{\mathcal{S}}=\left\{x\in C\cup D:B_e\left(z\right)\le 0\right\}$, the function B_e is a valid barrier function candidate Maghenem and Sanfelice (2021), Def. 3. Using Lemma 1, the gain conditions in Eqs. 20, 24 guarantee that the controllers in Eqs. 19, 21, respectively, are feasible. By design, $u_e^{*}\left(e\right)\in {\bar{\mathcal{U}}}_e\left(e\right)$ for all $e\in \mathbb{R}$ and $u_m^{*}\left(x\right)\in {\mathcal{U}}_M$ for all $x\in \mathcal{X}$. Proposition 1 then shows that $u^{*}\left(x\right)\in \tilde{\mathcal{U}}\left(z\right)$ for all $x\in \mathcal{X}$. It follows from the definition of $\tilde{\mathcal{U}}$ in Eq. 10 that

$⟨\nabla B_e\left(z\right),f⟩\le -{\gamma }_e\left(e\right),(26)$

for all x ∈ C and each $f\in F\left(x\right)$. Moreover, the jump map is such that

$B_e\left(z^{+}\right)=B_e\left(z\right),(27)$

for all x ∈ D and each $\left(z^{+},{\sigma }_M^{+},{\tau }^{+}\right)\in G\left(x\right)$. The barrier function does not decrease at jumps, but there is sufficient flow time to guarantee an overall decrease along solutions. More specifically, the dwell-time τ_D ensures that for any solution ϕ to $\mathcal{H}$, if $\left(t,j\right)\in \text{dom}\varphi$, then $t\ge {\tau }_D\left(j-1\right)$. Thus, for any T ≥ 0 and $\left(t,j\right)\in \text{dom}\varphi$, if t + j ≥ T then $t\ge \left({\tau }_D/\left(1+{\tau }_D\right)\right)\left(T-1\right)$. We use this bound on the flow time to apply Proposition 3.27 of Goebel et al. (2012).

The conditions in Eqs. 26, 27, and the fact that $G\left(x\right)\subset C\cup D$ for all x ∈ D allow us to apply Theorem 1 of Maghenem and Sanfelice (2021) to conclude that the set $\tilde{\mathcal{S}}$ is forward pre-invariant for $\mathcal{H}$. Furthermore, the barrier function B_e is a Lyapunov function for the restricted hybrid system ${\mathcal{H}}_r=\left(C_r,F,D_r,G\right)$ with $C_r\triangleq C\cap \mathcal{I}$ and $D_r\triangleq D\cap \mathcal{I}$, where $\mathcal{I}\triangleq \left\{x\in \mathcal{X}:B_e\left(z\right)\ge 0\right\}$, which is the restriction of $\mathcal{H}$ to the zero superlevel set of B_e. It can be shown that there exists⁷ a continuous, positive definite function $\rho :{\mathbb{R}}_{\ge 0}\to {\mathbb{R}}_{\ge 0}$ such that $\rho \left({\left|x\right|}_{\tilde{\mathcal{S}}}\right)\le {\gamma }_e\left(e\right)$ for all x ∈ C_r. Using Property 1, there are class ${\mathcal{K}}_{\infty }$ functions⁸ α₁ and α₂ such that ${\alpha }_1\left({\left|x\right|}_{\tilde{\mathcal{S}}}\right)\le B\left(z\right)\le {\alpha }_2\left({\left|x\right|}_{\tilde{\mathcal{S}}}\right)$ for all $x\in C_r\cup D_r\cup G\left(D_r\right)$. Thus, Proposition 3.27 of Goebel et al. (2012) can be applied to conclude that $\tilde{\mathcal{S}}$ is uniformly globally pre-asymptotically stable (UGpAS) for ${\mathcal{H}}_r$ Goebel et al. (2012), Def. 3.6. That $\tilde{\mathcal{S}}$ is UGpAS for the unrestricted system $\mathcal{H}$ follows from forward pre-invariance of $\tilde{\mathcal{S}}$ for $\mathcal{H}$, since for any solution ϕ to $\mathcal{H}$, if $\varphi \left(t,j\right)\in \tilde{\mathcal{S}}$ then ${\left|\varphi \left(t^{\prime },j^{\prime }\right)\right|}_{\tilde{\mathcal{S}}}=0$ for all $\left(t^{\prime },j^{\prime }\right)\in \text{dom}\varphi$ with t′ ≥ t, j′ ≥ j. Therefore, solutions to ${\mathcal{H}}_r$ that terminate on the boundary of $\tilde{\mathcal{S}}$ can be extended as solutions to $\mathcal{H}$ that remain in $\tilde{\mathcal{S}}$.

To conclude that $\tilde{\mathcal{S}}$ is UGAS⁹, it remains to show that each maximal solution to $\mathcal{H}$ is complete. Towards this end, we invoke Proposition 6.10 of Goebel et al. (2012). We first note that the dynamics satisfy the hybrid basic conditions Goebel et al. (2012), Asm. 6.5 because C and D are closed; G is outer semicontinuous and locally bounded; and F is outer semicontinuous, locally bounded, and convex-valued by Property 9 and Lemma 3.2 in Sanfelice (2013). It follows that $\mathcal{H}$ is a well-posed hybrid system Goebel et al. (2012), Thm. 6.30. Next, every point x ∈ ∂C\D has the component τ = 0. The fact that $\dot{\tau }=1$ implies that $F\left(x\right)\cap T_C\left(x\right)\ne \varnothing$ at any x ∈ ∂C\D, where $T_C\left(x\right)$ is the tangent cone to C at x. It is then straightforward to conclude that the condition (VC) in Proposition 6.10 holds for all x ∈ C\D. Moreover, $G\left(D\right)\subset C\cup D$. Thus, Proposition 6.10 shows that a maximal solution is either complete or escapes in finite time by flowing.

To eliminate the possibility that maximal solutions escape in finite time by flowing, we first let ϕ be a solution to $\mathcal{H}$. From the definition of UGpAS in Definition 3.6 of Goebel et al. (2012), the distance of ϕ from $\tilde{\mathcal{S}}$ is bounded. From the definition of $\tilde{\mathcal{S}}$, the component of ϕ corresponding to the state e is bounded. Using this information, we conclude from continuity of $e\mapsto u_e^{*}\left(e\right)$ and the use of the saturation function in the definition of $u_M^{*}$ in Eq. 21 that for the concatenated controller u*, the set $u^{*}\left(\text{rge}\varphi \right)$ is bounded, where $\text{rge}\varphi \triangleq \{\varphi \left(t,j\right):\left(t,j\right)\in \text{dom}\varphi \}$. Then, from boundedness of the e component of ϕ and Properties 2-7, it can be shown that the set $F\left(\text{rge}\varphi \right)$ is bounded. It follows that solutions do not terminate in finite time by flowing (cf. Kamalapurkar et al. (2020)). Thus, each maximal solution to $\mathcal{H}$ is complete, and $\tilde{\mathcal{S}}$ is UGAS for $\mathcal{H}$. ■

5 Experimental Results

The developed barrier function controller was tested on five participants and compared against uncontrolled volitional pedaling and the 3-Mode (3M) controller developed in Rouse et al. (2020), Section 3. As described in Section 1, the main idea behind the 3M controller is to create a region near the setpoint z_2d where no assistance is provided, with discontinuous control effort being applied on the boundary of the region. In contrast to the barrier function controller, the electric motor controller for the 3M controller is coupled with FES stimulation via the angular position state z₁, so that the motor is inactive whenever FES is active, and vice versa.

The barrier function controller can be configured for various purposes based on the needs of the rider. Generally, there is a trade-off where smaller user-defined cadence ranges lead to greater applied control effort. Protocol A was designed to investigate whether the controller can reduce the variance in the rider’s cadence by constraining their cadence within a small range. Such a trial provides a point of comparison with the 3M controller and uncontrolled volitional pedaling and generates data where the controller is more active. Protocol B was designed to show how assistance from the motor can be reduced by selecting a wider safe range, thereby encouraging more volitional contributions from the rider. In fact, Protocol B featured a nominal amount of resistance from the motor, making the program more challenging and requiring additional power output from the rider.

Due to COVID-19 related difficulties in scheduling participants with neurological conditions, the trials for this demonstration were done with able-bodied subjects. Each participant gave written informed consent approved by the University of Florida Institutional Review Board (IRB201600881). Participants 1-3 were male, participants 4 and 5 were female, and all ranged in age from 21–29 years old.

5.1 Testbed

The experimental testbed consisted of a stationary recumbent tricycle (TerraTrike Rover) with a 250 W, 24 V motor (Unite Motor Co.) coupled to the drive chain as described in Bellman et al. (2017), Section 5.1. To measure position and cadence, an optical encoder with an angular resolution of 20,000 pulses per revolution (US Digital H1) was mounted to the crank using spur gears. The motor was actuated using an Advanced Motion Controls¹⁰ motor driver and current-controlled power supply. Stimulation was delivered to the rider’s quadricep, hamstring, and gluteal muscle groups via self-adhesive electrodes provided compliments of Axelgaard Manufacturing Co., Ltd. A current-controlled stimulator (Hasomed Rehastim) delivered symmetric, rectangular, and bi-phasic pulses at fixed amplitude (90 mA, 80 mA, and 70 mA for the quadriceps, hamstrings, and gluteals, respectively) and frequency (60 Hz), while the pulse width was used as the control input. A desktop computer running real-time control software (QUARC integrated with Simulink) was used to interface the controllers and hardware through a data acquisition board (Quanser QPIDe) with a sampling rate of 1,000 Hz. For additional safety, an emergency stop switch was mounted on the cycle to allow the participant to end the experiment if required.

5.2 Procedure

The primary testing procedure (Protocol A) consisted of 180-s tests for each of the three configurations (barrier function, 3M, and volition-only) under consideration. The volitional pedaling trial was always first, followed by a random selection of either the barrier function or 3M controller. The riders were asked to track a setpoint of z_2d = 50 RPM. The safe set boundary for the barrier function controller was encoded by e_L = − 5 RPM and e_H = 5 RPM, while e_FES = − 3 RPM. The inactive region for the 3M controller was 48–52 RPM, which is comparable to the range 50–55 RPM that was used for the experiments in Rouse et al. (2020). The rider was shown a live plot of their cadence featuring a visible indication of the setpoint. Due to differences between the barrier function and 3M controllers, participants were not shown the boundaries of the safe set¹¹.

The 180 s tests started with a 20 s ramp-up phase where the rider sat passively while the motor brought their cadence to the setpoint. To ensure that the presented data represented steady-state operation, the ramp-up and an additional 20 s after it was excluded from each dataset in post-processing. For each configuration, there was a separate warm-up run before the recorded session so the rider could become accustomed to the controller.

Measurements of the position of the rider’s legs with respect to the cycle were used to determine the regions of effective torque transfer ${\mathcal{Q}}_m$ for each muscle (see Bellman et al. (2017), Section 5.2) for more details). The cycle was initially operated at 50 RPM and open-loop stimulation was applied to one muscle group at a time to determine the comfort limit $\bar{u}$ for each muscle. The FES inputs are scaled by the comfort threshold in addition to being saturated¹². The nominal controllers were $u_e^{nom}=u_{FES}^{nom}=0$. The control gains were adjusted by plotting the control inputs as a function of the cadence error, which produced a visualization of the regions of applied control effort. Small adjustments to the gains were made for each participant based on their preferences during the warm-up run, which is a cause for variation in the data between participants. Some detailed discussion about the effect of the barrier function controller gains on performance is provided in Isaly et al. (2020) (see Remark 1 and Section 5.4).

Additional trials were conducted to highlight unique aspects of the barrier function controller, which were performed with only one participant. Protocol B was designed to prioritize power output from the rider over cadence tracking. For this alternative trial, the width of the safe range was larger, with e_L = − 12 RPM, e_H = 10 RPM, and e_FES = − 6 RPM. Because the rider (Participant #2) was able-bodied, we chose to make the program more challenging by adding nominal controllers with $u_e^{nom}<0$ and $u_{FES}^{nom}>0$, which means that near the setpoint the electric motor produced resistive torque while FES provided assistance. The boundaries e_L and e_H were displayed on-screen for this trial. In Protocol C, Participant #1 was asked to provide no volitional effort for both the 3M and barrier function controllers (Figure 4). Because of problems with the 3M controller for this trial, we did not proceed with testing the no-volition configuration on other participants.

5.3 Results

Table 1 shows relevant statistics for the three configurations tested for Protocol A, including the average and standard deviation of the cadence, percentage of the trial duration for which FES was actively stimulating, and time spent outside of the safe set $\mathcal{S}$. Two integrals of the electric motor input are given to distinguish resistive torque, for which the rider must pedal harder to compensate, and assistive torque, which implies work done by the motor and not the rider. The barrier function controller produced the lowest standard deviation in cadence for each participant and led to greater FES usage, but generally used more assistive torque from the motor than the 3M controller. The 3M controller produced less assistive torque because the electric motor was off in regions of the crank cycle where FES was active. The discrete switching between motor and FES, along with switching on the boundary of the inactive zone, caused numerous discontinuities in the 3M motor controller; Table 1 shows an average of 493 switches per trial. For all participants, the riders’ cadence took values in the range 40.7–56.1 RPM for the 3M controller, 45.4–55.3 RPM for the barrier function controller, and 40.5–59.2 RPM for uncontrolled pedaling. The barrier function controller constrained each rider’s cadence to the user-defined range of 45–55 RPM for all but a negligible amount of time; an average of six sampled data points or approximately 0.004% of the trial duration. Segments of the trials for three randomly selected participants are shown in Figure 2. A zoomed view featuring the FES stimulation input for a single participant is shown in Figure 3.

TABLE 1

TABLE 1. Protocol A: Cycling metrics during steady-state operation (140 second trial).

FIGURE 2

FIGURE 2. Cadence and motor control input for 30-s segments of the trials using Protocol A. Random selection was used to choose which participants and time periods were plotted. The time axis is offset to zero for readability. The dashed orange line in the barrier function cadence plot indicates the boundary of the safe set $\mathcal{S}$, which was not meaningful for the other two configurations.

FIGURE 3

FIGURE 3. Zoomed view of a 5-s time period during a trial using Protocol A showing the cadence, motor control input, and stimulation pulse-width (PW) for Participant 5. Random selection was used to choose which participant and time period were plotted. The time axis is offset to zero for readability. A pulse-width feedforward term of 10 μs was used to facilitate stimulation. The stimulation does not significantly affect the participant at or below 10 μs.

Figure 4 shows the trials using Protocol C, where Participant #1 provided no volitional effort. The barrier function controller was still able to keep the rider’s cadence within the safe set, while the 3M controller caused large oscillations; the mean ± SD cadence for the 3M controller was 43.74 ± 4.94 RPM. The cadence dropped as low as 31.54 RPM during the 3M trial because the electric motor was inactive in the shaded regions of Figure 4. When the motor was next switched on, it compensated using control action with a maximum magnitude of 17.74 A, which was relatively large compared to a maximum of 8.13 A for the 3M controller during the Protocol A trials.

FIGURE 4

FIGURE 4. Cadence from a trial using Protocol C, where Participant #1 was asked to provide no volitional effort. The 3M controller was problematic in this scenario due to switching between FES and motor control. The shaded red regions in the 3-Mode plot correspond to times when the electric motor was switched off.

The results for Protocol B, where there were nonzero nominal controllers and a wider safe range, are displayed in Figure 5 and Table 2. There was high utilization of the electric motor to produce resistive torque, but low assistive torque production. The assistive torque was smaller than the Protocol A average and, in particular, was smaller than Participant #2’s results. The resistive torque was large and FES was more active for Protocol B due to the design of the nominal controllers. The electric motor deviated from its nominal value for only 7.7% of the trial duration and was providing assistance for 4.1% of the trial. The cadence standard deviation was higher than uncontrolled volitional pedaling, which was most likely because the control inputs were actively pushing the rider away from the setpoint. The assistive torque from the barrier function controller in Protocol B was comparable to the 3M controller in the Protocol A trials.

FIGURE 5

FIGURE 5. Segment of a trial using Protocol B, where alternative parameters for the barrier function controller were used. The safe set was much wider for this run, leading to less deviation of control inputs from the nominal value. Nonzero nominal inputs were used to intensify the training. The data was collected with Participant #2.

TABLE 2

TABLE 2. Protocol B–barrier function controller: Cycling metrics during steady-state operation (140 second trial).

5.4 Discussion

The results for Protocol A demonstrate that the barrier function controller can assist a rider in tracking the cadence setpoint while constraining their cadence within a user-defined range. Figure 3 shows that the control inputs ramp up before the cadence reaches the boundaries defined by e_H, e_L, and e_FES, yet are inactive when the cadence is near the setpoint. Such a ramp-up is demonstrative of how barrier function methods can ensure a gradual transition from a nominal controller, which should be active on the interior of the safe set, to an invariance-ensuring controller on the boundary of the safe set. For Protocol A, the width of the nominal control range was fairly small, while the width was increased for Protocol B.

In some situations, increasing the training intensity for the rider will be preferred over improved cadence tracking. The relevant statistics are the assistive and resistive torques produced by the electric motor. Higher assistive torque indicates that less power is being produced by the rider. The barrier function controller is versatile and can be tuned to provide more or less interference from the control inputs. Figure 5 shows a trial using Protocol B where power output from the rider was prioritized by allowing larger cadence errors. The system’s operator can allow larger cadence errors by selecting a wider safe range, which also facilitates the design of a wider nominal control range. The use of nominal controllers for Protocol B intensified the training by providing more FES stimulation and resistance from the motor. The control inputs were at their nominal values for a significant portion of the experiment, validating that a wider safe range leads to less modification of the nominal inputs. The nominal inputs can alternatively be designed so there is less resistance from the motor or less control input overall. The fact that the assistive torque from the barrier function controller was comparable to the 3M controller suggests that staggering FES assistance before motor assistance, as in the barrier function controller, is a viable alternative to discrete switching between FES and motor control, as in the 3M controller.

A continuous motor controller is more comfortable for the rider. Continuity is the primary difference between the barrier function and 3M controller. The 3M controller is discontinuous whenever the cadence crosses the boundary of the inactive zone, or the angular position crosses the boundary of the FES stimulation regions ${\mathcal{Q}}_m$. The resulting large number of switches for the 3M motor controller is quantified in Table 1. A particular advantage of the motor being active in the ${\mathcal{Q}}_m$ regions is that the barrier function controller is effective even when the rider produces little or no volitional effort, as shown in the trials using Protocol C (Figure 4). The 3M controller caused large oscillations in the rider’s cadence during Protocol C due to the discrete switching between FES and motor control. Since FES cannot always produce enough torque on its own, the cadence dropped in the FES stimulation regions, which was then met with large control effort from the motor upon exiting the region.

There were some small deviations from the safe set because the asymptotic stability of $\mathcal{S}$ is contingent on the selection of control gains, which must be large enough to compensate for the rider’s volitional effort and other dynamic effects. In practice, designing the gains to account for large volitional contributions from the rider leads to overly constraining the rider during normal operation. Designing controllers for asymptotic stability, rather than the weaker property of forward invariance, helps mitigate these effects. A property known as input-to-state stability, which is a consequence of the UGAS result in Theorem 1, can be interpreted as guaranteeing that some nearby set is asymptotically stable despite unaccounted-for disturbances of bounded magnitude Xu et al. (2015); Cai and Teel (2009). Thus, the control gains can be relaxed to favor comfortable and effective therapy while still ensuring that the cadence remains nearby the safe set.

6 Conclusion

This paper developed new FES and motor controllers that encourage the rider of a stationary cycle to provide volitional effort while constraining their cadence within a user-defined range. Using theoretical advances for barrier functions, the controllers are minimally invasive while transitioning gradually to a safety-ensuring controller on the boundary of the safe set. The control inputs are selected from regulation maps with sufficient regularity to ensure that optimal selections are locally Lipschitz functions of the cadence error. Robust control tools were used to develop the regulation maps, which are subsets of an original, uncertain map. The uniform global asymptotic stability of the user-defined safe set was certified with a hybrid system analysis. In the future, the performance of the controller can be improved by extending the development to a more complete dynamic model which accounts for muscle activation effects such as electromechanical delay in the rider’s muscles.

Experimental results showed that the control system improved the rider’s cadence tracking and effectively constrained their cadence within the safe set. The versatility of the controller was demonstrated with trials featuring two different objectives: improved cadence tracking or more power output from the rider. A significant next step is to perform more rigorous experiments on a set of participants with neurological conditions. These riders have a reduced ability to provide volitional contributions, so the results are expected to be significantly different from those of able-bodied riders, and would be of interest in more clinically focused literature.

Data Availability Statement

The raw data supporting the conclusions of this article will be made available by the authors, without undue reservation.

Ethics Statement

The studies involving human participants were reviewed and approved by University of Florida Institutional Review Board (IRB201600881). The patients/participants provided their written informed consent to participate in this study.

Author Contributions

AI designed the controller and experiment, wrote the manuscript, and processed experimental results. BA provided multiple reviews of the manuscript and conducted the experiments. WD and RS provided technical guidance and edited the article. All authors contributed to manuscript revision, read, and approved the submitted version.

Funding

This research is supported in part by AFOSR award no. FA9550-19-1-0169, award no. FA9550-19-1-0053, and award no. FA9550-20-1-0238; by NSF award no. ECS-1710621, award no. CNS-1544396, award no. CNS-2039054, and award no. 1762829; and by the Army Research Office under Grant no. W911NF-20-1-0253. Any opinions, findings and conclusions or recommendations expressed in this material are those of the author(s) and do not necessarily reflect the views of the sponsoring agency.

Conflict of Interest

The handling Editor declared a past co-authorship with one of the authors WD.

The remaining authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Publisher’s Note

All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.

Footnotes

¹For vectors $x\in {\mathbb{R}}^n$, $y\in {\mathbb{R}}^m$, $\left(x,y\right)\triangleq {\left[x^T,y^T\right]}^T$.

²The addition of a point $a\in \mathbb{R}$ and a set $B\subset \mathbb{R}$ is defined as $a+B\triangleq \left\{a+b:b\in B\right\}$.

³Using the transformation in Eq. 5, we frequently use e in place of the cadence state z₂.

⁴A set that is UGAS is also forward invariant, meaning that trajectories starting inside the set remain in the set for all of time.

⁵While the gain conditions in Eq. 16 will be needed to guarantee that the cadence is constrained to the set $\mathcal{S}$, uniform global asymptotic stability ensures that the cadence remains nearby $\mathcal{S}$ even if the conditions do not hold (see Section 5.4).

⁶The positive saturation function ${\text{sat}}_{\bar{u}}^{+}:\mathbb{R}\to \mathbb{R}$ is defined as ${\text{sat}}_{\bar{u}}^{+}\left(u\right)=0$ if u < 0, ${\text{sat}}_{\bar{u}}^{+}\left(u\right)=u$ if $u\in \left[0,\bar{u}\right]$, and ${\text{sat}}_{\bar{u}}^{+}\left(u\right)=\bar{u}$ if $u>\bar{u}$.

⁷While more general techniques can be developed, it is sufficient here to define $\rho \left(s\right)\triangleq {\gamma }_e\left(s+e_H\right)$ if $e_H\ge \left|e_L\right|$ or $\rho \left(s\right)\triangleq {\gamma }_e\left(e_L-s\right)$ if $e_H<\left|e_L\right|$.

⁸A function $\alpha :{\mathbb{R}}_{\ge 0}\to {\mathbb{R}}_{\ge 0}$ is a class ${\mathcal{K}}_{\infty }$ function if a is zero at zero, continuous, strictly increasing, and unbounded.

⁹A set $\mathcal{A}$ is UGAS for a hybrid system $\mathcal{H}$ if it is UGpAS and every maximal solution to the system is complete, meaning the solution is defined on an unbounded hybrid time domain.

¹⁰Advanced Motion Controls supported the development of the testbed by providing discounts on their branded items.

¹¹In the 3M controller, the user defines a region where no control is applied. An asymptotically stable region will be induced by the selection of the control gains, but it is not possible to compute this region explicitly. In the barrier function controller, the user defines the safe set boundary, while a computable region of no-control is induced by the selection of the control gains, and guaranteed to exist by Lemma 1.

¹²Practical improvements like muscle-dependent control gains are not included in the theoretical development for simplicity.

References

Ames, A. D., Coogan, S., Egerstedt, M., Notomista, G., Sreenath, K., and Tabuada, P. (2019). “Control Barrier Functions: Theory and Applications,” in Proc. Eur. Control Conf. (IEEE), 3420–3431. doi:10.23919/ecc.2019.8796030

CrossRef Full Text | Google Scholar

Ames, A. D., Xu, X., Grizzle, J. W., and Tabuada, P. (2016). Control Barrier Function Based Quadratic Programs for Safety Critical Systems. IEEE Trans. Autom Control. 62, 3861–3876.

Google Scholar

Asl, H. J., Yamashita, M., Narikiyo, T., and Kawanishi, M. (2020). Field-based Assist-As-Needed Control Schemes for Rehabilitation Robots. Ieee/asme Trans. Mechatron. 25, 2100–2111. doi:10.1109/tmech.2020.2992090

CrossRef Full Text | Google Scholar

Bellman, M. J., Downey, R. J., Parikh, A., and Dixon, W. E. (2017). Automatic Control of Cycling Induced by Functional Electrical Stimulation with Electric Motor Assistance. IEEE Trans. Automat. Sci. Eng. 14, 1225–1234. doi:10.1109/TASE.2016.2527716

CrossRef Full Text | Google Scholar

Cai, C., and Teel, A. R. (2009). Characterizations of Input-To-State Stability for Hybrid Systems. Syst. Control. Lett. 58, 47–53. doi:10.1016/j.sysconle.2008.07.009

CrossRef Full Text | Google Scholar

Cousin, C. A., Duenas, V. H., Rouse, C. A., Bellman, M. J., Freeborn, P., Fox, E. J., et al. (2020). Closed-loop Cadence and Instantaneous Power Control on a Motorized Functional Electrical Stimulation Cycle. IEEE Trans. Contr. Syst. Technol. 28, 2276–2291. doi:10.1109/tcst.2019.2937725

CrossRef Full Text | Google Scholar

Dao, Q.-T., and Yamamoto, S.-i. (2018). Assist-as-needed Control of a Robotic Orthosis Actuated by Pneumatic Artificial Muscle for Gait Rehabilitation. Appl. Sci. 8, 499. doi:10.3390/app8040499

CrossRef Full Text | Google Scholar

Ding, B., Ai, Q., Liu, Q., and Meng, W. (2014). “Path Control of a Rehabilitation Robot Using Virtual Tunnel and Adaptive Impedance Controller,” in 2014 Seventh International Symposium on Computational Intelligence and Design (IEEE), 158–161. doi:10.1109/iscid.2014.204

CrossRef Full Text | Google Scholar

Duenas, V. H., Cousin, C. A., Rouse, C., Fox, E. J., and Dixon, W. E. (2020). Distributed Repetitive Learning Control for Cooperative Cadence Tracking in Functional Electrical Stimulation Cycling. IEEE Trans. Cybern. 50, 1084–1095. doi:10.1109/tcyb.2018.2882755

PubMed Abstract | CrossRef Full Text | Google Scholar

Ferrante, S., Pedrocchi, A., Ferrigno, G., and Molteni, F. (2008). Cycling Induced by Functional Electrical Stimulation Improves the Muscular Strength and the Motor Control of Individuals with post-acute Stroke. Europa Medicophysica-SIMFER 2007 Award Winner. Eur. J. Phys. Rehabil. Med. 44, 159–167.

PubMed Abstract | Google Scholar

Freeman, R. A., and Kokotovic, P. V. (1996). Robust Nonlinear Control Design: State-Space and Lyapunov Techniques. Boston, MA: Birkhäuser.

Google Scholar

Glotfelter, P., Cortés, J., and Egerstedt, M. (2017). Nonsmooth Barrier Functions with Applications to Multi-Robot Systems. IEEE Control. Syst. Lett. 1, 310–315. doi:10.1109/lcsys.2017.2710943

CrossRef Full Text | Google Scholar

Goebel, R. G., Sanfelice, R., and Teel, A. R. (2012). Hybrid Dynamical Systems. Princeton University Press.

Google Scholar

Harrington, A. T., McRae, C. G. A., and Lee, S. C. K. (2012). Evaluation of Functional Electrical Stimulation to Assist Cycling in Four Adolescents with Spastic Cerebral Palsy. Int. J. Pediatr. 2012, 1–11. doi:10.1155/2012/504387

CrossRef Full Text | Google Scholar

Hooker, S. P., Figoni, S. F., Rodgers, M. M., Glaser, R. M., Mathews, T., Suryaprasad, A. G., et al. (1992). Physiologic Effects of Electrical Stimulation Leg Cycle Exercise Training in Spinal Cord Injured Persons. Arch. Phys. Med. Rehabil. 73, 470–476.

PubMed Abstract | Google Scholar

Idsø, E. S. (2002). Development of a Mathematical Model of a Rider-Tricycle System. Trondheim: Norwegian University of Science and Technology.

Google Scholar

Isaly, A., Allen, B. C., Sanfelice, R., and Dixon, W. E. (2020). “Zeroing Control Barrier Functions for Safe Volitional Pedaling in a Motorized Cycle,” in IFAC Conf. Cyber-Phys. Hum.-Syst. (IEEE). doi:10.1016/j.ifacol.2021.04.100

CrossRef Full Text | Google Scholar

Janssen, T. W., Beltman, J. M., Elich, P., Koppe, P. A., Konijnenbelt, H., de Haan, A., et al. (2008). Effects of Electric Stimulation−Assisted Cycling Training in People with Chronic Stroke. Arch. Phys. Med. Rehabil. 89, 463–469. doi:10.1016/j.apmr.2007.09.028

PubMed Abstract | CrossRef Full Text | Google Scholar

Johnston, T. E., Smith, B. T., Oladeji, O., Betz, R. R., and Lauer, R. T. (2008). Outcomes of a home Cycling Program Using Functional Electrical Stimulation or Passive Motion for Children with Spinal Cord Injury: a Case Series. J. Spinal Cord Med. 31, 215–221. doi:10.1080/10790268.2008.11760715

CrossRef Full Text | Google Scholar

Johnston, T. E., and Wainwright, S. F. (2011). Cycling with Functional Electrical Stimulation in an Adult with Spastic Diplegic Cerebral Palsy. Phys. Ther. 91, 970–982. doi:10.2522/ptj.20100286

PubMed Abstract | CrossRef Full Text | Google Scholar

Kamalapurkar, R., Dixon, W. E., and Teel, A. (2020). On Reduction of Differential Inclusions and Lyapunov Stability. Esaim: Control Optim. Calc. 26, 1–16. doi:10.1051/cocv/2019074

CrossRef Full Text | Google Scholar

MacKay-Lyons, M. J., and Makrides, L. (2002). Cardiovascular Stress during a Contemporary Stroke Rehabilitation Program: Is the Intensity Adequate to Induce a Training Effect? Arch. Phys. Med. Rehabil. 83, 1378–1383. doi:10.1053/apmr.2002.35089

PubMed Abstract | CrossRef Full Text | Google Scholar

Maghenem, M., and Sanfelice, R. G. (2021). Sufficient Conditions for Forward Invariance and Contractivity in Hybrid Inclusions Using Barrier Functions. Automatica 124, 109328. doi:10.1016/j.automatica.2020.109328

CrossRef Full Text | Google Scholar

Mohr, T., Pødenphant, J., Biering–Sørensen, F., Galbo, H., Thamsborg, G., and Kjær, M. (1997). Increased Bone mineral Density after Prolonged Electrically Induced Cycle Training of Paralyzed Limbs in Spinal Cord Injured Man. Calcif. Tissue Int. 61, 22–25. doi:10.1007/s002239900286

PubMed Abstract | CrossRef Full Text | Google Scholar

Ouellette, M. M., LeBrasseur, N. K., Bean, J. F., Phillips, E., Stein, J., Frontera, W. R., et al. (2004). High-intensity Resistance Training Improves Muscle Strength, Self-Reported Function, and Disability in Long-Term Stroke Survivors. Stroke 35, 1404–1409. doi:10.1161/01.str.0000127785.73065.34

PubMed Abstract | CrossRef Full Text | Google Scholar

Pehlivan, A. U., Losey, D. P., and O’Malley, M. K. (2015). Minimal Assist-As-Needed Controller for Upper Limb Robotic Rehabilitation. IEEE Trans. Robot. 32, 113–124.

Google Scholar

Rouse, C. A., Downey, R. J., Gregory, C. M., Cousin, C. A., Duenas, V. H., and Dixon, W. E. (2020). FES Cycling in Stroke: Novel Closed-Loop Algorithm Accommodates Differences in Functional Impairments. IEEE Trans. Biomed. Eng. 67, 738–749. doi:10.1109/tbme.2019.2920346

PubMed Abstract | CrossRef Full Text | Google Scholar

Rouse, C., Cousin, C. A., Allen, B. C., and Dixon, W. E. (2021). Shared Control for Switched Motorized FES-Cycling on a Split-Crank Cycle Accounting for Muscle Control Input Saturation. Automatica 123, 1–11. doi:10.1016/j.automatica.2020.109294

CrossRef Full Text | Google Scholar

Sanfelice, R. G. (2013). On the Existence of Control Lyapunov Functions and State-Feedback Laws for Hybrid Systems. IEEE Trans. Automat. Contr. 58, 3242–3248. doi:10.1109/tac.2013.2264851

CrossRef Full Text | Google Scholar

Trevisi, E., Gualdi, S., De Conti, C., Salghetti, A., Martinuzzi, A., Pedrocchi, A., et al. (2012). Cycling Induced by Functional Electrical Stimulation in Children Affected by Cerebral Palsy: Case Report. Eur. J. Phys. Rehabil. Med. 48, 135–145.

Google Scholar

Xu, X., Tabuada, P., Grizzle, J. W., and Ames, A. D. (2015). Robustness of Control Barrier Functions for Safety Critical Control**This Work Is Partially Supported by the National Science Foundation Grants 1239055, 1239037 and 1239085. IFAC-PapersOnLine 48, 54–61. doi:10.1016/j.ifacol.2015.11.152

CrossRef Full Text | Google Scholar