Internal forward models with efference copies for state estimations in adaptive hexapod locomotion
-
1
Georg-August-Universität Göttingen, Bernstein Center for Computational Neuroscience, Germany
-
2
Institute for Nonlinear Dynamics, Georg-August-Universität Göttingen, Germany
Animal locomotion mechanisms seem to largely rely not only on central pattern generators (CPGs) and sensory feedback but also on internal forward models [1]. These components are used in different degree in different animals. In general, CPGs generate basic rhythmic patterns which can be considered as motor commands. They are usually shaped by sensory feedback (like, proprioceptive signals) to achieve appropriate coordinated movements during walking. Besides, the internal models transform motor commands copied (efference copies) within the central nerve system (CNS) into expected sensory inputs (or sensory prediction). This allows to compare the expected ones to the actual incoming sensory signals for state estimations. As a consequence, the internal models with efference copies together with local leg control [2] allow animals to adapt their locomotion to deal with environmental changes or during traversing over difficult terrain.
Based on these biological findings, we extend our existing neural CPG-based locomotion control of the hexapod robot AMOS [3] by introducing six internal forward models here. Each of them serves to transform a motor signal generated by a CPG (efference copy) into an expected sensory signal (i.e., foot contact signal) of each leg. Utilizing the discrete-time dynamical properties of a recurrent neuron (e.g., hysteresis effect) for signal transformation, each forward model is configured as a single recurrent neuron [4] with synaptic plasticity. Gradient descent learning is applied to adapt its presynaptic and recurrent weights. This way it can learn online to correctly transform the motor signal into the expected foot contact signal of each leg during normal walking (e.g., walking on flat surface). After learning the outputs of the learned models (i.e., expected foot contact signals) are used to compare with the actual incoming foot contact signals for the estimation of its walking state. The differences between the expected and actual sensor values are used to adapt leg motion (e.g., extension or elevation) through local leg control mechanisms. As a result, this neural closed-loop controller with the neural forward models enables the robot to perform a variety of locomotion behavior including insect-like walking and climbing. In addition, it allows the robot at the same time to adapt its locomotion to deal with terrain changes, losing of ground contact during a stance phase, or hitting obstacles during a swing phase (see supplementary video at http://www.manoonpong.com/BCCN2012/InternalForwardModels.wmv). We believe that all these biologically inspired components (i.e., CPG, internal forward models, and local leg control mechanisms) are at least important parts for developing robust and adaptable walking robots.
Acknowledgements
This research was supported by Emmy Noether grant MA4464/3-1 of the Deutsche Forschungsgemeinschaft (DFG), the Bernstein Center for Computational Neuroscience II Göttingen (BCCN grant 01GQ1005A, project D1).
References
[1] Cruse, H.; Dürr, V.; Schilling, M.; Schmitz, J. (2009) Bottom-Up Approach for Cognitive Control, in: P. Arena, & L. Patané (Eds.), Spatial temporal patterns for action-oriented perception in roving robots, 1. Berlin: Springer, 179-218.
[2] Delcomyn, F. (1999) Walking Robots and the Central and Peripheral Control of Locomotion in Insects. Auton. Robots 7(3), 259-270.
[3] Steingrube, S.; Timme, M.; Woergoetter, F.; Manoonpong, P. (2010) Self-Organized Adaptation of Simple Neural Circuits Enables Complex Robot Behavior. Nature Physics 6, 224-230.
[4] Pasemann, F. (1993) Dynamics of a single model neuron. International Journal of Bifurcation and Chaos 2, 271-278.
Keywords:
Adaptive walking,
Autonomous Robots,
central pattern generators,
Local leg control,
Neural control,
recurrent neural networks
Conference:
Bernstein Conference 2012, Munich, Germany, 12 Sep - 14 Sep, 2012.
Presentation Type:
Poster
Topic:
Motor control, movement, navigation
Citation:
Manoonpong
P,
Parlitz
U and
Wörgötter
F
(2012). Internal forward models with efference copies for state estimations in adaptive hexapod locomotion.
Front. Comput. Neurosci.
Conference Abstract:
Bernstein Conference 2012.
doi: 10.3389/conf.fncom.2012.55.00209
Copyright:
The abstracts in this collection have not been subject to any Frontiers peer review or checks, and are not endorsed by Frontiers.
They are made available through the Frontiers publishing platform as a service to conference organizers and presenters.
The copyright in the individual abstracts is owned by the author of each abstract or his/her employer unless otherwise stated.
Each abstract, as well as the collection of abstracts, are published under a Creative Commons CC-BY 4.0 (attribution) licence (https://creativecommons.org/licenses/by/4.0/) and may thus be reproduced, translated, adapted and be the subject of derivative works provided the authors and Frontiers are attributed.
For Frontiers’ terms and conditions please see https://www.frontiersin.org/legal/terms-and-conditions.
Received:
10 May 2012;
Published Online:
12 Sep 2012.
*
Correspondence:
Dr. Poramate Manoonpong, Georg-August-Universität Göttingen, Bernstein Center for Computational Neuroscience, Göttingen, 37077, Germany, poma@mmmi.sdu.dk