Adaptive multi-mode locomotion for bipedal wheel-legged robots via sparse mixture-of-experts deep reinforcement learning

Abstract

The bipedal wheel-legged robot combines the high energy efficiency of wheeled movement with the 8 terrain adaptability of legged locomotion. However, achieving a smooth transition between these two 9 heterogeneous motion modes within a unified control framework remains challenging. This study 10 proposes a reinforcement learning control framework that integrates the Mixture of Experts (MoE) 11 architecture. This approach employs a "divide and conquer" strategy by introducing a dynamic gating 12 network and a Top-K sparse activation mechanism, which automatically allocates different motion 13 modes to specific expert subnetworks, effectively decoupling conflicting gradients. Simulation 14 results demonstrate that, compared to the single-network PPO method, the MoE-enhanced algorithm 15 exhibits significant improvements in training stability and rewards. The learned policy successfully 16 achieved smooth rolling on flat surfaces and transitioned to dynamic leg-lifting gaits when 17 confronted with obstacles. In various test terrains, it showed a markedly higher success rate 18 compared to the single-network PPO method.