Autonomous Learning Group University of Tübingen

Learning with Muscles

The Effect of Muscles in Learning Behavior

Muscles lead to more robust hopping behavior in a humanoid.
Muscles lead to more robust hopping behavior in a humanoid.

Humans have robust and versatile motor capabilities, excelling at learning new tasks. We hypothesize that nonlinear muscle dynamics enhance stability and aid learning. While recent advancements in simulations and robotics have applied learning techniques to muscle-actuated systems, there hasn’t been a comprehensive analysis of muscles’ advantages for learning from scratch. Our study fills this gap, demonstrating how muscle actuators can effectively improve data efficiency, hyperparameter sensitivity, and robustness.

Biological systems rely on muscles for actuation. Do muscles offer advantages over electric motors when viewed through the lens of learning and closed-loop control of behavior? We explored this question and found that muscles can enhance learning speed and robustness. This research highlighted the significant potential of leveraging muscle actuator morphology for natural and robust motion, so far only validated in simulation.

Publications

Learning with Muscles: Benefits for Data-Efficiency and Robustness in Anthropomorphic Tasks
Learning with Muscles: Benefits for Data-Efficiency and Robustness in Anthropomorphic Tasks
I. Wochner, P. Schumacher, G. Martius, D. Büchler, S. Schmitt, D. Haeufle
Proceedings of the 6th Conference on Robot Learning (CoRL)  ·  2022