Autonomous Learning Group University of Tübingen

Reinforcement Learning for Diverse Solutions

Learning Agile Skills via Adversarial Imitation of Rough Partial Demonstrations

The Solo 8 robot performing a backflip.
The Solo 8 robot performing a backflip.

Mastering agility: We use a generative adversarial method for inferring reward functions from partial demonstrations. Using sim2real transfer we get robust skills enabling, for instance, the impressive backflip of our quadruped Solo 8.

Imitation learning from state-only demonstrations is a promising approach to capture preferences and to easily specify tasks. We study how to obtain agile behavior from only partial demonstrations and develop a Wasserstein discrimination method to compute the reward. This paper was one of the three best paper finalists at CoRL 2022.

Publications

Learning Agile Skills via Adversarial Imitation of Rough Partial Demonstrations
Learning Agile Skills via Adversarial Imitation of Rough Partial Demonstrations
C. Li, M. Vlastelica, S. Blaes, J. Frey, F. Grimminger, G. Martius
Proceedings of the 6th Conference on Robot Learning (CoRL)  ·  2023