Timezone: »

Evolution Gym: A Large-Scale Benchmark for Evolving Soft Robots
Jagdeep Bhatia · Holly Jackson · Yunsheng Tian · Jie Xu · Wojciech Matusik

Thu Dec 09 04:30 PM -- 06:00 PM (PST) @

Both the design and control of a robot play equally important roles in its task performance. However, while optimal control is well studied in the machine learning and robotics community, less attention is placed on finding the optimal robot design. This is mainly because co-optimizing design and control in robotics is characterized as a challenging problem, and more importantly, a comprehensive evaluation benchmark for co-optimization does not exist. In this paper, we propose Evolution Gym, the first large-scale benchmark for co-optimizing the design and control of soft robots. In our benchmark, each robot is composed of different types of voxels (e.g., soft, rigid, actuators), resulting in a modular and expressive robot design space. Our benchmark environments span a wide range of tasks, including locomotion on various types of terrains and manipulation. Furthermore, we develop several robot co-evolution algorithms by combining state-of-the-art design optimization methods and deep reinforcement learning techniques. Evaluating the algorithms on our benchmark platform, we observe robots exhibiting increasingly complex behaviors as evolution progresses, with the best evolved designs solving many of our proposed tasks. Additionally, even though robot designs are evolved autonomously from scratch without prior knowledge, they often grow to resemble existing natural creatures while outperforming hand-designed robots. Nevertheless, all tested algorithms fail to find robots that succeed in our hardest environments. This suggests that more advanced algorithms are required to explore the high-dimensional design space and evolve increasingly intelligent robots -- an area of research in which we hope Evolution Gym will accelerate progress. Our website with code, environments, documentation, and tutorials is available at http://evogym.csail.mit.edu/.

Author Information

Jagdeep Bhatia (Massachusetts Institute of Technology)
Holly Jackson (Massachusetts Institute of Technology)

I’m a senior at MIT, pursuing a Bachelor’s in electrical engineering and computer science. I work on interdisciplinary applications of computer science, and I'm interested in computational geometry, physics-based simulation, evolutionary algorithms, GPU programming, numerical analysis, and data science.

Yunsheng Tian (Massachusetts Institute of Technology)
Jie Xu (Massachusetts Institute of Technology)
Wojciech Matusik (MIT)

More from the Same Authors