Timezone: »
Both the design and control of a robot play equally important roles in its task performance. However, while optimal control is well studied in the machine learning and robotics community, less attention is placed on finding the optimal robot design. This is mainly because co-optimizing design and control in robotics is characterized as a challenging problem, and more importantly, a comprehensive evaluation benchmark for co-optimization does not exist. In this paper, we propose Evolution Gym, the first large-scale benchmark for co-optimizing the design and control of soft robots. In our benchmark, each robot is composed of different types of voxels (e.g., soft, rigid, actuators), resulting in a modular and expressive robot design space. Our benchmark environments span a wide range of tasks, including locomotion on various types of terrains and manipulation. Furthermore, we develop several robot co-evolution algorithms by combining state-of-the-art design optimization methods and deep reinforcement learning techniques. Evaluating the algorithms on our benchmark platform, we observe robots exhibiting increasingly complex behaviors as evolution progresses, with the best evolved designs solving many of our proposed tasks. Additionally, even though robot designs are evolved autonomously from scratch without prior knowledge, they often grow to resemble existing natural creatures while outperforming hand-designed robots. Nevertheless, all tested algorithms fail to find robots that succeed in our hardest environments. This suggests that more advanced algorithms are required to explore the high-dimensional design space and evolve increasingly intelligent robots -- an area of research in which we hope Evolution Gym will accelerate progress. Our website with code, environments, documentation, and tutorials is available at http://evogym.csail.mit.edu/.
Author Information
Jagdeep Bhatia (Massachusetts Institute of Technology)
Holly Jackson (Massachusetts Institute of Technology)
I’m a senior at MIT, pursuing a Bachelor’s in electrical engineering and computer science. I work on interdisciplinary applications of computer science, and I'm interested in computational geometry, physics-based simulation, evolutionary algorithms, GPU programming, numerical analysis, and data science.
Yunsheng Tian (Massachusetts Institute of Technology)
Jie Xu (Massachusetts Institute of Technology)
Wojciech Matusik (MIT)
More from the Same Authors
-
2023 : AutODEx: Automated Optimal Design of Experiments Platform with Data- and Time-Efficient Multi-Objective Optimization »
Yunsheng Tian · Pavle Konakovic · Beichen Li · Ane Zuniga · Michael Foshey · Timothy Erps · Wojciech Matusik · Mina Konakovic Lukovic -
2023 : Accelerated High-Entropy Alloys Discovery for Electrocatalysis via Robotic-Aided Active Learning »
Zhichu Ren · Zhen Zhang · Yunsheng Tian · Ju Li -
2022 Poster: ActionSense: A Multimodal Dataset and Recording Framework for Human Activities Using Wearable Sensors in a Kitchen Environment »
Joseph DelPreto · Chao Liu · Yiyue Luo · Michael Foshey · Yunzhu Li · Antonio Torralba · Wojciech Matusik · Daniela Rus -
2020 Poster: Diversity-Guided Multi-Objective Bayesian Optimization With Batch Evaluations »
Mina Konakovic Lukovic · Yunsheng Tian · Wojciech Matusik -
2019 Poster: Learning-In-The-Loop Optimization: End-To-End Control And Co-Design Of Soft Robots Through Learned Deep Latent Representations »
Andrew Spielberg · Allan Zhao · Yuanming Hu · Tao Du · Wojciech Matusik · Daniela Rus