Timezone: »
Quality diversity (QD) is a growing branch of stochastic optimization research that studies the problem of generating an archive of solutions that maximize a given objective function but are also diverse with respect to a set of specified measure functions. However, even when these functions are differentiable, QD algorithms treat them as "black boxes", ignoring gradient information. We present the differentiable quality diversity (DQD) problem, a special case of QD, where both the objective and measure functions are first order differentiable. We then present MAP-Elites via a Gradient Arborescence (MEGA), a DQD algorithm that leverages gradient information to efficiently explore the joint range of the objective and measure functions. Results in two QD benchmark domains and in searching the latent space of a StyleGAN show that MEGA significantly outperforms state-of-the-art QD algorithms, highlighting DQD's promise for efficient quality diversity optimization when gradient information is available. Source code is available at https://github.com/icaros-usc/dqd.
Author Information
Matthew Fontaine (University of Southern California)
Stefanos Nikolaidis (University of Southern California)
Related Events (a corresponding poster, oral, or spotlight)
-
2021 Oral: Differentiable Quality Diversity »
Tue. Dec 7th 09:20 -- 09:35 AM Room
More from the Same Authors
-
2021 : On the Importance of Environments in Human-Robot Coordination »
Matthew Fontaine · Ya-Chuan Hsu · Yulun Zhang · Bryon Tjanaka · Stefanos Nikolaidis -
2022 : Scaling Covariance Matrix Adaptation MAP-Annealing to High-Dimensional Controllers »
Bryon Tjanaka · Matthew Fontaine · Aniruddha Kalkar · Stefanos Nikolaidis -
2022 : Panel Discussion »
Chuchu Fan · Stefanos Nikolaidis · Katherine Driggs-Campbell · Matthew Gombolay · Daniel Omeiza -
2022 : Scenario Generation via Quality Diversity for Trustworthy AI »
Stefanos Nikolaidis -
2022 Poster: Deep Surrogate Assisted Generation of Environments »
Varun Bhatt · Bryon Tjanaka · Matthew Fontaine · Stefanos Nikolaidis -
2019 Demonstration: Robot-Assisted Hair-Brushing »
Eura Shin · Hejia Zhang · Rey J Pocius · Nathaniel Dennler · Heather Culbertson · Naghmeh Zamani · Stefanos Nikolaidis