Timezone: »

Machine Learning for Creativity and Design 4.0
Luba Elliott · Sander Dieleman · Adam Roberts · Tom White · Daphne Ippolito · Holly Grimm · Mattie Tesfaldet · Samaneh Azadi

Sat Dec 12 05:15 AM -- 03:00 PM (PST) @ None
Event URL: https://neurips2020creativity.github.io/ »

Generative machine learning and machine creativity have continued to grow and attract a wider audience to machine learning. Generative models enable new types of media creation across images, music, and text - including recent advances such as StyleGAN2, Jukebox and GPT-3. This one-day workshop broadly explores issues in the applications of machine learning to creativity and design. We will look at algorithms for generation and creation of new media, engaging researchers building the next generation of generative models (GANs, RL, etc). We investigate the social and cultural impact of these new models, engaging researchers from HCI/UX communities and those using machine learning to develop new creative tools. In addition to covering the technical advances, we also address the ethical concerns ranging from the use of biased datasets to replicating artistic work. Finally, we’ll hear from some of the artists and musicians who are adopting machine learning including deep learning and reinforcement learning as part of their own artistic process. We aim to balance the technical issues and challenges of applying the latest generative models to creativity and design with philosophical and cultural issues that surround this area of research.

Sat 5:15 a.m. - 5:30 a.m.
Introduction and Art Gallery Overview (Introduction)
Luba Elliott
Sat 5:30 a.m. - 6:30 a.m.
Poster Session 1 (Poster Session)
Sat 6:30 a.m. - 6:56 a.m.
Farewell to Fart: Working with generated text in the age of huge neural nets (Invited Talk)   
Janelle Shane
Sat 6:56 a.m. - 7:21 a.m.
Artist+AI: Figures&Form (Invited Talk)   
Scott Eaton
Sat 7:21 a.m. - 7:40 a.m.
Artificial biodiversity (Invited Talk)   
Sofia Crespo
Sat 7:40 a.m. - 8:00 a.m.
Art Showcase 1 (Break)   
Luba Elliott
Sat 8:00 a.m. - 8:30 a.m.
Panel Discussion 1 (Panel Discussion)
Luba Elliott, Janelle Shane, Sofia Crespo, Scott Eaton, Adam Roberts, Angela Fan
Sat 8:30 a.m. - 9:15 a.m.
Social 1 (Social)
Sat 9:15 a.m. - 9:46 a.m.
magenta: Empowering Creative Agency with Machine Learning (Invited Talk)   
Jesse Engel
Sat 9:46 a.m. - 10:20 a.m.
Art Showcase 2 (Break)   
Holly Grimm
Sat 10:20 a.m. - 10:47 a.m.
Computation and the Human Visual Perception of Art (Invited Talk)   
Aaron Hertzmann
Sat 10:47 a.m. - 11:09 a.m.
LIGHT: Language in Games with Humans and Text (Invited Talk)   
Angela Fan
Sat 11:09 a.m. - 11:35 a.m.
Not the Only One (Invited Talk)   
Stephanie Dinkins
Sat 11:35 a.m. - 11:50 a.m.
Art Showcase 1 (Break)   
Luba Elliott
Sat 11:50 a.m. - 12:00 p.m.
Audio-reactive Latent Interpolations with StyleGAN (Contributed Talk)   
Hans Brouwer
Sat 12:00 p.m. - 12:10 p.m.
Towards realistic MIDI instrument synthesizers (Contributed Talk)   
Rodrigo Castellon
Sat 12:10 p.m. - 12:20 p.m.
Creative Sketch Generation (Contributed Talk)   
Songwei Ge
Sat 12:20 p.m. - 12:30 p.m.
Agence: an interactive film exploring multi-agent systems and human agency (Contributed Talk)   
Dante Camarena
Sat 12:30 p.m. - 12:45 p.m.
Art Showcase 2 (Break)   
Holly Grimm
Sat 12:45 p.m. - 1:45 p.m.
Poster Session 2 (Poster Session)
Sat 1:45 p.m. - 2:15 p.m.
Panel Discussion 2 (Panel Discussion)
Tom White, Jesse Engel, Aaron Hertzmann, Stephanie Dinkins, Holly Grimm
Sat 2:15 p.m. - 3:00 p.m.
Social 2 (Social)
Latent Space Oddity: Exploring Latent Spaces to Design Guitar Timbres (Poster)   
Jason Taylor
Colorization Transformer (Poster)   
Manoj Kumar
Diptychs of human and machine perceptions (Poster)   
Vivien Cabannes
GANterpretations (Poster)   
Pablo Samuel Castro
Generating Novel Glyph without Human Data by Learning to Communicate (Poster)   
Seung-won Park
Text to Dialog: Using Semantic Similarity to Extend Narrative Immersion in Virtual Worlds (Poster)   
Sherol Chen
TräumerAI: Dreaming Music with StyleGAN (Poster)   
Dasaem Jeong
Weird AI Yankovic: Generating Parody Lyrics (Poster)   
Mark Riedl
White-box Audio VST Effect Programming (Poster)   
Christopher Mitcheltree
A Note on Data Biases in Generative Models (Poster)   
Patrick Esser
Horses With Blue Jeans - Creating New Worlds by Rewriting a GAN (Poster)   
David Bau
Latent Compass (Poster)   
Sarah Schwettmann
Transformer-GAN: Symbolic music generation using a learned loss (Poster)   
aashiq Muhamed
Choreo-Graph: Learning Latent Graph Representations of the Dancing Body (Poster)   
Mariel Pettee
LiveGAN (Poster)   
Cameron Smith
Randomized Overdrive Neural Networks (Poster)   
Christian Steinmetz
Resolution Dependent GAN Interpolation for Controllable Image Synthesis Between Domains (Poster)   
Justin Pinkney
A Framework and Dataset for Abstract Art Generation via CalligraphyGAN (Poster)   
Jinggang Zhuo
Mask-Guided Discovery of Semantic Manifolds in Generative Models (Poster)   
Mengyu Yang
Network Bending Neural Vocoders (Poster)   
Louis McCallum
Copyspace: Where to Write on Images (Poster)   
Jessica Lundin
Musical Diary - AI Application for Music Making and Journaling (Poster)   
Suyash Joshi
Painting from Music using Neural Visual StyleTransfer (Poster)   
Prateek Verma, Ingrid Odlen, pamela Davis kivelson, Constantin Basica
Spatial Assembly:Generative Architecture With Reinforcement Learning, Self Play and Tree Search (Poster)   
Panagiotis Tigas
Behaviour Aesthetics of Reinforcement Learning in a Robotic Art Installation (Poster)   
Sofian Audry, Rosalie D Gagne, Hugo Scurto
A Speech-Based Music Composition Tool with Transformer (Poster)   
Jason d'Eon
Image Generation With Neural Cellular Automatas (Poster)   
Mingxiang Chen
Neural Style Transfer for Casual Creation (Poster)   
Simon Colton

Author Information

Luba Elliott (elluba.com)

Luba Elliott is a curator, artist and researcher specialising in artificial intelligence in the creative industries. She is currently working to educate and engage the broader public about the latest developments in creative AI through monthly meetups, talks and tech demonstrations. As curator, she organised workshops and exhibitions on art and AI for The Photographers’ Gallery, the Leverhulme Centre for the Future of Intelligence and Google. Prior to that, she worked in start-ups, including the art collector database Larry’s List. She obtained her undergraduate degree in Modern Languages at the University of Cambridge and has a certificate in Design Thinking from the Hasso-Plattner-Institute D-school in Potsdam.

Sander Dieleman (DeepMind)
Adam Roberts (Google Brain)
Tom White (Victoria University of Wellington School of Design)

Tom is a New Zealand based artist investigating machine perception. His current work focuses on creating physical artworks that highlight how machines “see” and thus how they think, suggesting that these systems are capable of abstraction and conceptual thinking. He has exhibited computer based artwork internationally over the past 25 years with themes of artificial intelligence, interactivity, and computational creativity. He is currently a lecturer and researcher at University of Wellington School of Design where he teaches students the creative potential of computer programming and artificial intelligence.

Daphne Ippolito (University of Pennsylvania / Google)

I am a PhD student at the University of Pennsylvania working in natural language processing. I am co-advised by Chris Callison-Burch at UPenn and Doug Eck at Google.

Holly Grimm (Sustia LLC)

Diné (Navajo) artist and machine learning engineer with interests in generative art and natural language processing for Indigenous languages. OpenAI Scholar. Creative Technologist at Google Artists + Machine Intelligence.

Mattie Tesfaldet (McGill University & Mila)
Samaneh Azadi (UC Berkeley)

More from the Same Authors