Timezone: »
Generative machine learning and machine creativity have continued to grow and attract a wider audience to machine learning. Generative models enable new types of media creation across images, music, and text - including recent advances such as StyleGAN2, Jukebox and GPT-3. This one-day workshop broadly explores issues in the applications of machine learning to creativity and design. We will look at algorithms for generation and creation of new media, engaging researchers building the next generation of generative models (GANs, RL, etc). We investigate the social and cultural impact of these new models, engaging researchers from HCI/UX communities and those using machine learning to develop new creative tools. In addition to covering the technical advances, we also address the ethical concerns ranging from the use of biased datasets to replicating artistic work. Finally, we’ll hear from some of the artists and musicians who are adopting machine learning including deep learning and reinforcement learning as part of their own artistic process. We aim to balance the technical issues and challenges of applying the latest generative models to creativity and design with philosophical and cultural issues that surround this area of research.
Sat 5:15 a.m. - 5:30 a.m.
|
Introduction and Art Gallery Overview
(
Introduction
)
|
Luba Elliott 🔗 |
Sat 5:30 a.m. - 6:30 a.m.
|
Poster Session 1 ( Poster Session ) link » | 🔗 |
Sat 6:30 a.m. - 6:56 a.m.
|
Farewell to Fart: Working with generated text in the age of huge neural nets
(
Invited Talk
)
SlidesLive Video » |
Janelle Shane 🔗 |
Sat 6:56 a.m. - 7:21 a.m.
|
Artist+AI: Figures&Form
(
Invited Talk
)
SlidesLive Video » |
Scott Eaton 🔗 |
Sat 7:21 a.m. - 7:40 a.m.
|
Artificial biodiversity
(
Invited Talk
)
SlidesLive Video » |
Sofia Crespo 🔗 |
Sat 7:40 a.m. - 8:00 a.m.
|
Art Showcase 1
SlidesLive Video » |
Luba Elliott 🔗 |
Sat 8:00 a.m. - 8:30 a.m.
|
Panel Discussion 1
(
Panel Discussion
)
|
Luba Elliott · Janelle Shane · Sofia Crespo · Scott Eaton · Adam Roberts · Angela Fan 🔗 |
Sat 8:30 a.m. - 9:15 a.m.
|
Social 1 ( Social ) link » | 🔗 |
Sat 9:15 a.m. - 9:46 a.m.
|
magenta: Empowering Creative Agency with Machine Learning
(
Invited Talk
)
SlidesLive Video » |
Jesse Engel 🔗 |
Sat 9:46 a.m. - 10:20 a.m.
|
Art Showcase 2
SlidesLive Video » |
Holly Grimm 🔗 |
Sat 10:20 a.m. - 10:47 a.m.
|
Computation and the Human Visual Perception of Art
(
Invited Talk
)
SlidesLive Video » |
Aaron Hertzmann 🔗 |
Sat 10:47 a.m. - 11:09 a.m.
|
LIGHT: Language in Games with Humans and Text
(
Invited Talk
)
SlidesLive Video » |
Angela Fan 🔗 |
Sat 11:09 a.m. - 11:35 a.m.
|
Not the Only One
(
Invited Talk
)
SlidesLive Video » |
Stephanie Dinkins 🔗 |
Sat 11:35 a.m. - 11:50 a.m.
|
Art Showcase 1
SlidesLive Video » |
Luba Elliott 🔗 |
Sat 11:50 a.m. - 12:00 p.m.
|
Audio-reactive Latent Interpolations with StyleGAN
(
Contributed Talk
)
SlidesLive Video » |
Hans Brouwer 🔗 |
Sat 12:00 p.m. - 12:10 p.m.
|
Towards realistic MIDI instrument synthesizers
(
Contributed Talk
)
SlidesLive Video » |
Rodrigo Castellon 🔗 |
Sat 12:10 p.m. - 12:20 p.m.
|
Creative Sketch Generation
(
Contributed Talk
)
SlidesLive Video » |
Songwei Ge 🔗 |
Sat 12:20 p.m. - 12:30 p.m.
|
Agence: an interactive film exploring multi-agent systems and human agency
(
Contributed Talk
)
SlidesLive Video » |
Dante Camarena 🔗 |
Sat 12:30 p.m. - 12:45 p.m.
|
Art Showcase 2
SlidesLive Video » |
Holly Grimm 🔗 |
Sat 12:45 p.m. - 1:45 p.m.
|
Poster Session 2 ( Poster Session ) link » | 🔗 |
Sat 1:45 p.m. - 2:15 p.m.
|
Panel Discussion 2
(
Panel Discussion
)
|
Tom White · Jesse Engel · Aaron Hertzmann · Stephanie Dinkins · Holly Grimm 🔗 |
Sat 2:15 p.m. - 3:00 p.m.
|
Social 2 ( Social ) link » | 🔗 |
-
|
Latent Space Oddity: Exploring Latent Spaces to Design Guitar Timbres
(
Poster
)
SlidesLive Video » |
Jason Taylor 🔗 |
-
|
Colorization Transformer
(
Poster
)
SlidesLive Video » |
Manoj Kumar 🔗 |
-
|
Diptychs of human and machine perceptions
(
Poster
)
SlidesLive Video » |
Vivien Cabannes 🔗 |
-
|
GANterpretations
(
Poster
)
SlidesLive Video » |
Pablo Samuel Castro 🔗 |
-
|
Generating Novel Glyph without Human Data by Learning to Communicate
(
Poster
)
SlidesLive Video » |
Seung-won Park 🔗 |
-
|
Text to Dialog: Using Semantic Similarity to Extend Narrative Immersion in Virtual Worlds
(
Poster
)
SlidesLive Video » |
Sherol Chen 🔗 |
-
|
TräumerAI: Dreaming Music with StyleGAN
(
Poster
)
SlidesLive Video » |
Dasaem Jeong 🔗 |
-
|
Weird AI Yankovic: Generating Parody Lyrics
(
Poster
)
SlidesLive Video » |
Mark Riedl 🔗 |
-
|
White-box Audio VST Effect Programming
(
Poster
)
SlidesLive Video » |
Christopher Mitcheltree 🔗 |
-
|
A Note on Data Biases in Generative Models
(
Poster
)
SlidesLive Video » |
Patrick Esser 🔗 |
-
|
Horses With Blue Jeans - Creating New Worlds by Rewriting a GAN
(
Poster
)
SlidesLive Video » |
David Bau 🔗 |
-
|
Latent Compass
(
Poster
)
SlidesLive Video » |
Sarah Schwettmann 🔗 |
-
|
Transformer-GAN: Symbolic music generation using a learned loss
(
Poster
)
SlidesLive Video » |
Aashiq Muhamed 🔗 |
-
|
Choreo-Graph: Learning Latent Graph Representations of the Dancing Body
(
Poster
)
SlidesLive Video » |
Mariel Pettee 🔗 |
-
|
LiveGAN
(
Poster
)
SlidesLive Video » |
Cameron Smith 🔗 |
-
|
Randomized Overdrive Neural Networks
(
Poster
)
SlidesLive Video » |
Christian Steinmetz 🔗 |
-
|
Resolution Dependent GAN Interpolation for Controllable Image Synthesis Between Domains
(
Poster
)
SlidesLive Video » |
Justin Pinkney 🔗 |
-
|
A Framework and Dataset for Abstract Art Generation via CalligraphyGAN
(
Poster
)
SlidesLive Video » |
Jinggang Zhuo 🔗 |
-
|
Mask-Guided Discovery of Semantic Manifolds in Generative Models
(
Poster
)
SlidesLive Video » |
Mengyu Yang 🔗 |
-
|
Network Bending Neural Vocoders
(
Poster
)
SlidesLive Video » |
Louis McCallum 🔗 |
-
|
Copyspace: Where to Write on Images
(
Poster
)
SlidesLive Video » |
Jessica Lundin 🔗 |
-
|
Musical Diary - AI Application for Music Making and Journaling
(
Poster
)
SlidesLive Video » |
Suyash Joshi 🔗 |
-
|
Painting from Music using Neural Visual StyleTransfer
(
Poster
)
SlidesLive Video » |
Prateek Verma · Ingrid Odlen · pamela Davis kivelson · Constantin Basica 🔗 |
-
|
Spatial Assembly:Generative Architecture With Reinforcement Learning, Self Play and Tree Search
(
Poster
)
SlidesLive Video » |
Panagiotis Tigas 🔗 |
-
|
Behaviour Aesthetics of Reinforcement Learning in a Robotic Art Installation
(
Poster
)
SlidesLive Video » |
Sofian Audry · Rosalie D Gagne · Hugo Scurto 🔗 |
-
|
A Speech-Based Music Composition Tool with Transformer
(
Poster
)
SlidesLive Video » |
Jason d'Eon 🔗 |
-
|
Image Generation With Neural Cellular Automatas
(
Poster
)
SlidesLive Video » |
Mingxiang Chen 🔗 |
-
|
Neural Style Transfer for Casual Creation
(
Poster
)
SlidesLive Video » |
Simon Colton 🔗 |
Author Information
Luba Elliott (elluba.com)
Luba Elliott is a curator, artist and researcher specialising in artificial intelligence in the creative industries. She is currently working to educate and engage the broader public about the latest developments in creative AI through monthly meetups, talks and tech demonstrations. As curator, she organised workshops and exhibitions on art and AI for The Photographers’ Gallery, the Leverhulme Centre for the Future of Intelligence and Google. Prior to that, she worked in start-ups, including the art collector database Larry’s List. She obtained her undergraduate degree in Modern Languages at the University of Cambridge and has a certificate in Design Thinking from the Hasso-Plattner-Institute D-school in Potsdam.
Sander Dieleman (DeepMind)
Adam Roberts (Google Brain)
Tom White (Victoria University of Wellington School of Design)
Tom is a New Zealand based artist investigating machine perception. His current work focuses on creating physical artworks that highlight how machines “see” and thus how they think, suggesting that these systems are capable of abstraction and conceptual thinking. He has exhibited computer based artwork internationally over the past 25 years with themes of artificial intelligence, interactivity, and computational creativity. He is currently a lecturer and researcher at University of Wellington School of Design where he teaches students the creative potential of computer programming and artificial intelligence.
Daphne Ippolito (University of Pennsylvania / Google)
I am a PhD student at the University of Pennsylvania working in natural language processing. I am co-advised by Chris Callison-Burch at UPenn and Doug Eck at Google.
Holly Grimm (Sustia LLC)
Diné (Navajo) artist and machine learning engineer with interests in generative art and natural language processing for Indigenous languages. OpenAI Scholar. Creative Technologist at Google Artists + Machine Intelligence.
Mattie Tesfaldet (McGill University & Mila)
Mattie Tesfaldet (they/them) is a computer vision and machine learning researcher, artist, and DJ based in Montréal, Canada. They are pursuing their PhD at McGill University and Mila researching generative models for visual content creation, specifically, looking for novel and interesting ways images and videos can be represented with neural networks. Outside of academia, they like to apply their research with the aim of exploring the intersection of human creativity and artificial intelligence. Particularly, developing new AI-based mediums for communication, expression, and sharing of visual imagery. You can find them on twitter and instagram @mattierialgirl.
Samaneh Azadi (UC Berkeley)
More from the Same Authors
-
2021 : Benchmark for Compositional Text-to-Image Synthesis »
Dong Huk Park · Samaneh Azadi · Xihui Liu · Trevor Darrell · Anna Rohrbach -
2021 : SynthBio: A Case Study in Faster Curation of Text Datasets »
Ann Yuan · Daphne Ippolito · Vitaly Nikolaev · Chris Callison-Burch · Andy Coenen · Sebastian Gehrmann -
2022 : PORTAGING (live AI Performance) »
Kory Mathewson · Piotr Mirowski · Hannah Johnston · Tom White · Jason Baldridge -
2022 Workshop: Workshop on Machine Learning for Creativity and Design »
Tom White · Yingtao Tian · Lia Coleman · Samaneh Azadi -
2022 : Tangible Abstractions »
Tom White -
2021 Workshop: Machine Learning for Creativity and Design »
Tom White · Mattie Tesfaldet · Samaneh Azadi · Daphne Ippolito · Lia Coleman · David Ha -
2020 : Panel Discussion 2 »
Tom White · Jesse Engel · Aaron Hertzmann · Stephanie Dinkins · Holly Grimm -
2020 : Art Showcase 2 »
Holly Grimm -
2020 : Art Showcase 1 »
Luba Elliott -
2020 : Art Showcase 2 »
Holly Grimm -
2020 : Panel Discussion 1 »
Luba Elliott · Janelle Shane · Sofia Crespo · Scott Eaton · Adam Roberts · Angela Fan -
2020 : Art Showcase 1 »
Luba Elliott -
2020 : Introduction and Art Gallery Overview »
Luba Elliott -
2019 : AI Art Gallery Overview »
Luba Elliott -
2019 Workshop: NeurIPS Workshop on Machine Learning for Creativity and Design 3.0 »
Luba Elliott · Sander Dieleman · Adam Roberts · Jesse Engel · Tom White · Rebecca Fiebrink · Parag Mital · Christine McLeavey · Nao Tokui -
2019 : Poster Session »
Ethan Harris · Tom White · Oh Hyeon Choung · Takashi Shinozaki · Dipan Pal · Katherine L. Hermann · Judy Borowski · Camilo Fosco · Chaz Firestone · Vijay Veerabadran · Benjamin Lahner · Chaitanya Ryali · Fenil Doshi · Pulkit Singh · Sharon Zhou · Michel Besserve · Michael Chang · Anelise Newman · Mahesan Niranjan · Jonathon Hare · Daniela Mihai · Marios Savvides · Simon Kornblith · Christina M Funke · Aude Oliva · Virginia de Sa · Dmitry Krotov · Colin Conwell · George Alvarez · Alex Kolchinski · Shengjia Zhao · Mitchell Gordon · Michael Bernstein · Stefano Ermon · Arash Mehrjou · Bernhard Schölkopf · John Co-Reyes · Michael Janner · Jiajun Wu · Josh Tenenbaum · Sergey Levine · Yalda Mohsenzadeh · Zhenglong Zhou -
2018 : Poster Session 2 »
Katy Gero · Le Zhou · Simiao Yu · Zhengyan Gao · Chris Donahue · Juncheng Li · TAEGYUN KWON · Patrick Hutchings · Charles Martin · Eunsu Kang · Asanobu Kitamoto · Zheng Jiang · Syuan-Cheng Sun · Philipp Roland Schmitt · Maria Attarian · Alex Lamb · Tarin CLANUWAT · Mauro Martino · Holly Grimm · Nikolay Jetchev -
2018 : SpaceSheets: Interactive Latent Space Exploration through a Spreadsheet Interface »
Tom White -
2018 : Infilling Piano performances »
Daphne Ippolito -
2018 : AI art gallery overview »
Luba Elliott -
2018 Workshop: Second Workshop on Machine Learning for Creativity and Design »
Luba Elliott · Sander Dieleman · Rebecca Fiebrink · Jesse Engel · Adam Roberts · Tom White -
2017 : Deep learning for music recommendation and generation »
Sander Dieleman -
2017 Workshop: Machine Learning for Creativity and Design »
Douglas Eck · David Ha · S. M. Ali Eslami · Sander Dieleman · Rebecca Fiebrink · Luba Elliott -
2017 Demonstration: Magenta and deeplearn.js: Real-time Control of DeepGenerative Music Models in the Browser »
Curtis Hawthorne · Ian Simon · Adam Roberts · Jesse Engel · Daniel Smilkov · Nikhil Thorat · Douglas Eck -
2016 Demonstration: Interactive musical improvisation with Magenta »
Adam Roberts · Jesse Engel · Curtis Hawthorne · Ian Simon · Elliot Waite · Sageev Oore · Natasha Jaques · Cinjon Resnick · Douglas Eck -
2016 Demonstration: Neural Puppet »
Tom White