Timezone: »
Generative machine learning and machine creativity have continued to grow and attract a wider audience to machine learning. Generative models enable new types of media creation across images, music, and text - including recent advances such as StyleGAN, MuseNet and GPT-2. This one-day workshop broadly explores issues in the applications of machine learning to creativity and design. We will look at algorithms for generation and creation of new media, engaging researchers building the next generation of generative models (GANs, RL, etc). We investigate the social and cultural impact of these new models, engaging researchers from HCI/UX communities and those using machine learning to develop new creative tools. In addition to covering the technical advances, we also address the ethical concerns ranging from the use of biased datasets to the use of synthetic media such as “DeepFakes”. Finally, we’ll hear from some of the artists and musicians who are adopting machine learning including deep learning and reinforcement learning as part of their own artistic process. We aim to balance the technical issues and challenges of applying the latest generative models to creativity and design with philosophical and cultural issues that surround this area of research.
Sat 8:15 a.m. - 8:30 a.m.
|
Welcome and Introduction
(
Introduction
)
|
🔗 |
Sat 8:30 a.m. - 9:00 a.m.
|
Transfer Learning for Text Generation
(
Invited Talk
)
|
Alec Radford 🔗 |
Sat 9:00 a.m. - 9:30 a.m.
|
Deepfakes: commodification, consequences and countermeasures
(
Invited Talk
)
|
Giorgio Patrini 🔗 |
Sat 9:30 a.m. - 9:45 a.m.
|
AI Art Gallery Overview
(
Introduction
)
|
Luba Elliott 🔗 |
Sat 9:45 a.m. - 10:30 a.m.
|
Coffee Break
|
🔗 |
Sat 10:30 a.m. - 11:00 a.m.
|
Artist Lightning Talks
(
Spotlight
)
|
Joanne Hastie · Maja Petric · Vibert Thio 🔗 |
Sat 10:30 a.m. - 11:00 a.m.
|
Yann LeCun (?)
(
Invited Talk
)
|
🔗 |
Sat 11:00 a.m. - 11:10 a.m.
|
Neural Painters: A learned differentiable constraint for generating brushstroke paintings
(
Contributed Talk
)
|
Reiichiro Nakano 🔗 |
Sat 11:10 a.m. - 11:20 a.m.
|
Transform the Set: Memory Attentive Generation of Guided and Unguided Image Collages
(
Contributed Talk
)
|
Nikolay Jetchev · Roland Vollgraf 🔗 |
Sat 11:20 a.m. - 11:30 a.m.
|
Paper Dreams: An Interactive Interface for Generative Visual Expression
(
Contributed Talk
)
|
Guillermo Bernal · Lily Zhou 🔗 |
Sat 11:30 a.m. - 11:40 a.m.
|
Deep reinforcement learning for 2D soft body locomotion
(
Contributed Talk
)
|
Junior Rojas 🔗 |
Sat 11:40 a.m. - 11:50 a.m.
|
Towards Sustainable Architecture: 3D Convolutional Neural Networks for Computational Fluid Dynamics Simulation and Reverse Design Workflow
(
Contributed Talk
)
|
Josef Musil 🔗 |
Sat 11:50 a.m. - 12:00 p.m.
|
Human and GAN collaboration to create haute couture dress
(
Contributed Talk
)
|
Jun Seita · Tatsuki Koga 🔗 |
Sat 12:00 p.m. - 1:30 p.m.
|
Lunch Break
|
🔗 |
Sat 1:30 p.m. - 2:30 p.m.
|
Poster Session 1
(
Poster Session
)
|
Han-Hung Lee · Asir Saeed · Terence Broad · Jon Gillick · Aaron Hertzmann · Gunjan Aggarwal · Eun Jee Sung · Alex Champandard · Junghyun Park · John Mellor · Vincent Herrmann · Da Gin Wu · Seri Lee · Park Jieun · TaeJae Han · wonseok jung · Seungil Kim
|
Sat 2:30 p.m. - 3:00 p.m.
|
How to Chain Trip
(
Invited Talk
)
|
Claire Evans · Jona Bechtolt · Robert Kieswetter 🔗 |
Sat 3:00 p.m. - 3:30 p.m.
|
Sougwen Chung
(
Invited Talk
)
|
Sougwen Chung 🔗 |
Sat 3:30 p.m. - 4:15 p.m.
|
Coffee Break
|
🔗 |
Sat 4:15 p.m. - 4:25 p.m.
|
MidiMe: Personalizing a MusicVAE model with user data
(
Contributed Talk
)
|
Monica Dinculescu 🔗 |
Sat 4:25 p.m. - 4:35 p.m.
|
First Steps Towards Collaborative Poetry Generation
(
Contributed Talk
)
|
Dave Uthus · Maria Voitovich 🔗 |
Sat 4:35 p.m. - 5:00 p.m.
|
Panel Discussion
(
Panel
)
|
🔗 |
Sat 5:00 p.m. - 6:00 p.m.
|
Poster Session 2
(
Poster Session
)
|
Mayur Saxena · Nicholas Frosst · Vivien Cabannes · Gene Kogan · Austin Dill · Anurag Sarkar · Joel Ruben Antony Moniz · Vibert Thio · Scott Sievert · Lia Coleman · Frederik De Bleser · Brian Quanz · Jonathon Kereliuk · Panos Achlioptas · Mohamed Elhoseiny · Songwei Ge · Aidan Gomez · Jamie Brew
|
Sat 5:05 p.m. - 6:00 p.m.
|
Artwork
(
Demonstration
)
|
Helena Sarin · Anthony Bourached · CJ Carr · Zachary Zukowski · Le Zhou · Katerina Malakhova · Maja Petric · Tomas Laurenzo · Elle O'Brien · Matthew Wegner · Yuma Kishi · Sehmon Burnam
|
Author Information
Luba Elliott (elluba.com)
Luba Elliott is a curator, artist and researcher specialising in artificial intelligence in the creative industries. She is currently working to educate and engage the broader public about the latest developments in creative AI through monthly meetups, talks and tech demonstrations. As curator, she organised workshops and exhibitions on art and AI for The Photographers’ Gallery, the Leverhulme Centre for the Future of Intelligence and Google. Prior to that, she worked in start-ups, including the art collector database Larry’s List. She obtained her undergraduate degree in Modern Languages at the University of Cambridge and has a certificate in Design Thinking from the Hasso-Plattner-Institute D-school in Potsdam.
Sander Dieleman (DeepMind)
Adam Roberts (Google Brain)
Jesse Engel (Google Brain)
Tom White (Victoria University of Wellington School of Design)
Tom is a New Zealand based artist investigating machine perception. His current work focuses on creating physical artworks that highlight how machines “see” and thus how they think, suggesting that these systems are capable of abstraction and conceptual thinking. He has exhibited computer based artwork internationally over the past 25 years with themes of artificial intelligence, interactivity, and computational creativity. He is currently a lecturer and researcher at University of Wellington School of Design where he teaches students the creative potential of computer programming and artificial intelligence.
Rebecca Fiebrink (Goldsmiths University of London)
Parag Mital (HyperSurfaces, LTD)
Parag K. MITAL (US) is an artist and interdisciplinary researcher obsessed with the nature of information, representation, and attention. Using film, eye-tracking, EEG, and fMRI recordings, he has worked on computational models of audiovisual perception from the perspective of both robots and humans, often revealing the disjunct between the two, through generative film experiences, augmented reality hallucinations, and expressive control of large audiovisual corpora. Through this process, he balances his scientific and arts practice, with both reflecting on each other: the science driving the theories, and the artwork re-defining the questions asked within the research. His work has been exhibited internationally including the Prix Ars Electronica, ACM Multimedia, Victoria & Albert Museum, London’s Science Museum, Oberhausen Short Film Festival, and the British Film Institute, and featured in FastCompany, BBC, NYTimes, CreativeApplications.Net, and CreateDigitalMotion.
Christine McLeavey (OpenAI)
Nao Tokui (Keio University)
More from the Same Authors
-
2021 : MIDI-DDSP: Hierarchical Modeling of Music for Detailed Control »
Yusong Wu · Ethan Manilow · Kyle Kastner · Tim Cooijmans · Aaron Courville · Cheng-Zhi Anna Huang · Jesse Engel -
2022 : PORTAGING (live AI Performance) »
Kory Mathewson · Piotr Mirowski · Hannah Johnston · Tom White · Jason Baldridge -
2022 Workshop: Workshop on Machine Learning for Creativity and Design »
Tom White · Yingtao Tian · Lia Coleman · Samaneh Azadi -
2022 : Tangible Abstractions »
Tom White -
2021 Workshop: Machine Learning for Creativity and Design »
Tom White · Mattie Tesfaldet · Samaneh Azadi · Daphne Ippolito · Lia Coleman · David Ha -
2021 : HEAR 2021: Holistic Evaluation of Audio Representations + Q&A »
Joseph Turian · Jordan Shier · Bhiksha Raj · Bjoern Schuller · Christian Steinmetz · George Tzanetakis · Gissel Velarde · Kirk McNally · Max Henry · Nicolas Pinto · Yonatan Bisk · George Tzanetakis · Camille Noufi · Dorien Herremans · Jesse Engel · Justin Salamon · Prany Manocha · Philippe Esling · Shinji Watanabe -
2020 : Panel Discussion 2 »
Tom White · Jesse Engel · Aaron Hertzmann · Stephanie Dinkins · Holly Grimm -
2020 : Art Showcase 1 »
Luba Elliott -
2020 : magenta: Empowering Creative Agency with Machine Learning »
Jesse Engel -
2020 : Panel Discussion 1 »
Luba Elliott · Janelle Shane · Sofia Crespo · Scott Eaton · Adam Roberts · Angela Fan -
2020 : Art Showcase 1 »
Luba Elliott -
2020 Workshop: Machine Learning for Creativity and Design 4.0 »
Luba Elliott · Sander Dieleman · Adam Roberts · Tom White · Daphne Ippolito · Holly Grimm · Mattie Tesfaldet · Samaneh Azadi -
2020 : Introduction and Art Gallery Overview »
Luba Elliott -
2020 Poster: Self-Supervised MultiModal Versatile Networks »
Jean-Baptiste Alayrac · Adria Recasens · Rosalia Schneider · Relja Arandjelović · Jason Ramapuram · Jeffrey De Fauw · Lucas Smaira · Sander Dieleman · Andrew Zisserman -
2019 : AI Art Gallery Overview »
Luba Elliott -
2019 : Poster Session »
Ethan Harris · Tom White · Oh Hyeon Choung · Takashi Shinozaki · Dipan Pal · Katherine L. Hermann · Judy Borowski · Camilo Fosco · Chaz Firestone · Vijay Veerabadran · Benjamin Lahner · Chaitanya Ryali · Fenil Doshi · Pulkit Singh · Sharon Zhou · Michel Besserve · Michael Chang · Anelise Newman · Mahesan Niranjan · Jonathon Hare · Daniela Mihai · Marios Savvides · Simon Kornblith · Christina M Funke · Aude Oliva · Virginia de Sa · Dmitry Krotov · Colin Conwell · George Alvarez · Alex Kolchinski · Shengjia Zhao · Mitchell Gordon · Michael Bernstein · Stefano Ermon · Arash Mehrjou · Bernhard Schölkopf · John Co-Reyes · Michael Janner · Jiajun Wu · Josh Tenenbaum · Sergey Levine · Yalda Mohsenzadeh · Zhenglong Zhou -
2018 : SpaceSheets: Interactive Latent Space Exploration through a Spreadsheet Interface »
Tom White -
2018 : AI art gallery overview »
Luba Elliott -
2018 Workshop: Second Workshop on Machine Learning for Creativity and Design »
Luba Elliott · Sander Dieleman · Rebecca Fiebrink · Jesse Engel · Adam Roberts · Tom White -
2018 Poster: The challenge of realistic music generation: modelling raw audio at scale »
Sander Dieleman · Aaron van den Oord · Karen Simonyan -
2017 : Imaginary Soundscape : Cross-Modal Approach to Generate Pseudo Sound Environments »
Yuma Kajihara · Nao Tokui -
2017 : Invited Talk »
Rebecca Fiebrink -
2017 Workshop: Machine Learning for Creativity and Design »
Douglas Eck · David Ha · S. M. Ali Eslami · Sander Dieleman · Rebecca Fiebrink · Luba Elliott -
2017 Demonstration: Magenta and deeplearn.js: Real-time Control of DeepGenerative Music Models in the Browser »
Curtis Hawthorne · Ian Simon · Adam Roberts · Jesse Engel · Daniel Smilkov · Nikhil Thorat · Douglas Eck -
2016 Demonstration: Interactive musical improvisation with Magenta »
Adam Roberts · Jesse Engel · Curtis Hawthorne · Ian Simon · Elliot Waite · Sageev Oore · Natasha Jaques · Cinjon Resnick · Douglas Eck -
2016 Demonstration: Neural Puppet »
Tom White