Timezone: »
Workshop
I (Still) Can't Believe It's Not Better: A workshop for “beautiful” ideas that "should" have worked
Aaron Schein · Melanie F. Pradier · Jessica Forde · Stephanie Hyland · Francisco Ruiz
Mon Dec 13 04:50 AM -- 02:40 PM (PST) @
Event URL: https://i-cant-believe-its-not-better.github.io/neurips2021/ »
Beautiful ideas have shaped scientific progress throughout history. As Paul Dirac said, “If one is working from the point of view of getting beauty in one's equations, (…), one is on a sure line of progress.” However, beautiful ideas are often overlooked in a research environment that heavily emphasizes state-of-the-art (SOTA) results, where the worth of scientific works is defined by their immediate utility and quantitative superiority instead of their creativity, diversity, and elegance. This workshop will explore gaps between the form and function (or, the intrinsic and extrinsic value) of ideas in ML and AI research. We will explore that disconnect by asking researchers to submit their “beautiful” ideas that don’t (yet) “work”. We will ask them to explain why their idea has intrinsic value, and hypothesize why it hasn’t (yet) shown its extrinsic value. In doing so, we will create a space for researchers to help each other get their “beautiful” ideas “working”.
|
Mon 4:50 a.m. - 5:00 a.m.
|
Opening Remarks
SlidesLive Video » |
🔗 |
|
Mon 5:00 a.m. - 5:30 a.m.
|
Invited Talk 1
(
Talk
)
SlidesLive Video » |
Robert Williamson 🔗 |
|
Mon 5:30 a.m. - 5:45 a.m.
|
Contributed Talk 1
(
Talk
)
SlidesLive Video » |
Wouter Kool 🔗 |
|
Mon 5:45 a.m. - 6:45 a.m.
|
Panel
SlidesLive Video » |
Mohammad Emtiyaz Khan · Atoosa Kasirzadeh · Anna Rogers · Javier González · Suresh Venkatasubramanian · Robert Williamson 🔗 |
|
Mon 6:45 a.m. - 7:00 a.m.
|
Coffee Break
|
🔗 |
|
Mon 7:00 a.m. - 7:30 a.m.
|
Invited Talk 2
(
Talk
)
SlidesLive Video » |
Mihaela Rosca 🔗 |
|
Mon 7:30 a.m. - 7:45 a.m.
|
Contributed Talk 2
(
Talk
)
SlidesLive Video » |
Francesco Negri 🔗 |
|
Mon 7:45 a.m. - 8:15 a.m.
|
Invited Talk 3
(
Talk
)
SlidesLive Video » |
Nyalleng Moorosi · Razvan Amironesei 🔗 |
|
Mon 8:15 a.m. - 8:18 a.m.
|
Spotlight Talk 1
(
Talk
)
SlidesLive Video » |
Imant Daunhawer 🔗 |
|
Mon 8:18 a.m. - 8:21 a.m.
|
Spotlight Talk 2
(
Talk
)
SlidesLive Video » |
Paulo Pirozelli 🔗 |
|
Mon 8:21 a.m. - 8:24 a.m.
|
Spotlight Talk 3
(
Talk
)
SlidesLive Video » |
Ke Alexander Wang 🔗 |
|
Mon 8:24 a.m. - 8:27 a.m.
|
Spotlight Talk 4
(
Talk
)
SlidesLive Video » |
Tristan Cinquin 🔗 |
|
Mon 8:27 a.m. - 8:30 a.m.
|
Spotlight Talk 5
(
Talk
)
SlidesLive Video » |
Soufiane Hayou 🔗 |
|
Mon 8:30 a.m. - 9:00 a.m.
|
Invited Talk 4
(
Talks
)
SlidesLive Video » |
Tom Griffiths 🔗 |
|
Mon 9:00 a.m. - 9:03 a.m.
|
Spotlight Talk 6
(
Talk
)
SlidesLive Video » |
Amélie Chatelain 🔗 |
|
Mon 9:03 a.m. - 9:06 a.m.
|
Spotlight Talk 7
(
Talk
)
SlidesLive Video » |
Nitya Kasturi 🔗 |
|
Mon 9:06 a.m. - 9:09 a.m.
|
Spotlight Talk 8
(
Talk
)
SlidesLive Video » |
Cian Eastwood 🔗 |
|
Mon 9:09 a.m. - 9:12 a.m.
|
Spotlight Talk 9
(
Talk
)
SlidesLive Video » |
Anthony Caterini 🔗 |
|
Mon 9:12 a.m. - 9:15 a.m.
|
Spotlight Talk 10
(
Talk
)
SlidesLive Video » |
Luca Zappella 🔗 |
|
Mon 9:15 a.m. - 10:00 a.m.
|
Break
|
🔗 |
|
Mon 10:00 a.m. - 11:45 a.m.
|
Poster Session
|
🔗 |
|
Mon 11:15 a.m. - 11:45 a.m.
|
Breakout Discussions
(
Discussion
)
|
🔗 |
|
Mon 11:45 a.m. - 12:15 p.m.
|
Invited Talk 5
(
Talk
)
SlidesLive Video » |
Tina Eliassi-Rad 🔗 |
|
Mon 12:15 p.m. - 12:30 p.m.
|
Contributed Talk 3
(
Talk
)
SlidesLive Video » |
Chelsea Murray 🔗 |
|
Mon 12:30 p.m. - 1:00 p.m.
|
Invited Talk 6
(
Talks
)
SlidesLive Video » |
Chris Maddison 🔗 |
|
Mon 1:00 p.m. - 1:15 p.m.
|
Contributed Talk 4
(
Talk
)
SlidesLive Video » |
Benjamin Bloem-Reddy 🔗 |
|
Mon 1:15 p.m. - 1:30 p.m.
|
Coffee Break
|
🔗 |
|
Mon 1:30 p.m. - 2:00 p.m.
|
Invited Talk 7
(
Talk
)
SlidesLive Video » |
Daniel McDonald 🔗 |
|
Mon 2:00 p.m. - 2:10 p.m.
|
Awards Ceremony
(
Awards
)
SlidesLive Video » |
🔗 |
|
Mon 2:10 p.m. - 2:40 p.m.
|
Town Hall
(
Discussion
)
|
🔗 |
Author Information
Aaron Schein (Columbia University)
Melanie F. Pradier (Microsoft Research)
Jessica Forde (Brown University)
Stephanie Hyland (Microsoft Research)
Francisco Ruiz ("DeepMind")
More from the Same Authors
-
2022 Spotlight: Evaluation beyond Task Performance: Analyzing Concepts in AlphaZero in Hex »
Charles Lovering · Jessica Forde · George Konidaris · Ellie Pavlick · Michael Littman -
2022 Workshop: I Can’t Believe It’s Not Better: Understanding Deep Learning Through Empirical Falsification »
Arno Blaas · Sahra Ghalebikesabi · Javier Antorán · Fan Feng · Melanie F. Pradier · Ian Mason · David Rohde -
2022 Poster: Repairing Neural Networks by Leaving the Right Past Behind »
Ryutaro Tanno · Melanie F. Pradier · Aditya Nori · Yingzhen Li -
2022 Poster: Evaluation beyond Task Performance: Analyzing Concepts in AlphaZero in Hex »
Charles Lovering · Jessica Forde · George Konidaris · Ellie Pavlick · Michael Littman -
2021 : TD | Panel Discussion »
Thomas Gilbert · Ayse Yasar · Rachel Thomas · Mason Kortz · Frank Pasquale · Jessica Forde -
2021 Workshop: Bridging the Gap: from Machine Learning Research to Clinical Practice »
Julia Vogt · Ece Ozkan · Sonali Parbhoo · Melanie F. Pradier · Patrick Schwab · Shengpu Tang · Mario Wieser · Jiayu Yao -
2021 : Evaluating Approximate Inference in Bayesian Deep Learning + Q&A »
Andrew Gordon Wilson · Pavel Izmailov · Matthew Hoffman · Yarin Gal · Yingzhen Li · Melanie F. Pradier · Sharad Vikram · Andrew Foong · Sanae Lotfi · Sebastian Farquhar -
2021 Poster: Hyperparameter Optimization Is Deceiving Us, and How to Stop It »
A. Feder Cooper · Yucheng Lu · Jessica Forde · Christopher De Sa -
2020 Workshop: I Can’t Believe It’s Not Better! Bridging the gap between theory and empiricism in probabilistic machine learning »
Jessica Forde · Francisco Ruiz · Melanie Fernandez Pradier · Aaron Schein · Finale Doshi-Velez · Isabel Valera · David Blei · Hanna Wallach -
2020 : Intro »
Aaron Schein · Melanie F. Pradier -
2020 : Jessica Zosa Forde - Build, Start, Run, Push: Computational Registration of ML Experiments »
Jessica Forde -
2020 Workshop: ML Retrospectives, Surveys & Meta-Analyses (ML-RSA) »
Chhavi Yadav · Prabhu Pradhan · Jesse Dodge · Mayoore Jaiswal · Peter Henderson · Abhishek Gupta · Ryan Lowe · Jessica Forde · Joelle Pineau -
2020 Workshop: Machine Learning for Health (ML4H): Advancing Healthcare for All »
Stephanie Hyland · Allen Schmaltz · Charles Onu · Ehi Nosakhare · Emily Alsentzer · Irene Y Chen · Matthew McDermott · Subhrajit Roy · Benjamin Akera · Dani Kiyasseh · Fabian Falck · Griffin Adams · Ioana Bica · Oliver J Bear Don't Walk IV · Suproteem Sarkar · Stephen Pfohl · Andrew Beam · Brett Beaulieu-Jones · Danielle Belgrave · Tristan Naumann -
2019 : Lunch Break and Posters »
Xingyou Song · Elad Hoffer · Wei-Cheng Chang · Jeremy Cohen · Jyoti Islam · Yaniv Blumenfeld · Andreas Madsen · Jonathan Frankle · Sebastian Goldt · Satrajit Chatterjee · Abhishek Panigrahi · Alex Renda · Brian Bartoldson · Israel Birhane · Aristide Baratin · Niladri Chatterji · Roman Novak · Jessica Forde · YiDing Jiang · Yilun Du · Linara Adilova · Michael Kamp · Berry Weinstein · Itay Hubara · Tal Ben-Nun · Torsten Hoefler · Daniel Soudry · Hsiang-Fu Yu · Kai Zhong · Yiming Yang · Inderjit Dhillon · Jaime Carbonell · Yanqing Zhang · Dar Gilboa · Johannes Brandstetter · Alexander R Johansen · Gintare Karolina Dziugaite · Raghav Somani · Ari Morcos · Freddie Kalaitzis · Hanie Sedghi · Lechao Xiao · John Zech · Muqiao Yang · Simran Kaur · Qianli Ma · Yao-Hung Hubert Tsai · Ruslan Salakhutdinov · Sho Yaida · Zachary Lipton · Daniel Roy · Michael Carbin · Florent Krzakala · Lenka Zdeborová · Guy Gur-Ari · Ethan Dyer · Dilip Krishnan · Hossein Mobahi · Samy Bengio · Behnam Neyshabur · Praneeth Netrapalli · Kris Sankaran · Julien Cornebise · Yoshua Bengio · Vincent Michalski · Samira Ebrahimi Kahou · Md Rifat Arefin · Jiri Hron · Jaehoon Lee · Jascha Sohl-Dickstein · Samuel Schoenholz · David Schwab · Dongyu Li · Sang Keun Choe · Henning Petzka · Ashish Verma · Zhichao Lin · Cristian Sminchisescu -
2019 Workshop: Retrospectives: A Venue for Self-Reflection in ML Research »
Ryan Lowe · Yoshua Bengio · Joelle Pineau · Michela Paganini · Jessica Forde · Shagun Sodhani · Abhishek Gupta · Joel Lehman · Peter Henderson · Kanika Madan · Koustuv Sinha · Xavier Bouthillier -
2019 Poster: Poisson-Randomized Gamma Dynamical Systems »
Aaron Schein · Scott Linderman · Mingyuan Zhou · David Blei · Hanna Wallach -
2018 : Poster Session »
Lorenzo Masoero · Tammo Rukat · Runjing Liu · Sayak Ray Chowdhury · Daniel Coelho de Castro · Claudia Wehrhahn · Feras Saad · Archit Verma · Kelvin Hsu · Irineo Cabreros · Sandhya Prabhakaran · Yiming Sun · Maxime Rischard · Linfeng Liu · Adam Farooq · Jeremiah Liu · Melanie F. Pradier · Diego Romeres · Neill Campbell · Kai Xu · Mehmet M Dundar · Tucker Keuter · Prashnna Gyawali · Eli Sennesh · Alessandro De Palma · Daniel Flam-Shepherd · Takatomi Kubo -
2018 : Poster Session 1 (note there are numerous missing names here, all papers appear in all poster sessions) »
Akhilesh Gotmare · Kenneth Holstein · Jan Brabec · Michal Uricar · Kaleigh Clary · Cynthia Rudin · Sam Witty · Andrew Ross · Shayne O'Brien · Babak Esmaeili · Jessica Forde · Massimo Caccia · Ali Emami · Scott Jordan · Bronwyn Woods · D. Sculley · Rebekah Overdorf · Nicolas Le Roux · Peter Henderson · Brandon Yang · Tzu-Yu Liu · David Jensen · Niccolo Dalmasso · Weitang Liu · Paul Marc TRICHELAIR · Jun Ki Lee · Akanksha Atrey · Matt Groh · Yotam Hechtlinger · Emma Tosch -
2018 Demonstration: Reproducing Machine Learning Research on Binder »
Jessica Forde · Tim Head · Chris Holdgraf · M Pacer · Félix-Antoine Fortin · Fernando Perez -
2017 : Coffee break and Poster Session I »
Nishith Khandwala · Steve Gallant · Gregory Way · Aniruddh Raghu · Li Shen · Aydan Gasimova · Alican Bozkurt · William Boag · Daniel Lopez-Martinez · Ulrich Bodenhofer · Samaneh Nasiri GhoshehBolagh · Michelle Guo · Christoph Kurz · Kirubin Pillay · Kimis Perros · George H Chen · Alexandre Yahi · Madhumita Sushil · Sanjay Purushotham · Elena Tutubalina · Tejpal Virdi · Marc-Andre Schulz · Samuel Weisenthal · Bharat Srikishan · Petar Veličković · Kartik Ahuja · Andrew Miller · Erin Craig · Disi Ji · Filip Dabek · Chloé Pou-Prom · Hejia Zhang · Janani Kalyanam · Wei-Hung Weng · Harish Bhat · Hugh Chen · Simon Kohl · Mingwu Gao · Tingting Zhu · Ming-Zher Poh · Iñigo Urteaga · Antoine Honoré · Alessandro De Palma · Maruan Al-Shedivat · Pranav Rajpurkar · Matthew McDermott · Vincent Chen · Yanan Sui · Yun-Geun Lee · Li-Fang Cheng · Chen Fang · Sibt ul Hussain · Cesare Furlanello · Zeev Waks · Hiba Chougrad · Hedvig Kjellstrom · Finale Doshi-Velez · Wolfgang Fruehwirt · Yanqing Zhang · Lily Hu · Junfang Chen · Sunho Park · Gatis Mikelsons · Jumana Dakka · Stephanie Hyland · yann chevaleyre · Hyunwoo Lee · Xavier Giro-i-Nieto · David Kale · Michael Hughes · Gabriel Erion · Rishab Mehra · William Zame · Stojan Trajanovski · Prithwish Chakraborty · Kelly Peterson · Muktabh Mayank Srivastava · Amy Jin · Heliodoro Tejeda Lemus · Priyadip Ray · Tamas Madl · Joseph Futoma · Enhao Gong · Syed Rameel Ahmad · Eric Lei · Ferdinand Legros -
2013 Demonstration: Di-BOSS™: Digital Building Operating System Solution »
Jessica Forde · Vivek Rathod · Hooshmand Shookri · Vaibhav Bandari · Ashwath Rajan · John Min · Ariel Fan · Leon Wu · Ashish Gagneja · Doug Riecken · David Solomon · Lauren Hannah · Albert Boulanger · Roger Anderson