Timezone: »

MLSys: Workshop on Systems for ML and Open Source Software
Aparna Lakshmiratan · Sarah Bird · Siddhartha Sen · Joseph Gonzalez · Daniel Crankshaw

Fri Dec 07 05:00 AM -- 03:30 PM (PST) @ Room 510 ABCD
Event URL: http://learningsys.org/nips18/ »

This workshop is part two of a two-part series with one day focusing on ML for Systems and the other on Systems for ML. Although the two workshops are being led by different organizers, we are coordinating our call for papers to ensure that the workshops complement each other and that submitted papers are routed to the appropriate venue.

The ML for Systems workshop focuses on developing ML to optimize systems while we focus on designing systems to enable large scale ML with Systems for ML. Both fields are mature enough to warrant a dedicated workshop. Organizers on both sides are open to merging in the future, but this year we plan to run them separately on two different days.

A new area is emerging at the intersection of artificial intelligence, machine learning, and systems design. This has been accelerated by the explosive growth of diverse applications of ML in production, the continued growth in data volume, and the complexity of large-scale learning systems. The goal of this workshop is to bring together experts working at the crossroads of machine learning, system design and software engineering to explore the challenges faced when building large-scale ML systems. In particular, we aim to elicit new connections among these diverse fields, identifying theory, tools and design principles tailored to practical machine learning workflows. We also want to think about best practices for research in this area and how to evaluate it. The workshop will cover state of the art ML and AI platforms and algorithm toolkits (e.g. TensorFlow, PyTorch1.0, MXNet etc.), as well as dive into machine learning-focused developments in distributed learning platforms, programming languages, data structures, GPU processing, and other topics.

This workshop will follow the successful model we have previously run at ICML, NIPS and SOSP 2017.

Our plan is to run this workshop annually co-located with one ML venue and one Systems venue, to help build a strong community which we think will complement newer conferences like SysML targeting research at the intersection of systems and machine learning. We believe this dual approach will help to create a low barrier to participation for both communities.

Fri 6:00 a.m. - 6:15 a.m.
Welcome (Talk)
Sarah Bird
Fri 6:10 a.m. - 6:40 a.m.
Invited Talk (Bryan Catanzaro, NVidia) (Talk)
Fri 6:40 a.m. - 7:00 a.m.
Fashionable modeling with Flux (Talk)
Fri 7:00 a.m. - 7:20 a.m.
Model assertions for debugging machine learning (Talks)
Fri 7:20 a.m. - 8:40 a.m.
Poster Intro by OC + Poster Session (Chair: Sid Sen) (Break)
Fri 8:40 a.m. - 9:10 a.m.
Keynote 2: “Machine Learning at Netflix” (Aish Fenton ) (Talk)
Fri 9:10 a.m. - 9:30 a.m.
Parallel training of linear models (Talk)
Fri 9:30 a.m. - 11:55 a.m.
Lunch provided and Open Source ML Systems Showcase (TensorFlow, PyTorch 1.0, MxNET, Keras, CoreML, Ray, Chainer) (Talks)
Rajat Monga, Soumith Chintala, Thierry Moreau, Francois Chollet, Dan Crankshaw, Robert Nishihara, Seiya Tokui
Fri 11:55 a.m. - 12:40 p.m.
Posters (all accepted papers) + Break (Poster Session)
Jianyu Wang, Denis Gudovskiy, Ziheng Jiang, Michael Kaufmann, Andreea Anghel, James Bradbury, Nikolas Ioannou, Nitin Agrawal, Emma Tosch, Gyeong-In Yu, Keno Fischer, Jarrett Revels, Giuseppe Siracusano, Yaoqing Yang, Jeff Johnson, Yang You, Hector Yuen, Chris Ying, Honglei Liu, Nikoli Dryden, Xiangxi Mo, YZH Wang, Amit Juneja, Micah Smith, Qian Yu, pramod gupta, Deepak Narayanan, Keshav Santhanam, Tim Capes, Abdul Dakkak, Norman Mu, Ke Deng, Liam Li, Joao Carreira, Luis Remis, Deepti Raghavan, Una-May O'Reilly, Amanpreet Singh, Mido Assran, Eugene Wu, Eytan Bakshy, Jinliang Wei, Mike Innes, Viral Shah, Haibin Lin, Conrad Sanderson, Ryan Curtin, Marcus Edel
Fri 12:40 p.m. - 1:10 p.m.
Keynote 3: “Infrastructure and Systems for Applied Machine Learning at Facebook” (Kim Hazelwood) (Talk)
Fri 1:10 p.m. - 1:30 p.m.
HiveMind: Accelerating Deep Learning Workloads through Efficient Multi-Model Execution (Talk)
Fri 1:30 p.m. - 1:50 p.m.
Rethinking floating point for deep learning (Talk)
Fri 1:50 p.m. - 2:10 p.m.
A Case for Serverless Machine Learning (Talk)
Fri 2:10 p.m. - 2:20 p.m.
Closing Remarks (Talk)
Aparna Lakshmiratan

Author Information

Aparna Lakshmiratan (Facebook)

I am the PM lead for the AI Platform in Facebook AI (PyTorch 1.0, Data Tools and Developer Ecosystem) Before Facebook, I worked in Microsoft building and shipping several products including a new Click Prediction system for Bing Ads, several enhancements to the Speller and Query Alterations engine in Bing and most recently an interactive machine learning platform for non-experts at Microsoft Research. I have a PhD in Computer Science from MIT.

Sarah Bird (Facebook AI Research)

Sarah leads research and emerging technology strategy for Azure AI. Sarah works to accelerate the adoption and impact of AI by bringing together the latest innovations research with the best of open source and product expertise to create new tools and technologies. Sarah is currently leading the development of responsible AI tools in Azure Machine Learning. She is also an active member of the Microsoft AETHER committee, where she works to develop and drive company-wide adoption of responsible AI principles, best practices, and technologies. Sarah was one of the founding researchers in the Microsoft FATE research group and prior to joining Microsoft worked on AI fairness in Facebook. Sarah is active contributor to the open source ecosystem, she co-founded ONNX, an open source standard for machine learning models and was a leader in the Pytorch 1.0 project. She was an early member of the machine learning systems research community and has been active in growing and forming the community. She co-founded the SysML research conference and the Learning Systems workshops. She has a Ph.D. in computer science from UC Berkeley advised by Dave Patterson, Krste Asanovic, and Burton Smith.

Siddhartha Sen (Microsoft Research)
Joseph Gonzalez (UC Berkeley)
Dan Crankshaw (UC Berkeley RISE Lab)

More from the Same Authors