Timezone: »
We present Placeto, a reinforcement learning (RL) approach to efficiently find device placements for distributed neural network training.
Unlike prior approaches that only find a device placement for a specific computation graph, Placeto can learn generalizable device placement policies that can be applied to any graph.
We propose two key ideas in our approach: (1) we represent the policy as performing iterative placement improvements, rather than outputting a placement in one shot; (2) we use graph embeddings to capture relevant information about the structure of the computation graph, without relying on node labels for indexing.
These ideas allow Placeto to train efficiently and generalize to unseen graphs.
Our experiments show that Placeto requires up to 6.1x fewer training steps to find placements that are on par with or better than the best placements found by prior approaches. Moreover, Placeto is able to learn a generalizable placement policy for any given family of graphs that can be used without any re-training to predict optimized placements for unseen graphs from the same family.
This eliminates the huge overhead incurred by the prior RL approaches whose lack of generalizability necessitates re-training from scratch every time a new graph is to be placed.
Author Information
Ravichandra Addanki (Massachusetts Institute of Technology)
Shaileshh Bojja Venkatakrishnan (Massachusetts Institute of Technology)
Shreyan Gupta (MIT)
Hongzi Mao (MIT)
Mohammad Alizadeh (Massachusetts Institute of Technology)
More from the Same Authors
-
2020 : Session A, Poster 2: Neural Large Neighborhood Search »
Ravichandra Addanki -
2020 : Session B, Poster 2: Neural Large Neighborhood Search »
Ravichandra Addanki -
2020 : Poster Session B »
Ravichandra Addanki · Andreea-Ioana Deac · Yujia Xie · Francesco Landolfi · Antoine Prouvost · Claudius Gros · Renzo Massobrio · Abhishek Cauligi · Simon Alford · Hanjun Dai · Alberto Franzin · Nitish Kumar Panigrahy · Brandon Kates · Iddo Drori · Taoan Huang · Zhou Zhou · Marin Vlastelica · Anselm Paulus · Aaron Zweig · Minsu Cho · Haiyan Yin · Michal Lisicki · Nan Jiang · Haoran Sun -
2020 : Poster Session A: 3:00 AM - 4:30 AM PST »
Taras Khakhulin · Ravichandra Addanki · Jinhwi Lee · Jungtaek Kim · Piotr Januszewski · Konrad Czechowski · Francesco Landolfi · Lovro Vrček · Oren Neumann · Claudius Gros · Betty Fabre · Lukas Faber · Lucas Anquetil · Alberto Franzin · Tommaso Bendinelli · Sergey Bartunov -
2020 Poster: High-Dimensional Contextual Policy Search with Unknown Context Rewards using Bayesian Optimization »
Qing Feng · Ben Letham · Hongzi Mao · Eytan Bakshy -
2020 Spotlight: High-Dimensional Contextual Policy Search with Unknown Context Rewards using Bayesian Optimization »
Qing Feng · Ben Letham · Hongzi Mao · Eytan Bakshy -
2019 : Invited Speaker: Mohammad Alizadeh »
Mohammad Alizadeh -
2019 : Poster Session 1 »
Hongzi Mao · Vikram Nathan · Ioana Baldini · Viswanath Sivakumar · Haonan Wang · Vinoj Yasanga Jayasundara Magalle Hewa · Zhan Shi · Samuel Kaufman · Joyce Fang · Giulio Zhou · Jialin Ding · Hao He · Miles Lubin -
2019 Poster: Park: An Open Platform for Learning-Augmented Computer Systems »
Hongzi Mao · Parimarjan Negi · Akshay Narayan · Hanrui Wang · Jiacheng Yang · Haonan Wang · Ryan Marcus · Ravichandra Addanki · Mehrdad Khani Shirkoohi · Songtao He · Vikram Nathan · Frank Cangialosi · Shaileshh Venkatakrishnan · Wei-Hung Weng · Song Han · Tim Kraska · Dr.Mohammad Alizadeh -
2018 : Poster Session (All Posters) »
Stephen Macke · Hongzi Mao · Caroline Lemieux · Saim Salman · Rishikesh Jha · Hanrui Wang · Shoumik P Palkar · Tianqi Chen · Thomas Pumir · Vaishnav Janardhan · adit bhardwaj · Ed Chi -
2018 : Poster Session (All Posters) »
Artemiy Margaritov · Ravichandra Addanki · Hamidreza Mahyar · GUO ZHANG · avani wildani · Hadi Esmaeilzadeh · Dmitrii Ustiugov · Shaileshh Bojja Venkatakrishnan · Fabian Ruffy Varga · adit bhardwaj · Tatiana Shpeisman -
2018 : Poster Session 1 + Coffee »
Tom Van de Wiele · Rui Zhao · J. Fernando Hernandez-Garcia · Fabio Pardo · Xian Yeow Lee · Xiaolin Andy Li · Marcin Andrychowicz · Jie Tang · Suraj Nair · Juhyeon Lee · Cédric Colas · S. M. Ali Eslami · Yen-Chen Wu · Stephen McAleer · Ryan Julian · Yang Xue · Matthia Sabatelli · Pranav Shyam · Alexandros Kalousis · Giovanni Montana · Emanuele Pesce · Felix Leibfried · Zhanpeng He · Chunxiao Liu · Yanjun Li · Yoshihide Sawada · Alexander Pashevich · Tejas Kulkarni · Keiran Paster · Luca Rigazio · Quan Vuong · Hyunggon Park · Minhae Kwon · Rivindu Weerasekera · Shamane Siriwardhanaa · Rui Wang · Ozsel Kilinc · Keith Ross · Yizhou Wang · Simon Schmitt · Thomas Anthony · Evan Cater · Forest Agostinelli · Tegg Sung · Shirou Maruyama · Alexander Shmakov · Devin Schwab · Mohammad Firouzi · Glen Berseth · Denis Osipychev · Jesse Farebrother · Jianlan Luo · William Agnew · Peter Vrancx · Jonathan Heek · Catalin Ionescu · Haiyan Yin · Megumi Miyashita · Nathan Jay · Noga H. Rotman · Sam Leroux · Shaileshh Bojja Venkatakrishnan · Henri Schmidt · Jack Terwilliger · Ishan Durugkar · Jonathan Sauder · David Kas · Arash Tavakoli · Alain-Sam Cohen · Philip Bontrager · Adam Lerer · Thomas Paine · Ahmed Khalifa · Ruben Rodriguez · Avi Singh · Yiming Zhang