Efficient Algorithms for Device Placement of DNN Graph Operators
Jakub M. Tarnawski,Amar Phanishayee,Nikhil Devanur,Divya Mahajan,Fanny Nina Paravecino
In this paper, we identify and isolate the structured optimization problem at the core of device placement of DNN operators, for both inference and training, especially in modern pipelined settings. We then provide algorithms that solve this problem to optimality. We demonstrate the applicability and efficiency of our approaches using several contemporary DNN computation graphs.
