Efficiently Scaling Transformer Inference
Reiner Pope, Sholto Douglas, A. Chowdhery, Jacob Devlin, James Bradbury, Anselm Levskaya, J. Heek, Kefan Xiao, Shivani Agrawal, J. Dean
Conference on Machine Learning and Systems