A Little Help Goes a Long Way: Efficient LLM Training by Leveraging Small LMs
A. Rawat, Veeranjaneyulu Sadhanala, Afshin Rostamizadeh, Ayan Chakrabarti, Wittawat Jitkrittum, Vladimir Feinberg, Seungyeon Kim, Hrayr Harutyunyan, Nikunj Saunshi, Zachary Nado, Rakesh Shivanna, Sashank J. Reddi, A. Menon, Rohan Anil, Sanjiv Kumar
arXiv.org