learning rate warmup
What is the most appropriate way to add learning rate warmup ?
I am thinking about using the hooks. def on_batch_end(self):, but not sure where to put this function to ? Thank you.