set_epoch isn't called for TPU training
🐛 Bug
This line https://github.com/PyTorchLightning/pytorch-lightning/blob/master/pytorch_lightning/trainer/training_loop.py#L350 doesn't call set_epoch when training on TPUs unless using self.use_horovod as self.use_ddp is False.