Why is `accumulate_grad_batches` set to 1 for first epoch when the argument is provided as int?
🚀 Feature
Is there any reasons why is it set to 1 for first epoch?
I think it should be set to the number users specify because of a lot of confusing.
Alternatives
Change the key of schedule dict to 0 in training_tricks.py:
def configure_accumulated_gradients(self, accumulate_grad_batches):
    if isinstance(accumulate_grad_batches, dict):
        self.accumulation_scheduler = GradientAccumulationScheduler(accumulate_grad_batches)
    elif isinstance(accumulate_grad_batches, int):
        schedule = {1: accumulate_grad_batches}  # => schedule = {0: accumulate_grad_batches}
        self.accumulation_scheduler = GradientAccumulationScheduler(schedule)
    else:
        raise TypeError("Gradient accumulation supports only int and dict types")