Allow optimizers to alternate at arbitrary intervals
For GANs or similar approaches, we may want optimizer A to step every batch while optimizer B might step every k batches.
This feature will enable this behavior.
Approach still needs to be scoped out. Open to suggestions here.