Simultaneously run multiple optimizers
Current optimizers are run sequentially.
However, there are cases that two optimizers are used optimized different parts of the network, for example, a CNN+LSTM. one would want CNN to be updated SGD and LSTM to be updated Adam.