Regression between Lightning 1.1.3 and 1.1.5
🐛 Bug
Posted originally by @okuchaiev:
Has anyone observed a model performance degradation when switching from 1.1.3 to 1.1.4 and 1.1.5? On the plot below you can see exactly the same model/hyperparams trained using 1.1.3 (runs named enes3) and 1.1.5 (runs named enes5). You can see that 1.1.3 outperforms 1.1.5 consistently.

Please reproduce using the BoringModel
Currently not reproduced.
cc @ericharper