Lower parity tests
🐛 Bug
We have observed that the trainer reached the initial threshold for parity
Note that we are still almost the same fast, but we may find some weeks spots
Please reproduce using
see GPU tests in the benchmark folder
Additional context
actual version 1.0.7 has avg diff 0.84s