Add an option to disable Trainer.detect_nan_tensors
🚀 Feature
Add an option to disable Trainer.detect_nan_tensors
Motivation
This function tends to be pretty slow when your network has got a lot of parameters, especially in small tensors. For example in my case it took ~0.5s per training iteration.
Pitch
Add an option to the Trainer class that disables calling detect_nan_tensors every epoch.
Alternatives
Remove it all together. Bad idea.
Additional context