Log debug information to a file
🚀 Feature
Create a log file for each run with debug information.
Motivation
User can read the logs and understand in which order things got executed. For example, logs could contain this information:
prepare_data_called
setup called
started train loop
training step called
backward called
zero grad called
etc...
Pitch
Use Python logging and redirect all messages with level "debug" to a file in e.g. the logger folder.
Additional context
Suggested by @williamFalcon in a slack discussion.