Adding NVIDIA-SMI like information
🚀 Feature

Add the GPU usage information during training.

Motivation
Most of the research is done on HPC. Therefore, if I want to see the GPU RAM and usage of my job, I have to open a secondary screen to run "watch nvidia-smi" or "nvidia-smi dmon".
Have this info saved in the logs will help to:

See if I have space for larger batches
Report the correct resources needed to replicate my experiment.

Pitch
When training starts, report the GPU RAM and the GPU usage together with loss and v_num
Alternatives
After the first epoch is loaded into the GPU, log the GPU RAM and the GPU usage
Additional context