Questions about GPUStatsMonitor callback and GPU utilization
I'm logging the GPU activity using the default values. I'm getting the following plots on my tensorboard:

A couple of questions:

Is the utilization really zero at specific time points (jigsaw) or is it just plotting zero's in-between epochs?
If my utilization is really zero at specific points, how can I make sure this doesn't happen? What about memory utlization?
As you can see in the first two graphs, the memory allocation is above 75%, but the memory utilization shows 16-18%. Why do these two numbers don't correspond?
Is there a similar callback for CPU? E.g.:If I want to check CPU utilization in-between training cycles (e.g.: to check data loader preparation)
Any recommendations on how to set num_workers on an 8-GPU system?

Thanks!