Checkpoint is saving the model based on the last val_metric_step value and not val_metric_epoch
🐛 Bug
Checkpoint callback did not save some models even thought they achieved better result in the monitored metric, than the currently top k saved models
Expected behavior
Checkpoint callback saving the best scoring models based on a metric
Environment
I am using pytorch-lightning 1.0.2
Update:
I changed the checkpoint call back to add the value I am monitoring to the name of the saved checkpoint, what I notice it's not the epoch value, but the last step in the epoch value, so it's not taking the metric average value, but taking only the last one.