Testing metrics on all batches and all ranks
What is your question?
I don't understand why under the comment "check on all batches on all ranks" in function _class_test only NUM_BATCHES examples are taken whereas all preds and targets contain NUM_BATCHES * worldsize examples.
Thank you very much for your help and excuse me if the question is stupid.