Weird DP behaviour on AWS P2 16xlarge with Wandb Logger
❓ Questions and Help
Before asking:

search the issues.
search the docs.


What is your question?
Wandb Logger seems to not log all steps.
AWS P2 16xLarge has 16 K80s on 1 node.
I am using dp distrib mode.
Code
My training steps:
    def training_step(self, batch, batch_idx):
        loss, logits, *_ = self(batch)
        output = {"loss": loss, "log": {"loss": loss}}
        return output

My logs:

When I change my training_step to explicitly log metrics, all works again:
    def training_step(self, batch, batch_idx):
        loss, logits, *_ = self(batch)
        self.logger.log_metrics({"loss": loss.cpu()})
        output = {"loss": loss}
        return output


What's your environment?

OS: [e.g. iOS, Linux, Win]: Linux
Packaging [e.g. pip, conda]: Pip
Version [e.g. 0.5.2.1]: 0.8.0