Model parallelism in Multi-GPUs
Hi everyone!
Does lightning has any way to split very large networks between GPUs like in the example in link?
https://discuss.pytorch.org/t/model-parallelism-in-multi-gpus-forward-backward-graph/27679/4
Thanks!