PyTorch at JSC¶
Please check out the recipe on using PyTorch at JSC in its own repository:
https://gitlab.jsc.fz-juelich.de/sdlaml/pytorch-at-jsc
The recipe demonstrates and explains how to make PyTorch work efficiently in two distributed settings (DDP and FSDP), while avoiding common pitfalls.