Distributed training with Ray Train DLCs and EFA on EKS | Amazon Web Services
The Ray Train Deep Learning Container ships the full CUDA-through-EFA stack, so you build no image. This post walks through a reproducible sample that fine-tunes Qwen2.5-1.5B with PyTorch FSDP across eight GPUs on two EFA-enabled g6.12xlarge instances on Amazon EKS, using the container exactly as published.
Amazon Web Services ยท https://www.facebook.com/amazonwebservices
Topics: Infrastructure
Entities: Infrastructure