LLM Pre-training  Distributed Engineer (AI Infrastructure)

📋 Description

• Orchestrate distributed training across 1,000+ GPUs using PyTorch/DeepSpeed/Megatron-LM.
• Tune InfiniBand/RDMA networking and memory to prevent out-of-memory errors.
• Automate checkpointing and failure recovery during month-long training runs.

🎯 Requirements

• 3D parallelism (Data, Tensor, Pipeline).
• Experience managing SLURM or Kubernetes-based GPU clusters.
• Strong systems engineering background (C++, CUDA, Python).