Orchestrate training across 1,000+ GPUs using PyTorch, DeepSpeed, or Megatron-LM.
Optimize InfiniBand/RDMA networking and memory to prevent OOM errors.
Automate checkpointing and recovery during long runs.

🎯 Requirements

Deep expertise in 3D parallelism: Data, Tensor, Pipeline.
Experience managing SLURM or Kubernetes GPU clusters.
Strong systems engineering background (C++, CUDA, Python).

Apply on employer's website

This employer gathers applications via their own applicant tracking system.

You will be redirected to an external application form.

Share job

Meet JobCopilot: Your Personal AI Job Hunter

Automatically Apply to Engineering Jobs. Just set your preferences and Job Copilot will do the rest — finding, filtering, and applying while you focus on what matters.

Activate JobCopilot