Hyphen Connect logo
Hyphen Connect

LLM Pre-training & Distributed Engineer (AI Infrastructure)

On site
Engineering
Added
25 minutes ago
Location
Type
Full time
Salary
Salary not provided
Save Job

Related skills

python kubernetes pytorch deepspeed cuda

📋 Description

  • Orchestrate distributed training across 1,000+ GPUs using PyTorch, DeepSpeed, or Megatron-LM.
  • Optimize networking (InfiniBand/RDMA) and memory management to prevent OOM.
  • Automate checkpointing and failure recovery during long training runs.

🎯 Requirements

  • Deep expertise in 3D parallelism (Data, Tensor, Pipeline).
  • Experience managing SLURM or Kubernetes-based GPU clusters.
  • Strong systems engineering background (C++, CUDA, Python).
Apply on employer's website
This employer gathers applications via their own applicant tracking system.
You will be redirected to an external application form.
Share job

Meet JobCopilot: Your Personal AI Job Hunter

Automatically Apply to Engineering Jobs. Just set your preferences and Job Copilot will do the rest — finding, filtering, and applying while you focus on what matters.
Activate JobCopilot

Related Engineering Jobs

See more Engineering jobs →