Software Engineer, LLM Infrastructure

📋 Description

• Design scalable backend infrastructure for distributed training and inference
• Build and maintain core backend services: LLM CI/CD, control plane, and serving
• Improve performance, cost efficiency, and reliability across compute, storage, and networking
• Build frameworks and safeguards to ensure top model quality
• Collaborate with performance, training, and product teams to translate needs into infrastructure
• Participate in code reviews and CI/CD processes

🎯 Requirements

• Bachelor’s degree in CS, Engineering, or related field (or equivalent)
• 3 years of software engineering experience focused on infrastructure or ML systems
• Strong programming skills in Python, Go, or similar language
• Experience with ML infra and tooling (e.g., PyTorch, MLflow, Kubernetes)
• Basic understanding of LLM concepts (context length, KV cache, etc.)

🎁 Benefits

• Solve hard AI infra problems
• Work with bleeding-edge tech
• Ownership and impact in a fast-growing startup
• Learn from world-class engineers and researchers