Senior AI Research Engineer - LLM Training & Inference Infrastructure

Added
13 days ago
Type
Full time
Salary
Salary not provided

Related skills

rust python kubernetes go llm

📋 Description

  • Design, build, and operate distributed training and inference infrastructure for large language
  • Scale training with parallelism strategies (data, tensor, pipeline, and expert), memory
  • Build inference and rollout systems that support evaluation, experimentation, and RL without
  • Build execution environments and sandboxes for online RL and agent post-training
  • Own continuous performance validation: regular benchmarks of rollout speed, training throughput
  • Improve the researcher experience: job submission, scheduling, quotas, GPU utilization, and

🎯 Requirements

  • You have depth in distributed systems and ML infrastructure for training and inference at scale
  • You are proficient in Python and in at least one systems language (e.g., Rust, C++, or Go)
  • You have experience operating large-scale training or serving infrastructure, or schedulers and
  • You understand what limits throughput/latency in distributed inference workloads: communication
  • You have strong debugging, profiling, and incident-diagnosis skills, ideally including on-call
  • You can explain design and performance trade-offs clearly to both technical and non-technical

🎁 Benefits

  • Competitive global benefits
  • New hire stock equity (RSUs) and employee stock purchase plan (ESPP)
  • Opportunity to collaborate closely with colleagues across the Datadog offices in New York City and
  • Opportunity to attend and present at conferences and meetups
  • Intra-departmental mentor and buddy program for in-house networking
  • An inclusive company culture, ability to join our Community Guilds (Datadog employee resource
Get alerts for new remote engineering jobs
A weekly email with new matches. Unsubscribe anytime.
Share job

Meet JobCopilot: Your Personal AI Job Hunter

Automatically Apply to Engineering Jobs. Just set your preferences and Job Copilot will do the rest — finding, filtering, and applying while you focus on what matters.

Related Engineering Jobs

See more Engineering jobs →