Senior Research Engineer

📋 Description

• Raise the team's experimental velocity — make it faster to launch an experiment job, get a number
• Maintain and evolve our JAX training framework, keeping it scalable and efficient for large-scale
• Improve the data our models learn from: investigating quality issues, building the tooling to
• Analyze the accuracy of production models, build evaluation harnesses, and work out which
• Translate research prototypes into production-ready systems, refactoring and modernizing model
• Optimize production inference for speech language models, both from a serving architecture

🎯 Requirements

• Expert-level proficiency with JAX and TPUs, including the surrounding ecosystem (Flax, Optax, the
• Measurement discipline. You define what success looks like before you start, you stay skeptical of
• Appetite for the whole pipeline. Your core strength might be JAX and TPU performance, but when a
• Strong experience optimizing inference systems for production, ideally with LLMs or speech models.
• Deep understanding of distributed training at scale, modern deep learning systems, and ML
• Familiarity with modern inference optimization techniques: continuous batching, KV-cache

🎁 Benefits

• Salary range: $270,000 - $310,000
• Pay equity for our team
• Competitive compensation, benefit, and other reward opportunities