Forward Deployed Engineer, Inference

📋 Description

• Embed directly with customer engineering teams to architect the connective tissue between AI models
• Design advanced model serving topologies, implementing multi-tenant architectures, intelligent
• Optimize AI-in-a-box and private deployments, balancing localized SRE constraints like Kubernetes
• Conduct rigorous benchmarking and profiling of customer LLM workloads, root-causing performance
• Accelerate hardware validation, collaborating with clients to run and support Cohere models on
• Translate complex field friction into platform upgrades, delivering prescriptive feedback and

🎯 Requirements

• 8+ years of engineering experience running production infrastructure, designing large-scale
• Deep technical depth in production Kubernetes, including orchestration across multi-cluster and
• Strong understanding of LLM architecture and inference dynamics, specifically how attention
• Hands-on experience with modern inference engines and optimization stacks (e.g., vLLM
• Familiarity with distributed serving techniques, such as prefill/decode disaggregated serving
• Exceptional customer-facing technical leadership, with a proven track record of scoping highly

🎁 Benefits

• A weekly lunch stipend of $75/£75 or equivalent in your local currency for lunch.
• Full health and dental benefits, including a separate budget for mental health.
• RRSP matching, 401K, Pension Scheme.
• 100% Parental Leave top-up for up to 6 months, for either parent.
• Annual enrichment benefits: Arts & culture, fitness/wellness, quality time, and a workspace
• 6 weeks of paid vacation (30 working days!).