Member of Technical Staff | Inference Platform

📋 Description

• Evolve Sophos, our online and batch inference runtime, built on Kubernetes
• Run large batch inference on ephemeral jobs, with multi-dimensional admission control (CPU, memory
• Build and extend the Sophos controller and its Kubernetes custom resources
• Optimize each model's inference engine and feature processing, using vectorized, columnar operations
• Serve graphs and data efficiently from Lance-based storage
• Own execution of training, post-training, and fine-tuning jobs, in our cloud and in customer

🎯 Requirements

• Experience running model serving or large-scale batch compute on Kubernetes
• Experience building Kubernetes controllers or operators
• Skill at profiling and optimizing data-heavy Python pipelines
• A clear sense of cost: treat compute efficiency as a product feature
• Production-quality code and reviews, and a willingness to operate what you build
• Nice to have: Ray, Ray Serve, or KubeRay in production

🎁 Benefits

• Own systems and outcomes, not steps in a function
• Seniority shows up in scope, level, and compensation