Staff Software Engineer, AI Gateway

📋 Description

• Set technical direction for core systems powering the AI Gateway – the model router, MCP gateway
• Consistently identify gaps in our infrastructure, process, or tooling before they become blockers
• Take a significant, hands-on role in defining, delivering, and implementing the Gateway's technical
• Own the hardest, highest-ambiguity problems in the system: dynamic model selection, auto-failover
• Act as the go-to expert for secure credential storage, session summarization, caching, and rate
• Build the infrastructure that lets us, and our customers, evaluate, replay, and backtest agent and

🎯 Requirements

• 8+ years of backend engineering experience, with a track record of owning production-grade systems
• Deep specialization in distributed systems, cloud-native infrastructure, and API design –
• Experience building secure, high-throughput services (gateways, proxies, load balancers, policy
• Fluency in Go and/or Rust
• A track record of identifying systemic gaps – in architecture, process, or tooling – and driving
• A strong product mindset, with real experience shaping technical direction rather than only

🎁 Benefits

• Remote-first by design – Work from your home, with offices in Seattle and Paris for connection and
• Flexibility that fits your life – We trust you to manage your schedule while delivering great work
• Time to recharge – Generous PTO, designated quarterly Whaleness Days, and a designated end-of-year
• Home office support – Set up your workspace for comfort and success
• Technology stipend – Equivalent to US$100 net per month to help support your work
• Learning & development – Annual stipend for conferences, courses, certifications, and continued