Senior Software Engineer, AI Gateway

📋 Description

• Design and implement core systems powering the AI Gateway, including the model router, MCP gateway
• Build infrastructure that supports dynamic model selection/routing, auto-failover, cost-based
• Own critical capabilities such as secure credential storage, session summarization, caching, and
• Develop APIs for developers building with OpenAI-compatible interfaces and the Model Context
• Build the underlying infrastructure to support evaluation, telemetry, replay, and backtesting for
• Lead architectural decisions and mentor engineers as the team scales

🎯 Requirements

• 6+ years of backend engineering experience with production-grade systems
• Deep knowledge of distributed and highly scalable systems, cloud-native infrastructure, and API
• Experience building secure, high-throughput services (e.g., gateways, proxies, load balancers
• Fluency in Go, and/or Rust (both preferred)
• Familiarity with AI/ML platforms or model serving infrastructure
• A strong product mindset—you're excited about building developer-facing tools

🎁 Benefits

• Remote-first by design – Work from your home, with offices in Seattle and Paris for connection and
• Flexibility that fits your life – We trust you to manage your schedule while delivering great work.
• Time to recharge – Generous PTO, designated quarterly Whaleness Days, and a designated end-of-year
• Home office support – Set up your workspace for comfort and success.
• Technology stipend – Equivalent to US$100 net per month to help support your work.
• Learning & development – Annual stipend for conferences, courses, certifications, and continued