Principal Software Engineer

📋 Description

• Own the architecture across the AI gateway, control plane, model serving, identity, metering and
• Lead the gateway strategy, including the data plane choice and policy-based routing with
• Set direction for LLM serving on Kubernetes: GPU scheduling and sharing, autoscaling, multi-tenant
• Define how enterprises run the product: Helm installs and upgrades, air-gapped networks, preflight
• Run design reviews, make build vs. buy calls, and record decisions as ADRs.
• Build hands-on in the critical path, and mentor senior engineers, including on AI-assisted

🎯 Requirements

• 10+ years in infrastructure or distributed systems, including several as technical lead.
• Shipped multi-service systems that enterprises run in production, including software they install
• Expert Kubernetes: operators, CRDs, scheduling, Helm, and debugging at scale.
• Production experience with GPU workloads, LLM inference or AI gateways
• Expert Go, strong Python, and solid CI/CD and infrastructure as code.
• Leads through writing and influence, uses AI-assisted development tools fluently, and thrives with

🎁 Benefits

• Work with an established leader in the cloud infrastructure industry.
• Work with exceptionally passionate, talented and engaging colleagues, helping Fortune 500 and
• Be a part of cutting-edge, open-source innovation.
• Thrive in the high-energy environment of a young company where openness, collaboration
• Receive a competitive compensation package with strong benefits plan.
• We are a Leader for Container Management in G2 (#2 after AWS)!