Staff / Sr. Staff Engineer, AI Gateway

Added
9 days ago
Type
Full time
Salary
Salary not provided

Related skills

grpc golang docker python kubernetes

πŸ“‹ Description

  • Architect, build, and scale core AI Gateway solutions, backend services, and high-throughput APIs
  • Write highly concurrent, robust, and maintainable software primarily in Golang
  • Integrate AI and agent-based tooling into daily development workflow; audit and validate
  • Design for scale and resilience, handling streaming LLM responses and complex proxy routing
  • Partner with global engineering, AI researchers, and product teams to translate AI features into
  • Drive technical culture through architectural reviews, code reviews, and mentorship

🎯 Requirements

  • 8-10+ years in software engineering, with at least 5+ years in backend development, cloud-native
  • Exceptional programming skills in Golang or Python; ability to write modular, production-grade code
  • Experience using advanced LLM-based coding agents; ability to identify and catch AI-generated errors
  • Expertise in microservices architecture, RESTful/gRPC API design, distributed system trade-offs
  • Deep understanding of Layer 4-7 networking: proxies, HTTP/S, TLS interception, DNS, TCP/IP, load
  • Hands-on experience with Docker/Kubernetes, including networking, service discovery, and deployment
Share job

Meet JobCopilot: Your Personal AI Job Hunter

Automatically Apply to Engineering Jobs. Just set your preferences and Job Copilot will do the rest β€” finding, filtering, and applying while you focus on what matters.

Related Engineering Jobs

See more Engineering jobs β†’