Software Engineer II - Serverless Inference

Added
30 days ago
Type
Full time
Salary
Salary not provided

Related skills

kubernetes microservices go observability triton

๐Ÿ“‹ Description

  • Design and build scalable, multi-tenant services for AI inference and routing.
  • Develop and operate high-scale distributed systems with reliability and performance.
  • Improve observability, capacity management, automation, and tooling.
  • Collaborate with platform, GPU infra, and product teams to deliver APIs.
  • Raise engineering discipline through design, incident management, and improvement.
  • Contribute to architecture decisions on traffic, service orchestration, and scalability.

๐ŸŽฏ Requirements

  • 2+ years building and operating multi-tenant platforms or distributed backends
  • Experience operating high-scale distributed services in production
  • Deep understanding of SRE: observability, incident management, reliability, and automation
  • 1+ years of Go / Golang in production systems
  • 1+ years of Kubernetes experience
  • Strong knowledge of cloud-native architectures and microservices

๐ŸŽ Benefits

  • Career development resources and training
  • Well-being benefits and flexible time off
  • Competitive pay and equity; bonus potential
  • Equal opportunity employer
Share job

Meet JobCopilot: Your Personal AI Job Hunter

Automatically Apply to Engineering Jobs. Just set your preferences and Job Copilot will do the rest โ€” finding, filtering, and applying while you focus on what matters.

Related Engineering Jobs

See more Engineering jobs โ†’