Senior Systems Engineer, AI Gateway

Added
13 days ago
Type
Full time
Salary
Salary not provided

Related skills

rust distributed systems go typescript ai

πŸ“‹ Description

  • Build core AI Gateway systems handling high-volume inference across providers.
  • Design and implement APIs, routing, observability, and developer workflows.
  • Collaborate across product and infra with Workers AI, Agents, and Developer Platform.
  • Turn ideas into prototypes, design docs, shipped features, and measurable improvements.
  • Improve reliability, performance, cost efficiency, and debuggability for latency-sensitive AI workloads.
  • Build the software and the software that builds it: agents, tests, harnesses, tools.

🎯 Requirements

  • 5+ years building and operating production AI/infrastructure systems.
  • Strong systems fundamentals: networking, APIs, reliability, observability.
  • Experience designing or scaling distributed systems for latency and throughput.
  • Cross-stack work from API design to backend services and storage.
  • Strong developer tools taste: APIs, SDKs, dashboards, CLIs, docs.
  • Clear technical communication: design docs, tradeoffs, reviews.
Share job

Meet JobCopilot: Your Personal AI Job Hunter

Automatically Apply to Engineering Jobs. Just set your preferences and Job Copilot will do the rest β€” finding, filtering, and applying while you focus on what matters.

Related Engineering Jobs

See more Engineering jobs β†’