Senior Software Engineer (AI Inference & Runtime Platform)

Added
21 days ago
Type
Full time
Salary
Upgrade to Premium to se...

Related skills

rust terraform python kubernetes ai

πŸ“‹ Description

  • Manage the model-serving infrastructure for open-weight large language models, including
  • Operate and improve the Kubernetes infrastructure supporting inference and sandbox workloads
  • Own the stateful data plane end to end, ensuring reliable operation, documented recovery
  • Develop and maintain the secure agent-sandboxing runtime and host-side control plane, covering
  • Build and maintain FastAPI control-plane services, infrastructure-as-code configurations using
  • Provide the infrastructure foundation used by backend engineering teams, collaborating across

🎯 Requirements

  • At least 5 years of experience delivering production systems using a systems programming language.
  • Solid understanding of asynchronous runtimes, memory safety, and low-level debugging, including
  • Hands-on experience operating Kubernetes workloads that other teams depend on, including
  • Proven ability to threat-model isolation boundaries involving technologies such as namespaces
  • Practical knowledge of secure AI-agent execution, including least-privilege access, preventing
  • Experience deploying or operating open-weight LLM inference infrastructure, such as vLLM, SGLang

🎁 Benefits

  • Salary: $140,000–$230,000, with compensation determined by experience, capabilities, and location.
  • Equity: Equity participation in an early-stage company.
  • Bonus: Eligibility for performance-related bonus compensation.
  • Healthcare: Health insurance with meaningful coverage for dependents.
  • Flexible time off: Paid time off designed to support flexibility and work-life balance.
  • Remote work: Fully remote working culture, with a cluster of teammates based in Seattle.
Get alerts for new remote engineering jobs
A weekly email with new matches. Unsubscribe anytime.
Share job

Meet JobCopilot: Your Personal AI Job Hunter

Automatically Apply to Engineering Jobs. Just set your preferences and Job Copilot will do the rest β€” finding, filtering, and applying while you focus on what matters.

Related Engineering Jobs

See more Engineering jobs β†’