Senior AI Infrastructure Engineer

Added
4 hours ago
Type
Full time
Salary
Upgrade to Premium to se...

Related skills

sql python go apis llm
JobCopilot logo
Meet JobCopilot: Your Personal Al Job Hunter
Automatically Apply to Your Dream Jobs While You Sleep
Try it now β†’

πŸ“‹ Description

  • Design and operate production-grade AI infrastructure for reliable agent-based experiences.
  • Build multi-tenant AI infra with isolation, rate limiting, and caller attribution.
  • Develop durable agent runtimes for long-running workflows and failure recovery.
  • Create advanced agent orchestration with context management, memory, and tools.
  • Establish evaluation-driven development with automated testing and quality gates.
  • Build API-first infra and LLM abstraction layers enabling AI-powered apps.

🎯 Requirements

  • 6+ years of software engineering, incl. 1+ year in AI/ML infra, LLM or agentic systems.
  • Go backend proficiency; Python and SQL experience.
  • Experience designing, building, operating production APIs and developer platforms at scale.
  • Strong understanding of multi-tenant architectures, including rate limiting and tenant isolation.
  • Hands-on experience with LLM APIs (OpenAI or Anthropic), including prompt engineering and function/tool calling.
  • Practical experience building agent workflows with context management, state handling, and multi-step execution.

🎁 Benefits

  • Equity participation opportunities.
  • Fully remote work within the United States.
  • Flexible and discretionary paid time off.
  • Company-wide spring, summer, and winter breaks.
  • Comprehensive medical, dental, and vision insurance.
  • 401(k) retirement plan with employer matching.
Share job

Meet JobCopilot: Your Personal AI Job Hunter

Automatically Apply to Engineering Jobs. Just set your preferences and Job Copilot will do the rest β€” finding, filtering, and applying while you focus on what matters.

Related Engineering Jobs

See more Engineering jobs β†’