Software Engineer - Inference Product

Added
1 hour ago
Type
Full time
Salary
Upgrade to Premium to se...

Related skills

billing kubernetes distributed systems api authentication

πŸ“‹ Description

  • Build and operate the API layer behind Model APIs: request handling, authentication, rate limiting
  • Own usage metering and billing infrastructure: accurate, real-time accounting for every request
  • Build the rate-limiting and capacity systems that balance customer throughput against fleet
  • Ship new products at the API layer that change how developers use models, from routing across
  • Turn platform capabilities into a strong product experience: usage visibility, self-serve controls
  • Instrument the edge with deep observability and alerting, so issues are caught and fixed before

🎯 Requirements

  • Bachelor's, Master's, or Ph.D. in Computer Science, Engineering, or a related field, or equivalent
  • 3+ years building and operating distributed systems, backend infrastructure, or large-scale APIs
  • A proven track record of owning low-latency, reliable backend services, including rate limiting
  • Infrastructure instincts with a feel for performance: profiling, tracing, capacity planning, and
  • Comfort debugging performance and reliability issues across multiple layers of the stack, from
  • A strong sense of developer experience. You think about how systems are used, not just how they

🎁 Benefits

  • Competitive compensation, including meaningful equity
  • (U.S. only) 100% coverage of medical, dental, and vision insurance for employee and dependents
  • Flexible PTO policy including company wide Winter Break (our offices are closed from Christmas Eve
  • Paid parental leave
  • Fertility and family-building stipend through Carrot
  • (U.S. only) Company-facilitated 401(k)
Get alerts for new remote engineering jobs
A weekly email with new matches. Unsubscribe anytime.
Share job

Meet JobCopilot: Your Personal AI Job Hunter

Automatically Apply to Engineering Jobs. Just set your preferences and Job Copilot will do the rest β€” finding, filtering, and applying while you focus on what matters.

Related Engineering Jobs

See more Engineering jobs β†’