Senior Software Engineer II, Inference

Added
13 minutes ago
Type
Full time
Salary
Upgrade to Premium to se...

Related skills

grafana prometheus python kubernetes go

πŸ“‹ Description

  • Lead design reviews and drive architecture within the team; decompose multi-service work into clear
  • Define and own SLIs/SLOs; ensure post-incident actions land and reliability improves
  • Implement advanced optimizations (e.g., micro-batch schedulers, speculative decoding, KV-cache
  • Strengthen incident posture: capacity planning, autoscaling policy, graceful degradation
  • Mentor IC1/IC2 engineers; review cross-team designs and elevate coding/testing standards.
  • For IC4: own an area spanning multiple services and teams (e.g., request routing & adaptive

🎯 Requirements

  • IC3: ~3–5 years; IC4: ~5–8 years industry experience building distributed systems or cloud services.
  • Strong coding in Python or Go (C++ a plus) and deep familiarity with networked systems and
  • Hands-on experience with Kubernetes at production scale, CI/CD, and observability stacks
  • Practical knowledge of inference internals: batching, caching, mixed precision (BF16/FP8)
  • Proven track record improving tail latency (P95/P99) and service reliability through metrics-driven
  • Bachelor's or Master's in Computer Science or related field (or equivalent practical experience).

🎁 Benefits

  • Medical, dental, and vision insurance - 100% paid for by CoreWeave
  • Company-paid Life Insurance
  • Voluntary supplemental life insurance
  • Short and long-term disability insurance
  • Flexible Spending Account
  • Health Savings Account
Get alerts for new remote engineering jobs
A weekly email with new matches. Unsubscribe anytime.
Share job

Meet JobCopilot: Your Personal AI Job Hunter

Automatically Apply to Engineering Jobs. Just set your preferences and Job Copilot will do the rest β€” finding, filtering, and applying while you focus on what matters.

Related Engineering Jobs

See more Engineering jobs β†’