Product Manager, Inference Platform

Added
11 days ago
Type
Full time
Salary
Upgrade to Premium to se...

Related skills

product management python pytorch gpu inference
JobCopilot logo
Meet JobCopilot: Your Personal Al Job Hunter
Automatically Apply to Your Dream Jobs While You Sleep
Try it now β†’

πŸ“‹ Description

  • Work with inference engineering and research teams to bring new performance capabilities to
  • Translate advances in batching, caching, quantization, speculative decoding, and serving
  • Define benchmarks and evaluations that demonstrate meaningful improvements in latency, throughput
  • Understand customer workloads and help prioritize the optimizations that will have the greatest
  • Make performance features easier to configure, evaluate, and adopt in production.
  • Help customers understand tradeoffs across hardware, model configurations, autoscaling, and routing.

🎯 Requirements

  • Experience building and shipping AI/ML products or infrastructure, particularly where performance
  • A technical background in software engineering, ML engineering, research, or equivalent hands-on
  • Strong understanding of model serving architectures, GPU economics, and latency, throughput
  • Experience working closely with researchers or infrastructure engineers to bring technically
  • A rigorous approach to benchmarking, experimentation, and performance measurement.
  • Strong product judgment and the ability to translate deep technical work into clear customer value.

🎁 Benefits

  • Competitive compensation, including meaningful equity
  • (U.S. only) 100% coverage of medical, dental, and vision insurance for employee and dependents
  • Flexible PTO policy including company wide Winter Break (our offices are closed from Christmas Eve
  • Paid parental leave
  • Fertility and family-building stipend through Carrot
  • (U.S. only) Company-facilitated 401(k)

πŸ›ƒ Visa sponsorship

Get alerts for new remote product jobs
A weekly email with new matches. Unsubscribe anytime.
Share job

Meet JobCopilot: Your Personal AI Job Hunter

Automatically Apply to Product Jobs. Just set your preferences and Job Copilot will do the rest β€” finding, filtering, and applying while you focus on what matters.

Related Product Jobs

See more Product jobs β†’