Performance Modeling Engineer, AI Inference Deployments (Senior/Principal)

Added
18 minutes ago
Type
Full time
Salary
Upgrade to Premium to se...

Related skills

rust c capacity planning systems architecture performance modeling

πŸ“‹ Description

  • Partner with customers and product teams to translate deployment requirements into structured
  • Conduct objective, apples-to-apples performance comparisons between competing hardware platforms
  • Design, develop, and deliver a standalone performance-estimation tool that customers can use to
  • Build and maintain deployment-level performance models for large-scale inference systems
  • Evaluate the impact of batch sizes, context lengths, workload characteristics, and mixed hardware
  • Model network and system-level performance, including interconnect latency, bandwidth, topology

🎯 Requirements

  • At least 5 years of professional experience in performance modeling, capacity planning, systems
  • Demonstrated experience developing analytical or queueing-based performance models and calibrating
  • Deep understanding of large language model (LLM) inference at the systems level, including prefill
  • Strong knowledge of large-scale deployment architectures and the factors affecting inference
  • Solid understanding of data-center networking concepts, including interconnect latency, bandwidth
  • Good knowledge of GPU architecture and performance characteristics, with the ability to evaluate

🎁 Benefits

  • Competitive annual base salary based on experience and seniority
  • Competitive equity opportunities as part of the overall compensation package.
  • Flexibility to offer compensation above the stated salary ranges for candidates with exceptional
  • Fully company-paid medical, dental, and vision insurance for employees and their dependents.
  • Company-paid life and disability insurance, with additional voluntary coverage options.
  • Access to supplemental hospital, critical illness, and accident insurance.
Get alerts for new remote engineering jobs
A weekly email with new matches. Unsubscribe anytime.
Share job

Meet JobCopilot: Your Personal AI Job Hunter

Automatically Apply to Engineering Jobs. Just set your preferences and Job Copilot will do the rest β€” finding, filtering, and applying while you focus on what matters.

Related Engineering Jobs

See more Engineering jobs β†’