Lead/Senior Inference Engineer

Added
12 minutes ago
Type
Full time
Salary
Upgrade to Premium to se...

Related skills

rust kubernetes go gpu triton

πŸ“‹ Description

  • Build, maintain, and operate production-grade model-serving infrastructure supporting large-scale
  • Implement and optimize inference techniques, including batching, caching, quantization, and
  • Strengthen platform observability, monitoring, and operational visibility as traffic volumes and
  • Develop the operational and compliance foundations required for production growth, including
  • Establish cost-tracking and attribution mechanisms that support financial planning, as well as
  • Evaluate and document trade-offs between cost, latency, and reliability, communicating technical

🎯 Requirements

  • Hands-on infrastructure engineering experience with Kubernetes or comparable technologies
  • Experience operating and maintaining model services across different workloads, including peak
  • Direct experience with model-serving infrastructure and/or inference optimization for large
  • Strong background in large-scale distributed systems, particularly production scalability
  • Proven ability to troubleshoot distributed systems and resolve production incidents under real
  • Demonstrated experience delivering software end to end, from technical design and implementation

🎁 Benefits

  • Competitive compensation: CAD $140,000–$175,000 annual base salary for Ontario, Canada.
  • Potential eligibility for an annual performance bonus based on individual and organizational
  • Comprehensive benefits and wellbeing programs, including retirement savings, flexible vacation, and
  • Flexible work arrangements, including the possibility of working from anywhere for up to eight
  • Two company-wide mental health days annually and access to the Headspace app.
  • Learning and career development opportunities, including skills development and tuition
Get alerts for new remote engineering jobs
A weekly email with new matches. Unsubscribe anytime.
Share job

Meet JobCopilot: Your Personal AI Job Hunter

Automatically Apply to Engineering Jobs. Just set your preferences and Job Copilot will do the rest β€” finding, filtering, and applying while you focus on what matters.

Related Engineering Jobs

See more Engineering jobs β†’