Senior / Lead Machine Learning Engineer, Serving - Serbia

Added
2 hours ago
Type
Full time
Salary
Salary not provided

Related skills

rust python kubernetes llm cuda

πŸ“‹ Description

  • Lead ML serving for real-time, agentic systems.
  • Optimize models and serving with vLLM and TRT-LLM.
  • Collaborate with US teams; containerize for production.
  • Scale to thousands of concurrent connections; ensure reliability.

🎯 Requirements

  • Inference optimization with vLLM or TRT-LLM.
  • Model acceleration: quantization, distillation, caching, and batching.
  • High-performance systems: C++, CUDA, Rust, or optimized Python; GPU profiling.
  • Distributed systems and scaling: Kubernetes, Ray; multi-GPU/multi-node inference.
  • Public work: open-source contributions or deep-dive technical writing.
  • PhD in CS/Physics/Math or equivalent; English fluency.

🎁 Benefits

  • Flat structure, fast iterations, minimal process theater.
  • Impactful work and open-source contributions.
  • Work is visible with US-based leadership collaboration.
  • Future relocation/US visa support may be available.
Share job

Meet JobCopilot: Your Personal AI Job Hunter

Automatically Apply to Engineering Jobs. Just set your preferences and Job Copilot will do the rest β€” finding, filtering, and applying while you focus on what matters.

Related Engineering Jobs

See more Engineering jobs β†’