Python Inference Engineer

📋 Description

• Build and improve the inference layer of the Gcore Inference platform
• Integrate and operate inference frameworks such as vLLM, SGLang, NVIDIA Dynamo, and TensorRT-LLM
• Bring new language and multimodal models into production
• Improve inference latency, throughput, memory use, GPU utilization, and cost efficiency
• Debug performance and reliability issues across model code, inference frameworks, GPU execution
• Work with platform, infrastructure, product, and customer-facing teams to turn inference

🎯 Requirements

• 5+ years of experience writing reliable, well-tested production code
• Strong Python skills and experience designing production systems
• Hands-on experience with PyTorch and deploying machine learning models
• Experience with Linux, Docker, and Kubernetes
• Experience in at least one relevant area: distributed systems, GPU computing, ML runtimes, model
• Ability to debug complex problems across software, infrastructure, and hardware

🎁 Benefits

• Competitive compensation
• Flexible working hours and hybrid or remote options, depending on your role
• Work from anywhere in the world for up to 45 days per year
• Private medical insurance for you and your family*
• Extra paid vacation and sick leave days*
• Support for life’s important moments and celebrations