Software Python Engineer (Inference)

📋 Description

• Build and improve the inference layer of the Gcore Inference platform.
• Integrate and operate inference frameworks such as vLLM, SGLang, NVIDIA Dynamo, and TensorRT-LLM.
• Bring new language and multimodal models into production.
• Improve inference latency, throughput, memory use, GPU utilization, and cost efficiency.
• Debug performance and reliability issues across model code, inference frameworks, GPU execution
• Work with platform, infrastructure, product, and customer-facing teams to turn inference

🎯 Requirements

• 5+ years of experience writing reliable, well-tested production code.
• Strong Python skills and experience designing production systems.
• Hands-on experience with PyTorch and deploying machine learning models.
• Experience with Linux, Docker, and Kubernetes.
• Experience in at least one relevant area: distributed systems, GPU computing, ML runtimes, model
• Ability to debug complex problems across software, infrastructure, and hardware.

🎁 Benefits

• Competitive compensation
• Flexible working hours and hybrid or remote options
• Work from anywhere in the world for up to 45 days per year
• Private medical insurance for you and your family*
• Extra paid vacation and sick leave days*
• Support for life’s important moments and celebrations