Senior IA Inference Engineer (x/f/m)

📋 Description

• Build the shared LLM serving foundations with MLOps engineers — define the serving stack, GPU
• Own the model registry and promotion path — establish clear processes for versioning, validating
• Optimize inference performance and efficiency — operate and tune serving engines (vLLM, Triton
• Own production reliability and disaster recovery — define SLOs, run load tests before launches
• Make serving performance and costs measurable — build Datadog dashboards, alerting, and cost
• Keep the inference stack secure, compliant, and evolving — work with Security and Privacy on

🎯 Requirements

• Have 5+ years of software or computer engineering experience, including hands-on production
• Are proficient in Python and Terraform, with a solid understanding of transformer inference
• Have strong experience running GPU workloads on Kubernetes or a managed Ray / Anyscale platform
• Are comfortable owning production reliability: observability, incident response, and on-call are a
• Have excellent communication and collaboration skills, high agency, a pragmatic build-vs-buy
• Are fluent in English

🎁 Benefits

• Free comprehensive health insurance (basic package) for you and your children
• 25 days of paid vacation per year, plus up to 14 days of RTT
• Free mental health and coaching services through our partner Moka.care
• Work from abroad for up to 10 days per year thanks to our flexibility days policy
• Lunch vouchers (Swile card) worth €8.50 per working day, with €4.50 covered by Doctolib
• A subsidy from the work council to refund part of the membership to a sport club or a creative class