Senior or Staff ML Systems Engineer, LLMs

📋 Description

• Build reusable CI/CD workflows for model training, evaluation, and deployment.
• Automate model versioning, approvals, and compliance across environments.
• Create modular AI infra: vector stores, feature stores, registries, observability.
• Partner with eng and data science to embed AI models and agents in real-time apps.
• Evaluate and integrate state-of-the-art AI tools (LangChain, LlamaIndex, vLLM, MLflow, BentoML).
• Drive AI reliability and governance, ensuring compliance, security, and uptime.

🎯 Requirements

• Python-focused; strong software engineering ability
• Scalable infra: Docker, Kubernetes
• IaC/deployment: Terraform, CI/CD pipelines
• Monitoring/logging: Datadog, Prometheus, OpenTelemetry
• ML Ops: model versioning/rollback, eval, drift detection
• Production infra for LLM/agent workflows (vLLM, Triton, BentoML)

🎁 Benefits

• Remote-friendly, distributed-first company with global hubs
• High-ownership culture and fast-moving, impact-driven environment
• Clear career paths with defined engineering levels and mentorship
• Opportunity to work on AI infrastructure at scale in safety-focused org