Senior or Staff AI Infrastructure Engineer

📋 Description

• Build reusable CI/CD workflows for model training, evaluation, and deployment — Langfuse, GitHub Actions
• Automate model versioning, approval workflows, and compliance checks
• Build modular AI infra stack — vector databases, feature stores, model registries, observability
• Partner with engineering and data science to embed AI models and agents into real-time applications and workflows
• Continuously evaluate and integrate state-of-the-art AI tools (LangChain, LlamaIndex, vLLM, MLflow, BentoML)
• Drive AI reliability and governance, ensuring compliance, security, and uptime

🎯 Requirements

• Python proficiency; maintainable software
• Strong background in scalable infrastructure: Docker, Kubernetes
• Infrastructure-as-code and deployment: Terraform, CI/CD pipelines
• Monitoring/logging: Datadog, Prometheus, OpenTelemetry
• ML Ops: versioning/rollback, automated evaluation, drift detection
• Serving infra for LLMs/agents: vLLM, Triton, BentoML
• Production workflows: cost/latency/performance monitoring; tracing; real-time data access

🎁 Benefits

• Distributed-first company with hubs worldwide
• High ownership, fast-paced, impact-driven culture
• Meaningful mission at AI, national security, crime-fighting
• Collaborative culture with cross-team mentorship
• Equity plan eligibility