Senior Software Engineer – AI Infrastructure

📋 Description

• Design and build the infrastructure layer powering AI agent systems in production
• Develop high-performance Rust services for model inference and orchestration
• Architect scalable systems for millions of users and high throughput
• Build reliable ML infrastructure and MLOps patterns for model deployment, evaluation, and monitoring
• Define guardrails, observability, and failure handling for agent-driven workflows
• Optimize latency, throughput, and cost across inference and orchestration

🎯 Requirements

• 5+ years of experience building and operating high-scale production systems
• Strong proficiency in Rust and systems-level programming
• Deep understanding of distributed systems, reliability engineering, and performance optimization
• Experience operating services serving millions of users or high-throughput workloads
• Familiarity with ML infrastructure, model serving, or MLOps in production environments
• Experience designing observability, monitoring, and failure recovery systems

🎁 Benefits

• Experience building infrastructure for agent-based or LLM-powered systems
• Background in high-performance networking, async systems, or low-latency architectures
• Experience with container orchestration and cloud-native infrastructure
• Familiarity with evaluation frameworks and model performance monitoring at scale
• Experience working in fast-moving 0→1 or platform-building teams
• Explore Kraken culture before applying