Software Engineer, AI Infra

📋 Description

• Design, develop, and maintain scalable GPU infrastructure for training and serving state-of-the-art
• Architect and optimize high-throughput, low-latency APIs for AI model serving and inference
• Lead the orchestration, scheduling, and efficient utilization of heterogeneous GPU resources across
• Build and support robust systems for model deployment, monitoring, scaling, and reliability in
• Collaborate with ML, backend, and platform engineering teams to deliver seamless AI-powered product
• Drive technical direction, code reviews, and mentorship across the AI Infrastructure team

🎯 Requirements

• Strong experience (5+ years) as a software engineer working on systems infrastructure, including
• Deep knowledge of distributed systems, Kubernetes (or similar orchestration frameworks), and
• Proven expertise in building and optimizing APIs for large-scale AI model serving (TensorFlow
• Familiarity with the challenges of high-throughput, scalable GPU fleet management, scheduling, and
• Proficiency in backend languages such as Python, Go, or C++, and experience optimizing for
• Ownership mentality and the drive to solve complex problems independently in ambiguous, high-growth

🎁 Benefits

• Competitive salary in the AI industry
• Equity in a rapidly growing team shaping the future of AI
• Comprehensive health benefits, monthly stipends, and company retreats
• A supportive and collaborative office culture—everyone builds, ships, and learns together