Staff Software Engineer, AI Platform

📋 Description

• Design and build platform-level abstractions for Harvey’s AI products.
• Own infrastructure for model integration, routing, and evaluation.
• Build evaluation tooling to measure and improve AI quality across teams.
• Partner with product engineering, PMs, and design to launch AI products.
• Evaluate and integrate new AI advancements as they emerge.

🎯 Requirements

• 8+ years backend systems, with 1+ year AI/ML leadership.
• Experience shipping multi-model AI systems in production.
• Familiarity with context management, session state, or memory.
• Built internal platforms, SDKs, or shared infra adopted by teams.
• Strong judgment on abstractions; design-minded, pragmatic shipping.
• Bonus: eval frameworks, agent/function-calling architectures.