Staff Software Engineer, Foundation Model API

📋 Description

• Build LLM infra for large-scale inference with partner and self-hosted models.
• Shape FMAPI roadmap and execution via enterprise feedback.
• Improve reliability, latency, and efficiency of distributed AI workloads.
• Collaborate with platform, infra, and ML teams for end-to-end UX.
• Define how developers and data scientists interact with AI at Databricks.

🎯 Requirements

• 8+ years of backend or infrastructure engineering.
• Experience with distributed systems, scalable APIs, or cloud-native infra.
• Strong product ownership mindset with shipping user-facing value.
• Experience with real-time serving, ML infrastructure, or GPU orchestration.
• Familiarity with SOA, deployment pipelines, and system observability.
• Strong programming skills in Scala, Go, or Python.

🎁 Benefits

• Comprehensive benefits and perks.
• Pay transparency resources and regional pay ranges.
• Global offices and inclusive culture.
• Opportunities to work across data and AI platforms.