Senior Machine Learning Platform Engineer

📋 Description

• Define ML/AI infra direction and foundational systems.
• Scale hosted GPU inference for AI features.
• Build platform: multi-tenant serving, data pipelines, IaC.
• Own production model serving pipelines and reproducible environments.
• Develop high-performance GPU inference pipelines with low latency.
• Role requires 4 days/week in NYC office (Flatiron District).

🎯 Requirements

• 4+ years in software engineering; 2+ years in ML infra/AI.
• Strong Python and infra fundamentals.
• Familiar with cloud ML services (SageMaker/Vertex AI) and ML CI/CD.
• Experience with IaC (Terraform/Pulumi) and Kubernetes/ECS.
• Experience building evaluation/observability for LLM/agent AI apps.
• Excellent at managing ambiguity; break problems into steps.
• Growth mindset; welcome feedback in fast-paced env.
• Experience with Go/Rust/C++ is a plus.

🎁 Benefits

• Comprehensive benefits for all full-time employees.
• Benefits details at https://www.charliehealth.com/careers/epd#benefits