Architect the Data Platform.
Design internal SDKs and self-service data frameworks.
Shift from pipelines to platform engineering for batch and real-time processing.
Scale the Databricks Lakehouse across hundreds of services.
Tune Spark plans, partitions, and auto-scaling to manage DBU costs.
Ensure platform reliability and cost-efficiency as volumes grow.

🎯 Requirements

5+ years building and operating production-scale data systems.
Deep Databricks/Spark expertise (Delta Lake, DLT, tuning).
Real-time streaming: Spark Structured Streaming, Kafka, or Kinesis.
Strong cloud cost optimization in high-growth environments.
Experience building internal APIs, tools, or frameworks.

🎁 Benefits

Generous paid parental leave.
Flexible time off.
Spending accounts.
Medical, dental, and vision insurance.
Sabbatical after 5 years.
Career growth opportunities.

Apply on employer's website

This employer gathers applications via their own applicant tracking system.

You will be redirected to an external application form.

Share job

Meet JobCopilot: Your Personal AI Job Hunter

Automatically Apply to Data Jobs. Just set your preferences and Job Copilot will do the rest — finding, filtering, and applying while you focus on what matters.

Activate JobCopilot