Principal Data Engineer

📋 Description

• Own the data platform strategy, architecture, and roadmap.
• Design and maintain scalable Databricks-based streaming and batch platforms.
• Implement least-privilege access controls and HIPAA/SOC 2 compliance.
• Drive platform cost optimization and reliability.
• Enable ML/BI/DevOps teams with training data pipelines and dashboards.

🎯 Requirements

• Degree in Computer Science or related field or equivalent experience.
• 8+ years data engineering experience.
• 5+ years Databricks experience (Unity Catalog, Delta Lake, Structured Streaming, Spark SQL).
• Proficiency in PySpark and Python; working knowledge of Scala.
• Terraform for infrastructure-as-code (state mgmt, multi-env).
• Apache Kafka / AWS MSK experience.
• CI/CD pipelines for data platforms (Jenkins, GitHub Actions).
• Expert SQL skills — complex queries on large datasets.

🎁 Benefits

• Health Insurance: 80% of medical/dental coverage; vision included.
• 401(k) with employer contributions after first day.
• Generous Paid Time Off policy.
• Annual performance reviews and growth planning.
• Company awards program recognizing outstanding achievement.
• Office: Back Bay Boston workspace.