Added
9 minutes ago
Type
Full time
Salary
Upgrade to Premium to se...

Related skills

azure aws python gcp databricks

πŸ“‹ Description

  • Design and own the end-to-end lakehouse architecture on Databricks, using Medallion
  • Build and optimize scalable batch and streaming pipelines in PySpark, Spark SQL and Python.
  • Lead platform migrations (e.g., legacy data warehouse or Hadoop/EMR to Databricks) with measurable
  • Define data governance: Unity Catalog, fine-grained access control, auditing, lineage and
  • Model data for analytics and operations (OLTP/OLAP, dimensional, SQL and NoSQL).
  • Set engineering standards: CI/CD, unit and integration tests, code review, reusable Python

🎯 Requirements

  • 10+ years in data engineering, including 5+ years hands-on with Databricks and Spark in production.
  • Strong Python and PySpark; working knowledge of Scala and advanced SQL.
  • Proven record designing data lakes, data warehouses and lakehouses, including at least one large
  • Production experience on at least one major cloud (AWS, Azure or GCP).
  • Hands-on data governance with Unity Catalog, access controls, lineage and auditing.
  • Solid software engineering practice: Git workflows, automated testing, CI/CD (Azure DevOps, GitHub

🎁 Benefits

  • Salary range offered: $7,000 - $8,800 (USD) per month, depending on seniority and skillset.
  • Full-time contract through a payroll platform.
  • Remote work allocated at our client.
Share job

Meet JobCopilot: Your Personal AI Job Hunter

Automatically Apply to Data Jobs. Just set your preferences and Job Copilot will do the rest β€” finding, filtering, and applying while you focus on what matters.

Related Data Jobs

See more Data jobs β†’