Data Engineer (Databricks) | SR

Added
8 days ago
Type
Full time
Salary
Salary not provided

Related skills

databricks apache spark pyspark azure data factory delta lake

๐Ÿ“‹ Description

  • Define and evolve data architectures using Databricks, ensuring pipeline optimization, processing
  • Build, maintain, and optimize scalable, reliable data pipelines for data ingestion, transformation
  • Design and implement Lakehouse architectures and Medallion structures (Bronze, Silver, and Gold).
  • Develop batch and streaming data processing solutions, including Change Data Capture (CDC) and
  • Build and orchestrate data ingestion and integration processes using Azure Data Factory (ADF), Auto
  • Work with Apache Spark, Airflow, Kafka, dbt, SQL and NoSQL databases, and cloud data platforms.

๐ŸŽฏ Requirements

  • Advanced expertise in Databricks, PySpark, Spark SQL, and Delta Lake.
  • Strong experience with Delta Live Tables (DLT) / Lakeflow Spark Declarative Pipelines, CDC, and
  • Hands-on knowledge of Liquid Clustering, Auto Loader, and Delta table optimization.
  • Strong understanding of Unity Catalog, including data governance, security, lineage, and access
  • Proven experience designing and implementing data architectures based on Lakehouse and Medallion
  • Practical experience with Azure Data Factory (ADF) for data orchestration, ingestion, and

๐ŸŽ Benefits

  • Meal and/or food allowance.
  • Health insurance and dental insurance.
  • Pet health insurance.
  • Home-office allowance for remote positions.
  • Welcome kit during onboarding.
  • Life insurance.
Get alerts for new remote data jobs
A weekly email with new matches. Unsubscribe anytime.
Share job

Meet JobCopilot: Your Personal AI Job Hunter

Automatically Apply to Data Jobs. Just set your preferences and Job Copilot will do the rest โ€” finding, filtering, and applying while you focus on what matters.

Related Data Jobs

See more Data jobs โ†’