Databricks Engineer - Senior/ Lead

Added
1 day ago
Type
Full time
Salary
Salary not provided

Related skills

sql python apache spark pyspark delta lake
JobCopilot logo
Meet JobCopilot: Your Personal Al Job Hunter
Automatically Apply to Your Dream Jobs While You Sleep
Try it now โ†’

๐Ÿ“‹ Description

  • Design, build, and optimize scalable data pipelines on Azure Databricks.
  • ETL/ELT workflows with PySpark, Spark SQL, and Python.
  • Optimize Spark jobs for performance, cost, and scalability.
  • Work with Parquet, Delta, JSON, CSV data.
  • Build and manage Delta Lake tables with ACID, time travel, schema evolution.
  • Integrate Databricks with Azure Data Lake Storage Gen2.

๐ŸŽฏ Requirements

  • 6+ years of experience in Data Engineering.
  • Strong hands-on experience with Azure Databricks.
  • Proficiency in Python for data processing.
  • Strong knowledge of SQL (joins, window functions, performance tuning).
  • Hands-on experience with Apache Spark / PySpark.
  • Experience with Delta Lake.

๐ŸŽ Benefits

  • Azure Data Factory experience.
  • Exposure to CI/CD pipelines (Azure DevOps, GitHub Actions).
  • Basic understanding of data modeling.
  • Familiarity with cloud security and RBAC in Azure.
Share job

Meet JobCopilot: Your Personal AI Job Hunter

Automatically Apply to Data Jobs. Just set your preferences and Job Copilot will do the rest โ€” finding, filtering, and applying while you focus on what matters.

Related Data Jobs

See more Data jobs โ†’