Tech Lead Data - Databricks

Added
21 days ago
Type
Full time
Salary
Salary not provided

Related skills

azure databricks pyspark delta lake azure databricks
JobCopilot logo
Meet JobCopilot: Your Personal Al Job Hunter
Automatically Apply to Your Dream Jobs While You Sleep
Try it now →

📋 Description

  • Provide technical leadership to Data Engineering teams, supporting solution design, code reviews
  • Collaborate with the Data Architect to define the technical vision, coding standards, data modeling
  • Design, develop, and oversee data pipelines in Databricks using PySpark and Spark SQL across
  • Establish and reinforce DataOps practices, including Git version control, CI/CD, automated unit and
  • Optimize pipeline performance, including partitioning strategies, Spark tuning, cloud cost
  • Ensure non-functional requirements are met, particularly regarding access control, security, and

🎯 Requirements

  • Strong experience in Data Engineering projects, including previous experience providing technical
  • Extensive hands-on experience with Databricks, PySpark, and Spark SQL, particularly in designing
  • Deep knowledge of Delta Lake and practical experience implementing the Medallion architecture
  • Solid experience with Azure data services, including Azure Databricks, Azure Data Lake Storage
  • Strong SQL and Python skills, along with a solid understanding of dimensional data modeling
  • Experience implementing DataOps practices, including Git, CI/CD for data pipelines, automated

🎁 Benefits

  • Health and dental insurance.
  • Meal and food allowances.
  • Childcare assistance.
  • Extended paternity leave.
  • Access to gym memberships and health and wellness professionals through Wellhub (Gympass) and
  • Profit Sharing and Results Participation (PLR).
Get alerts for new remote data jobs
A weekly email with new matches. Unsubscribe anytime.
Share job

Meet JobCopilot: Your Personal AI Job Hunter

Automatically Apply to Data Jobs. Just set your preferences and Job Copilot will do the rest — finding, filtering, and applying while you focus on what matters.

Related Data Jobs

See more Data jobs →