Sr IT Delivery Manager

Added
9 days ago
Type
Full time
Salary
Upgrade to Premium to se...

Related skills

data engineering sql python apache spark pyspark

๐Ÿ“‹ Description

  • Design, develop, and maintain scalable data pipelines using Azure Databricks
  • Implement ETL/ELT workflows using PySpark, Spark SQL, and Python
  • Optimize Spark jobs for performance, cost, and scalability
  • Work with structured and semi-structured data (Parquet, Delta, JSON, CSV)
  • Build and manage Delta Lake tables (ACID, time travel, schema evolution)
  • Integrate Databricks with Azure Data Lake Storage (ADLS Gen2)

๐ŸŽฏ Requirements

  • 6+ years of experience in Data Engineering
  • Strong hands-on experience with Azure Databricks
  • Proficiency in Python for data processing
  • Strong knowledge of SQL (joins, window functions, performance tuning)
  • Hands-on experience with Apache Spark / PySpark
  • Experience working with Delta Lake
Get alerts for new remote data jobs
A weekly email with new matches. Unsubscribe anytime.
Share job

Meet JobCopilot: Your Personal AI Job Hunter

Automatically Apply to Data Jobs. Just set your preferences and Job Copilot will do the rest โ€” finding, filtering, and applying while you focus on what matters.

Related Data Jobs

See more Data jobs โ†’