Lead Data Software Engineer

Added
8 days ago
Type
Full time
Salary
Salary not provided

Related skills

databricks pyspark delta lake unity catalog jdbc
JobCopilot logo
Meet JobCopilot: Your Personal Al Job Hunter
Automatically Apply to Your Dream Jobs While You Sleep
Try it now β†’

πŸ“‹ Description

  • Design, build, and maintain scalable data pipelines that ensure reliable data flow across multiple
  • Develop and manage ingestion pipelines that collect and process data from diverse source systems.
  • Write clean, maintainable, high-quality, and thoroughly tested code based on strong software
  • Collaborate with cross-functional teams to understand business and data requirements and translate
  • Monitor pipeline performance, identify potential issues proactively, and maintain system
  • Participate in code reviews, uphold engineering quality standards, and share technical knowledge

🎯 Requirements

  • At least 5 years of relevant professional experience.
  • At least 1 year of experience leading and managing development teams.
  • Strong experience with PySpark and Spark SQL for building and managing large-scale data processing
  • Hands-on experience developing and managing Databricks Lakeflow pipelines and Jobs for data
  • Proficiency with Auto Loader and JDBC/CDC ingestion strategies, including experience integrating
  • Strong knowledge of Delta Lake and Unity Catalog for data storage, management, and governance.

🎁 Benefits

  • Opportunity to work on international projects for leading global brands.
  • Collaboration with highly skilled and diverse teams across different locations.
  • Healthcare benefits.
  • Employee financial programs.
  • Paid time off and sick leave.
  • Upskilling, reskilling, and professional certification opportunities.
Get alerts for new remote data jobs
A weekly email with new matches. Unsubscribe anytime.
Share job

Meet JobCopilot: Your Personal AI Job Hunter

Automatically Apply to Data Jobs. Just set your preferences and Job Copilot will do the rest β€” finding, filtering, and applying while you focus on what matters.

Related Data Jobs

See more Data jobs β†’