Senior Data Software Engineer

Added
8 days ago
Type
Full time
Salary
Salary not provided

Related skills

db2 pyspark delta lake unity catalog jdbc
JobCopilot logo
Meet JobCopilot: Your Personal Al Job Hunter
Automatically Apply to Your Dream Jobs While You Sleep
Try it now β†’

πŸ“‹ Description

  • Design, develop, and maintain scalable data pipelines that enable reliable data movement across
  • Build and manage data ingestion processes from a variety of source systems.
  • Write clean, efficient, maintainable, and well-tested code in accordance with established software
  • Collaborate with cross-functional teams to understand data requirements and translate them into
  • Monitor data pipeline performance and proactively identify and resolve issues to maintain system
  • Participate in code reviews, uphold engineering quality standards, and share technical knowledge

🎯 Requirements

  • At least 3 years of relevant professional experience in data engineering or a related software
  • Strong hands-on experience with PySpark and Spark SQL for building and processing large-scale data
  • Experience building and managing Lakeflow pipelines and Jobs for data orchestration.
  • Proficiency with Auto Loader and JDBC/CDC ingestion methods, working with source systems such as
  • Solid experience with Delta Lake and Unity Catalog for data storage, management, and governance.
  • Background in data quality assurance and source reconciliation to maintain accurate and trustworthy

🎁 Benefits

  • Opportunity to work on international projects for leading global brands.
  • Collaboration with diverse, highly skilled teams across different locations.
  • Healthcare benefits.
  • Employee financial programs.
  • Paid time off and sick leave.
  • Professional development opportunities, including upskilling, reskilling, and certification courses.
Get alerts for new remote data jobs
A weekly email with new matches. Unsubscribe anytime.
Share job

Meet JobCopilot: Your Personal AI Job Hunter

Automatically Apply to Data Jobs. Just set your preferences and Job Copilot will do the rest β€” finding, filtering, and applying while you focus on what matters.

Related Data Jobs

See more Data jobs β†’