AWS Data Engineer

Added
12 minutes ago
Type
Full time
Salary
Salary not provided

Related skills

aws sql python databricks apache spark
JobCopilot logo
Meet JobCopilot: Your Personal Al Job Hunter
Automatically Apply to Your Dream Jobs While You Sleep
Try it now →

📋 Description

  • Design, develop, test, and maintain scalable data pipelines and transformation workflows using
  • Build and optimise data processing solutions using Apache Spark, PySpark, and SQL.
  • Develop batch and, where required, streaming data pipelines to support enterprise data processing
  • Implement robust data ingestion, cleansing, transformation, and enrichment processes across
  • Develop and maintain Delta Lake tables, applying appropriate data modelling, partitioning, and
  • Implement reusable, modular, and maintainable data engineering frameworks and components.

🎯 Requirements

  • Typically 6+ years of experience in data engineering, software engineering, or related technology
  • Strong practical experience developing data pipelines and transformation workloads using Databricks.
  • Advanced proficiency in Python, PySpark, and SQL.
  • Strong understanding of Apache Spark architecture, distributed data processing, and performance
  • Hands-on experience with Delta Lake, including data ingestion, transformation, optimisation, and
  • Experience designing and implementing ETL/ELT pipelines for large-scale data processing.
Get alerts for new remote data jobs
A weekly email with new matches. Unsubscribe anytime.
Share job

Meet JobCopilot: Your Personal AI Job Hunter

Automatically Apply to Data Jobs. Just set your preferences and Job Copilot will do the rest — finding, filtering, and applying while you focus on what matters.

Related Data Jobs

See more Data jobs →