Added
27 days ago
Type
Full time
Salary
Salary not provided

Related skills

aws apache spark pyspark amazon athena apache iceberg

πŸ“‹ Description

  • Design, build, and maintain scalable data pipelines and ingestion frameworks supporting batch
  • Develop and optimize data processing workflows using Apache Spark and PySpark, ensuring reliable
  • Implement and manage data lake architectures on AWS, leveraging S3 as the primary storage layer and
  • Work with AWS-native services including Glue for ETL orchestration, Athena for serverless querying
  • Manage data access controls and security configurations using AWS IAM, ensuring compliant and
  • Collaborate with data analysts, data scientists, and platform engineers to understand data

🎯 Requirements

  • Advanced hands-on experience with AWS services, including AWS Glue, Amazon S3, Amazon Athena, and
  • Apache Spark / PySpark for data processing.
  • Data lake architectures, ideally with knowledge of Apache Iceberg.
  • Data ingestion patterns, including batch processing, streaming, and CDC patterns.
  • Experience with SQL for data querying, validation, and exploratory analysis.
  • Solid understanding of data modeling and large-scale data processing.

🎁 Benefits

  • Certifications in AWS (we are AWS Partners), Databricks, and Snowflake.
  • Access to AI learning paths to stay up to date with the latest technologies.
  • Study plans, courses, and additional certifications tailored to your role.
  • Access to Udemy Business, offering thousands of courses to boost your technical and soft skills.
  • English lessons to support your professional communication.
  • Travel opportunities to attend industry conferences and meet clients.
Get alerts for new remote engineering jobs
A weekly email with new matches. Unsubscribe anytime.
Share job

Meet JobCopilot: Your Personal AI Job Hunter

Automatically Apply to Engineering Jobs. Just set your preferences and Job Copilot will do the rest β€” finding, filtering, and applying while you focus on what matters.

Related Engineering Jobs

See more Engineering jobs β†’