Data Engineer PySpark H/F

Added
8 days ago
Type
Full time
Salary
Salary not provided

Related skills

snowflake sql scala dbt apache spark

๐Ÿ“‹ Description

  • Conceive, develop and maintain massive data processing pipelines in PySpark.
  • Build and optimize data models and advanced data processing techniques.
  • Implement Big Data architectures on AWS (S3, EMR, Lambda, Snowflake...).
  • Develop in SQL, Snowflake, Scala, Gitlab CI/CD and use Apache Spark for massive data processing.
  • Automate workflows with Apache Airflow and DBT to orchestrate pipelines.
  • Design and expose high-performance APIs to serve data (Scala, Spark, Terraform, Gitlab CI CD, ECS

๐ŸŽฏ Requirements

  • At least 5 years of experience in data project development.
  • Deep knowledge of PySpark (distributed development, Spark job optimization, memory and partitioning
  • Solid expertise in SQL (complex querying, performance optimization, data warehouse modeling).
  • Confirmed experience with dbt (model development, macros, data tests, documentation).
  • Advanced knowledge of AWS Cloud ecosystem (S3, Glue, EMR, Redshift, IAM, Lambda, etc.).
  • Mastery of Terraform for provisioning and automated management of cloud resources.

๐ŸŽ Benefits

  • Dynamic communities to support you in your career path.
  • Meetups to develop your skills.
  • Training to reinvent yourself and progress.
  • Sporting and festive events for your well-being.
  • A sustainable mobility package to facilitate your daily life and encourage soft mobility.
  • A latest-generation phone to stay connected.
Get alerts for new remote data jobs
A weekly email with new matches. Unsubscribe anytime.
Share job

Meet JobCopilot: Your Personal AI Job Hunter

Automatically Apply to Data Jobs. Just set your preferences and Job Copilot will do the rest โ€” finding, filtering, and applying while you focus on what matters.

Related Data Jobs

See more Data jobs โ†’