Big Data Developer

📋 Description

• Design, develop and maintain data lake pipelines using Apache Spark, Scala and SQL.
• Build and maintain scalable data processing solutions for large volumes of data.
• Orchestrate batch workflows and dependencies using tools such as Control-M and Airflow.
• Implement data ingestion, transformation, validation and publication processes for Market Risk use
• Analyse and optimise the performance, reliability and scalability of Spark-based workloads.
• Analyse technical and functional requirements, identify gaps and propose effective solutions.

🎯 Requirements

• 2+ years of professional experience in Big Data, Data Lakes or cloud-based data platforms.
• Strong hands-on experience with Apache Spark, Scala and SQL for large-scale data processing.
• Good understanding of Data Lake architecture, data quality controls, data lineage and
• Strong analytical and problem-solving skills.
• Excellent communication and teamwork skills, with the ability to collaborate effectively with
• Adaptability and a proactive approach to solving technical challenges.

🎁 Benefits

• Full-time, permanent employment contract.
• 100% remote working with the flexibility to work from wherever you are.
• Professional growth and career development opportunities, with access to continuous learning.
• The opportunity to join a multicultural and international environment, collaborating with
• A comprehensive range of benefits designed to support your physical, emotional and financial
• Life insurance