Lead Data Engineer

📋 Description

• Design, develop, and maintain scalable data pipelines running on AWS infrastructure.
• Build reliable data processing solutions using Python, Pandas, and PySpark.
• Configure and manage data workflows using AWS Managed Workflows for Apache Airflow (MWAA) or Apache
• Develop and optimize queries with AWS Athena to support efficient data analysis.
• Automate infrastructure provisioning and deployment processes using Terraform and GitHub Actions.
• Implement testing, monitoring, troubleshooting, and data-quality controls to ensure pipeline

🎯 Requirements

• At least 5 years of relevant professional experience.
• At least 1 year of experience leading and managing development teams.
• Strong Python programming skills applied to data engineering.
• Practical experience using Pandas for data manipulation and analysis.
• Advanced working knowledge of PySpark for large-scale distributed data processing.
• Experience with AWS MWAA or Apache Airflow for workflow orchestration.

🎁 Benefits

• Opportunity to contribute to international projects for leading global brands.
• Collaboration with skilled and diverse teams across different locations.
• Healthcare benefits.
• Employee financial programs.
• Paid time off and sick leave.
• Upskilling, reskilling, and professional certification opportunities.