Lead Data Engineer

📋 Description

• Own the middle layer of the data pipeline, combining Quantum interaction data with account, device
• Build and maintain ETL workflows that transform data on daily, weekly, and monthly schedules.
• Develop and manage AWS processing resources, validate outputs, and prepare reliable datasets for
• Design and maintain application data structures that minimize compute requirements and support
• Investigate data discrepancies, troubleshoot pipeline issues, and adapt workflows as application
• Collaborate with the engineering lead, fellow data engineers, application developers, and data

🎯 Requirements

• 5+ years of experience in Data Engineering, Data Architecture, or a related field
• Strong hands-on AWS experience, including managing resources for data processing
• Proficiency in SQL and experience with Spark
• Experience building ETL pipelines, integrating multiple data sources, and organizing data for
• An investigative mindset and the ability to independently work through ambiguous technical problems
• A collaborative approach, with the ability to take ownership of assigned work within an established

🎁 Benefits

• Certifications in AWS (we are AWS Partners), Databricks, and Snowflake
• Access to AI learning paths to stay up to date with the latest technologies
• Study plans, courses, and additional certifications tailored to your role
• Access to Udemy Business, offering thousands of courses to boost your technical and soft skills
• English lessons to support your professional communication
• Travel opportunities to attend industry conferences and meet clients