Senior Data Engineer

📋 Description

• Design, build, and maintain robust Apache Spark Structured Streaming applications that process
• Implement and optimize stateful processing, slowly changing dimensions (SCD), checkpointing, state
• Own and scale AWS EMR clusters, managing instance sizing, resource allocation, managed scaling
• Maintain and optimize Apache Iceberg tables at scale by designing partitioning strategies and
• Onboard new business domains onto the streaming platform by configuring CDC sources and
• Investigate and resolve complex production incidents across the data platform, addressing issues

🎯 Requirements

• At least 7 years of professional experience in data engineering, including a minimum of 3 years
• Strong hands-on experience with Apache Spark, particularly Structured Streaming, state stores such
• Production experience with modern lakehouse table formats, ideally Apache Iceberg, including
• Experience operating Spark workloads on AWS EMR, Amazon EKS, or comparable platforms, with a strong
• Solid understanding of Change Data Capture principles and Kafka semantics, including offsets
• Strong proficiency in Python and SQL. Experience with Scala or Java is considered an advantage.

🎁 Benefits

• Competitive Compensation: Annual gross base salary ranging from $50,000 to $80,000 USD, depending
• Localized Compensation: Salary offers are adjusted to the candidate's country and paid in the
• Equity Opportunities: Stock grant opportunities, depending on role, employment status, and location.
• Flexible Working Arrangements: Fully remote work, with optional flexible office memberships through
• Additional Benefits: Access to additional perks and benefits based on employment status and country
• International Exposure: Opportunity to collaborate with globally distributed engineering teams and