Data Engineer

📋 Description

• Build and maintain Spark and SparkSQL jobs that populate company data models
• Own well-scoped pipelines end to end, from requirements through deployment, monitoring, and
• Contribute to data quality frameworks, testing, and data lineage instrumentation
• Partner with data scientists, analysts, product managers, and engineers to turn data needs into
• Extend datamarts and data models supporting recurring reporting and analysis across products
• Improve the reliability and cost efficiency of existing pipelines, dashboards, and frameworks

🎯 Requirements

• 2+ years of development experience in Spark, Python, Java, C++, or Scala
• 2+ years of SQL experience, including query performance tuning
• 2+ years of experience with schema design and dimensional data modeling
• Experience building and maintaining production data pipelines that others depend on
• Working exposure to a cloud data lake or lakehouse platform, Databricks preferred
• Clear written and verbal communication with non-engineering partners, and a track record of asking