Senior Data Engineer

📋 Description

• Design, build, and operate scalable batch and streaming pipelines on AWS using Airflow (MWAA)
• Lead the evolution of our product event platform, including schema design, event taxonomy
• Build event data quality and observability: schema validation, instrumentation testing, anomaly
• Handle late-arriving and out-of-order data correctly, using lookback reprocessing and idempotent
• Build and maintain the data foundations for personalization and recommendation systems, including
• Partner with ML engineers to build feature pipelines and a batch plus low-latency feature store

🎯 Requirements

• 8+ years of experience in data engineering, including building and owning production pipelines at
• Strong SQL and Python skills; experience with PySpark or Spark is a plus
• Deep hands-on experience with AWS data services (S3, Glue, Redshift, DynamoDB, Lambda, IAM)
• Production experience with Apache Airflow, including DAG design, dependency management, templating
• Experience with streaming and event ingestion (Kafka, Kinesis, SQS, or similar) and clickstream or
• Strong data modeling skills (dimensional and event modeling) and a clear sense of how data design

🎁 Benefits

• Competitive Medical, Dental, and Vision coverage
• 401(k) match
• Generous PTO
• Tuition reimbursement
• Yearly lifestyle stipend
• Exclusive employee discounts