Senior Data Engineer

📋 Description

• Take full-lifecycle ownership of the streaming platform - architecture, implementation, production
• Run the platform in production - own latency/throughput SLOs, monitoring and alerting
• Build and extend streaming pipelines that ingest CDC events from operational databases and SaaS
• Transform and enrich in Spark (Structured Streaming or dbt-on-Spark micro-batch)
• Enable secure, governed data access over PHI
• Make the platform reliable and observable - idempotent/replayable pipeline design, data-quality

🎯 Requirements

• 6+ years building and operating production data systems
• Deep, production experience with Apache Kafka
• Strong, hands-on Apache Spark experience (PySpark)
• AWS-native data engineering across streaming, processing, storage, and catalog services (e.g., MSK
• Comfort debugging distributed data pipelines
• Expert-level SQL and Python

🎁 Benefits

• alternative medicine coverage
• flexible PTO
• paid parental leave (up to 16 weeks)
• paid holidays
• 401k program
• transportation perks