Senior Data Engineer

📋 Description

• Lead the technical direction and roadmap for our Airflow and Astronomer platform while owning its
• Build paved paths for authoring, testing, deploying, and operating workflows, including reusable
• Design and operate streaming and change data capture pipelines using tools such as Pub/Sub
• Make data delivery resilient to retries, duplicates, schema changes, late events, backfills, and
• Improve the cloud foundation behind data workloads with Kubernetes, Terraform, IAM, secrets, CI/CD
• Lead cross-team design decisions on data contracts, interfaces, and operational ownership; mentor

🎯 Requirements

• Strong software engineering skills in Python and experience building and operating production data
• Deep hands-on Airflow experience beyond writing DAGs: scheduling and execution behavior
• Experience with event-driven or streaming data infrastructure, including a message broker or
• Sound understanding of CDC, delivery guarantees, idempotency, ordering, schema evolution, and
• Experience with cloud infrastructure and infrastructure as code; comfortable working with
• A track record of leading ambiguous infrastructure initiatives: setting technical direction, making

🎁 Benefits

• Ownership: Equity in a fast-growing company
• Financial Wellness: 401(k) match, competitive compensation, financial coaching
• Family Support: Paid parental leave, fertility benefits, parental coaching
• Wellbeing: Medical, dental, & vision, mental health support, $500 wellness stipend
• Growth: $2,000 learning stipend, ongoing development
• Remote & Office: Internet, commuting, & free lunch/gym in our SF office