Senior Data Engineer

Added
4 days ago
Type
Full time
Salary
Upgrade to Premium to se...

Related skills

aws sql python databricks airflow

πŸ“‹ Description

  • Own Airflow codebase (MWAA) and ~100 DAGs; templates and tests
  • Be the go-to for pipeline architecture and troubleshooting
  • Own data onboarding for new sources: connection setup, schema discovery, pipeline design
  • Operate Spark pipelines on AWS Glue; multi TB joins; migrate to Databricks
  • Improve pharma data models: structure, lineage, and data flow
  • Contribute to and maintain internal Python package used by the data team

🎯 Requirements

  • 5+ years building data models and pipelines
  • 2+ years production Airflow
  • 2+ years Spark at scale (multi-TB); AWS Glue exp preferred
  • Strong Python and SQL
  • AWS: S3, ECS/Fargate, Glue, IAM, Secrets Manager
  • Clear communicator; onboarding analytics team to codebase and Airflow

🎁 Benefits

  • Medical, dental, vision, and basic life insurance
  • Flexible PTO and company paid holidays
  • Retirement programs
  • 1% charitable giving program
Share job

Meet JobCopilot: Your Personal AI Job Hunter

Automatically Apply to Data Jobs. Just set your preferences and Job Copilot will do the rest β€” finding, filtering, and applying while you focus on what matters.

Related Data Jobs

See more Data jobs β†’