Senior Data Platform Engineer

Added
11 days ago
Type
Full time
Salary
Upgrade to Premium to se...

Related skills

terraform python databricks apache airflow azure devops

๐Ÿ“‹ Description

  • Own the Apache Airflow platform: environments, deployment, upgrades, configuration, connections
  • Work on the migration from Azure Data Factory to Airflow and the evolution of the Metadata-Driven
  • Ensure Airflow is reliable and observable: SLAs, alerting, retries, backfills, health monitoring
  • Manage Azure resources with Infrastructure as Code (Terraform): Databricks workspaces, Data Lake
  • Own secrets and identity management: Key Vault, service principals and managed identities, secret
  • Own access management: Azure RBAC, Entra ID groups, Unity Catalog grants and ownership, following

๐ŸŽฏ Requirements

  • 6+ years of experience in data engineering, with significant time on platform or infrastructure
  • Strong technical expertise with Python and SQL (advanced), including PySpark and Delta Lake
  • Deep hands-on experience with Apache Airflow in production: DAG design, deployment, operations
  • Hands-on experience with Azure resource management:
  • Key Vault, managed identities and service principals, secret management
  • Access management: Azure RBAC, Entra ID, Unity Catalog permissions
Get alerts for new remote data jobs
A weekly email with new matches. Unsubscribe anytime.
Share job

Meet JobCopilot: Your Personal AI Job Hunter

Automatically Apply to Data Jobs. Just set your preferences and Job Copilot will do the rest โ€” finding, filtering, and applying while you focus on what matters.

Related Data Jobs

See more Data jobs โ†’