Added
4 days ago
Type
Full time
Salary
Salary not provided

Related skills

sql python dbt airflow spark
JobCopilot logo
Meet JobCopilot: Your Personal Al Job Hunter
Automatically Apply to Your Dream Jobs While You Sleep
Try it now →

📋 Description

  • Onboard sources end to end: authentication, pagination, rate limits, incremental watermarks
  • Own orchestration: DAGs triggered on data arrival, idempotent re-runs, backfills that do not
  • Build the last mile: marts and semantic-layer definitions on top of them so metrics resolve to
  • Keep the lakehouse healthy: compaction, Z-ordering from real query patterns, vacuum within
  • Make performance a measured number: before/after on pipeline tuning, capacity spend, caching or
  • Set and defend freshness and completeness expectations per source; diagnose root cause and document

🎯 Requirements

  • 5+ years in data engineering with production ownership of pipelines others depended on.
  • Expert Python and SQL: able to read a query plan and explain slowness.
  • Experience with dataframe engines at volume: Polars, duckDB, Spark and judgment about when not to
  • Production experience with Airflow (or Dagster/Prefect with willingness to move); debugged a
  • Containers and Kubernetes: image, pod spec, resource limits, and consequences of incorrect limits.
  • Lakehouse table formats: Delta or Iceberg with partitioning, compaction, schema evolution as
Get alerts for new remote engineering jobs
A weekly email with new matches. Unsubscribe anytime.
Share job

Meet JobCopilot: Your Personal AI Job Hunter

Automatically Apply to Engineering Jobs. Just set your preferences and Job Copilot will do the rest — finding, filtering, and applying while you focus on what matters.

Related Engineering Jobs

See more Engineering jobs →