Added
25 days ago
Type
Contract
Salary
Upgrade to Premium to se...

Related skills

postgresql sql python dbt airflow
JobCopilot logo
Meet JobCopilot: Your Personal Al Job Hunter
Automatically Apply to Your Dream Jobs While You Sleep
Try it now β†’

πŸ“‹ Description

  • Build concurrent ingestion for provider APIs, webhooks, files, and scraping, with rate limits and
  • Orchestrate scheduled workflows and historical backfills using tools such as Airflow, Dagster, or
  • Preserve original payloads, including provider JSON, in Google Cloud Storage (GCS) before
  • Implement idempotent upserts and safe retries, replay, and historical backfills to avoid duplicate
  • Define data contracts, build automated validation and pipeline tests, and monitor freshness and
  • Integrate provider enrichment and LLM-based structured extraction from text into the platform.

🎯 Requirements

  • Experience building multi-source production data platforms from zero to one, from initial
  • Production experience with workflow orchestration tools such as Airflow, Dagster, Prefect, or
  • Hands-on production experience with dbt and GCP.
  • Experience building event-driven systems with messaging or task queues, including asynchronous
  • Strong SQL and PostgreSQL skills, including data modeling, query optimization, and reliable
  • Strong Python skills, including asynchronous HTTP and concurrent processing with tools such as

🎁 Benefits

  • Salary: $84K – $120K per year
  • Remote work
  • Contract employment
Get alerts for new remote data jobs
A weekly email with new matches. Unsubscribe anytime.
Share job

Meet JobCopilot: Your Personal AI Job Hunter

Automatically Apply to Data Jobs. Just set your preferences and Job Copilot will do the rest β€” finding, filtering, and applying while you focus on what matters.

Related Data Jobs

See more Data jobs β†’