Data Platform Engineer, Ingestion

Added
24 days ago
Type
Full time
Salary
Upgrade to Premium to se...

Related skills

snowflake sql python dbt airflow

πŸ“‹ Description

  • Build pipelines for messy sources including APIs, files, database extracts and approved scraping
  • Make reruns safe with incremental loads, backfills and retries that never duplicate or corrupt
  • Automate onboarding of new data sources from source configuration and access checks through
  • Build reusable connectors and storage modules with tests, examples and clear interfaces that other
  • Keep the origin of every value by carrying source metadata through the pipeline and enforcing
  • Own integrations in production with shared monitoring, recovery runbooks and fixing source-specific

🎯 Requirements

  • Typically three or more years building and supporting production data pipelines or equivalent
  • Experience bringing in data from many vendors and source types including messy data at scale and
  • Practical judgment about incremental processing, backfills, failures and cost
  • Experience automating repeated work or building components other engineers used
  • Strong Python and SQL skills
  • Ability to pin down what a source owner needs and document what will and won't be supported

🎁 Benefits

  • Meaningful equity
  • Medical, dental and vision coverage
  • Unlimited PTO
  • Monthly fitness stipend
  • Annual company offsite

🚚 Relocation support

πŸ›ƒ Visa sponsorship

Get alerts for new remote data jobs
A weekly email with new matches. Unsubscribe anytime.
Share job

Meet JobCopilot: Your Personal AI Job Hunter

Automatically Apply to Data Jobs. Just set your preferences and Job Copilot will do the rest β€” finding, filtering, and applying while you focus on what matters.

Related Data Jobs

See more Data jobs β†’