Senior Data Engineer, Cloudforce One

Added
2 days ago
Type
Full time
Salary
Salary not provided

Related skills

sql s3 python kubernetes spark

πŸ“‹ Description

  • Design, build, and operate scalable batch data pipelines on Kubernetes-hosted Airflow and Spark
  • Build and evolve our data stores in Apache Iceberg (R2) and the curated data marts that serve
  • Model datasets deliberately β€” choosing grain, partitioning, and schema evolution strategies that
  • Write and optimize SQL against large-scale analytical data in ClickHouse, balancing completeness
  • Make pipelines safe to retry, resume, and backfill, so downstream consumers receive exactly the
  • Build data quality checks, reconciliation, and monitoring that catch problems before they reach

🎯 Requirements

  • 5+ years of experience designing, building, and operating scalable production data pipelines.
  • Proven experience building analytical data stores and data marts, including data modeling
  • Strong Python for data engineering, including testing and maintainable, well-structured code.
  • Strong SQL, including window functions, query optimization, and performance tuning on large
  • Hands-on experience with Apache Airflow in production, including Kubernetes-hosted deployments.
  • Experience with distributed data processing (e.g. Spark or similar) at large scale.

🎁 Benefits

  • Not specified
Get alerts for new remote data jobs
A weekly email with new matches. Unsubscribe anytime.
Share job

Meet JobCopilot: Your Personal AI Job Hunter

Automatically Apply to Data Jobs. Just set your preferences and Job Copilot will do the rest β€” finding, filtering, and applying while you focus on what matters.

Related Data Jobs

See more Data jobs β†’