Added
7 hours ago
Type
Full time
Salary
Salary not provided

Related skills

sql airflow pyspark clickhouse apache kafka

๐Ÿ“‹ Description

  • Own end-to-end real-time data pipeline across the analytics warehouse.
  • Design/build scalable data pipelines with AWS Glue (PySpark).
  • Optimize the ClickHouse warehouse for sub-second queries.
  • Implement data contracts; onboarding a new operator is a config change.
  • Build a feature-serving layer delivering pre-computed features to AI agents.
  • Collaborate with data scientists, BI, and infra teams.

๐ŸŽฏ Requirements

  • 3+ years building and operating production data pipelines.
  • Expertise in Apache Kafka (Amazon MSK).
  • Strong SQL and warehouse engineering (ClickHouse preferred).
  • PySpark/Spark Streaming; AWS Glue, Airflow, NiFi a strong plus.
  • Data modelling for multi-tenant schemas with data contracts governance.
  • CI/CD and infrastructure-as-code (CloudFormation, Terraform, CDK); containers (ECS Fargate or Kubernetes).

๐ŸŽ Benefits

  • Fully remote with asynchronous-first communication.
  • EU time zone overlap is preferred.
  • Small, high-autonomy Data team; report to Head of Data.
  • Architecture decisions documented; design reviews; domain ownership.
  • Culture: mature, mission-driven, low-ego.
Share job

Meet JobCopilot: Your Personal AI Job Hunter

Automatically Apply to Engineering Jobs. Just set your preferences and Job Copilot will do the rest โ€” finding, filtering, and applying while you focus on what matters.

Related Engineering Jobs

See more Engineering jobs โ†’