Added
1 day ago
Type
Full time
Salary
Salary not provided

Related skills

terraform postgresql python kubernetes kafka

๐Ÿ“‹ Description

  • Data pipeline development: Design, develop, and maintain robust data pipelines.
  • Streaming data processing: Real-time streaming using Kafka, Debezium, Kafka Connect.
  • Workflow orchestration: Build and manage workflows with Apache Airflow.
  • Database management: Work with MySQL, PostgreSQL, MongoDB, Redshift/BigQuery.
  • Infrastructure as Code: Use Terraform, Kubernetes, and Helm to provision infra.
  • CI/CD and testing: Develop CI/CD pipelines; perform unit/integration tests.

๐ŸŽฏ Requirements

  • Bachelor's in CS/Engineering or related field.
  • Python essential; JavaScript/Scala advantageous.
  • 3+ years data engineering; 2+ years software eng.
  • Kafka, Debezium, Kafka Connect streaming.
  • Airflow (preferred) or Databricks/Dagster/Airbyte.
  • MySQL/PostgreSQL/MongoDB/Redshift; BigQuery/SingleStore bonus.
Share job

Meet JobCopilot: Your Personal AI Job Hunter

Automatically Apply to Data Jobs. Just set your preferences and Job Copilot will do the rest โ€” finding, filtering, and applying while you focus on what matters.

Related Data Jobs

See more Data jobs โ†’