Added
18 days ago
Type
Full time
Salary
Salary not provided

Related skills

bigquery sql python airflow apache spark
JobCopilot logo
Meet JobCopilot: Your Personal Al Job Hunter
Automatically Apply to Your Dream Jobs While You Sleep
Try it now β†’

πŸ“‹ Description

  • Design, build, and optimize large-scale distributed data pipelines with Beam/Dataflow, Spark, or Flink.
  • Develop ETL/ELT workflows on GCP with multiple data sources.
  • Address schema, type conversion, and performance when migrating warehouses to BigQuery.
  • Implement observability, monitoring, logging, and error handling in pipelines.
  • Collaborate with Data Analysts to integrate validation rules, QA checks, and automated testing.
  • Support large-scale data migrations and performance tuning for high-volume workloads.

🎯 Requirements

  • 4+ years as Data Engineer in modern cloud environments.
  • 2+ years hands-on GCP (BigQuery, Dataflow, Dataform, Composer, Dataproc, Pub/Sub).
  • Strong experience with distributed data processing frameworks (Beam, Spark, Flink).
  • Proficiency in Python for pipelines.
  • Proficiency in SQL (Oracle + BigQuery dialects ideal).
  • Experience with Apache Airflow (orchestration).
  • Big data workloads, batch/streaming pipelines, large-scale migrations.
  • CI/CD, MLOps, or data quality frameworks advantage.

🎁 Benefits

  • Fully remote company with global teams.
  • Competitive compensation and benefits.
  • Inclusive, equal-opportunity employer.
  • Opportunity to work with Google Cloud data stack.
Share job

Meet JobCopilot: Your Personal AI Job Hunter

Automatically Apply to Data Jobs. Just set your preferences and Job Copilot will do the rest β€” finding, filtering, and applying while you focus on what matters.

Related Data Jobs

See more Data jobs β†’