Data Platform Engineer

📋 Description

• Design and build data platforms at scale for both batch and streaming, choosing storage, compute
• Own the infrastructure for BigQuery, streaming (such as Pub/Sub or Kafka, and Dataflow or Flink)
• Own access and governance: IAM, policy tags, PII contracts, masked and no-PII access paths, and
• Provide ML platform capabilities: feature pipelines, training data, and serving real-time features
• Build platform tooling: templates, CI checks, schema registry and data contracts, catalog, and
• Monitor platform reliability, latency, and cost, and fix what is slow or expensive.

🎯 Requirements

• At least 4 years building and running data platforms in production on a cloud provider such as GCP
• Experience designing data platforms at scale: storage and compute choices, multi-team access
• Experience operating cloud data warehouses and real-time stores such as BigQuery and ClickHouse.
• Experience operating streaming infrastructure such as Pub/Sub, Kafka, Dataflow, or Flink, including
• Experience operating batch infrastructure: orchestration (Dagster or Airflow), CI/CD, and
• Infrastructure as code with Terraform.

🎁 Benefits

• Flexible time off: Unlimited vacation, minimum 10 days required
• Flexible working: work from home, office, or both; home workspace stipend
• Health, dental, and vision plan: 95% coverage for US Rainmakers, 90% for dependents; 100%
• 401(k) with 4% company match
• Equity option plan for every Rainmaker
• Monthly health and wellness stipend