Staff Engineer, Datalake Platform

Added
41 minutes ago
Type
Full time
Salary
Salary not provided

Related skills

s3 rest spark iam flink

📋 Description

  • Architect the unified Iceberg platform for multiple engines.
  • Own the Hive Metastore migration across teams.
  • Shape the object storage abstraction: IAM, lifecycle, policy design.
  • Lead compliance architecture: audit logging, access review, controls.
  • Drive cost and efficiency at petabyte scale with automation.
  • Set technical bar: design reviews, reliability, and developer UX.

🎯 Requirements

  • 10+ years of professional software engineering experience.
  • Design, build, and operate large-scale distributed storage/data infra.
  • Deep experience with object storage (S3/Azure Blob); IAM, lifecycle.
  • Lead multi-quarter infra projects end-to-end with cross-team migrations.
  • Strong background in authorization and access control for distributed data.
  • Deep expertise in Apache Iceberg (REST Catalog, lifecycle, compute).
Share job

Meet JobCopilot: Your Personal AI Job Hunter

Automatically Apply to Engineering Jobs. Just set your preferences and Job Copilot will do the rest — finding, filtering, and applying while you focus on what matters.

Related Engineering Jobs

See more Engineering jobs →