Principal Data Engineer

Added
3 days ago
Type
Full time
Salary
Upgrade to Premium to se...

Related skills

aws snowflake presto google bigquery trino

📋 Description

  • Architecting large-scale data intelligence solutions, performing architectural assessments
  • Design and evolve an open lakehouse on AWS: S3 with Apache Iceberg/Delta table formats, a medallion
  • Finalize preferred solution alternative working with IT and Business stakeholders to build data
  • Need to have professional knowledge of cloud platforms like AWS, GCP, etc.
  • Developing ETL pipelines in and out of data the warehouse using but not limited to Python, Scala
  • Own orchestration patterns in Dagster: asset-based pipelines, code-location design, cross-asset

🎯 Requirements

  • 12+ years of experience working with data in the following ways: SQL development, Shell Scripting
  • Ideal candidate has led platform architecture for a multi-team data organization
  • Experience developing end-to-end data pipelines to transform and process data for reporting layer
  • Experience with large-scale data sets using both structured and unstructured data
  • Production experience with at least two of: Trino/Presto, Iceberg/Delta/Hudi, Dagster/Airflow, dbt
  • Full grasp of continuous integration and delivery, including branching strategies, automated

🎁 Benefits

  • We celebrate one another’s differences. We are proud of our culture of diversity and inclusion, and
  • Join the experts. If you're passionate about supporting businesses and organizations, you won’t
  • You’ll have opportunities to grow your career.
  • A generous paid time off policy and a competitive benefits package that supports the health and
Get alerts for new remote data jobs
A weekly email with new matches. Unsubscribe anytime.
Share job

Meet JobCopilot: Your Personal AI Job Hunter

Automatically Apply to Data Jobs. Just set your preferences and Job Copilot will do the rest — finding, filtering, and applying while you focus on what matters.

Related Data Jobs

See more Data jobs →