Principal Software Architect - Data Platform

Added
7 days ago
Type
Full time
Salary
Upgrade to Premium to se...

Related skills

data python kafka spark architecture

๐Ÿ“‹ Description

  • Own the system design for our data platform end to end, from ingestion through to the serving layer
  • Define the service boundaries and data contracts between producers and consumers, including schema
  • Design the lakehouse: table format, partitioning strategy, schema evolution, compaction, and
  • Architect the analytical serving layer for three workload classes with conflicting demands
  • Set direction on languages and frameworks in the data stack
  • Engineer data quality and observability into the platform rather than bolting them on: validation

๐ŸŽฏ Requirements

  • 10+ years of software or data engineering experience, including significant time architecting
  • Deep expertise in stream and batch processing at scale with Kafka, Flink, and Spark or close
  • Strong Python and PySpark, solid Java for Flink stream processing, and enough Scala to read and
  • Hands-on experience designing lakehouse storage in production: columnar formats such as Parquet
  • Experience architecting OLAP and analytical serving layers (ClickHouse, Druid, Pinot, BigQuery
  • Strong distributed systems fundamentals as they apply to data: exactly-once versus at-least-once

๐ŸŽ Benefits

  • Competitive salary
  • Stock options
  • Health benefits
  • Unlimited PTO
  • Parental leave
  • Tuition reimbursements
Share job

Meet JobCopilot: Your Personal AI Job Hunter

Automatically Apply to Data Jobs. Just set your preferences and Job Copilot will do the rest โ€” finding, filtering, and applying while you focus on what matters.

Related Data Jobs

See more Data jobs โ†’