Principal Software Architect - Data Platform

📋 Description

• Own the system design for our data platform end to end, from ingestion through to the serving layer
• Define the service boundaries and data contracts between producers and consumers, including schema
• Design the lakehouse: table format, partitioning strategy, schema evolution, compaction, and
• Architect the analytical serving layer for three workload classes with conflicting demands
• Set direction on languages and frameworks in the data stack
• Engineer data quality and observability into the platform: validation and quarantine paths

🎯 Requirements

• 10+ years of software or data engineering experience, with significant time architecting
• Deep expertise in stream and batch processing at scale with Kafka, Flink, and Spark or close
• Strong Python and PySpark, solid Java for Flink stream processing, enough Scala for reading Spark
• Hands-on lakehouse storage design in production (Parquet, Iceberg, partitioning, compaction, schema
• Experience architecting OLAP serving layers (ClickHouse, Druid, Pinot, BigQuery, Snowflake)
• Strong distributed systems fundamentals: exactly-once semantics, ordering, backpressure

🎁 Benefits

• Competitive salary
• Stock options
• Health benefits
• Unlimited PTO
• Parental leave
• Tuition reimbursements