Senior Data Platform Engineer

📋 Description

• Design and evolve Sword's streaming lakehouse - the foundation that every data consumer in the
• Build and operate distributed streaming pipelines that move data at low latency and high
• Own the durable workflows that coordinate complex data movement across systems.
• Shape the platform's API surface - the interface producers and consumers use so they never need to
• Drive evaluations and integrations with vendor data platforms, sitting inside the architectural
• Contribute to the self-service and agentic layer: interfaces designed to be consumed by humans

🎯 Requirements

• Proven experience designing and operating data platforms at scale - warehouse, data lake, or
• Hands-on experience with a modern lakehouse table format - Iceberg strongly preferred; Delta Lake
• Clear mental model of catalogs (REST, Polaris, Glue, Unity, Hive) - their trade-offs, and how
• Exposure to at least one vendor lakehouse or query platform - Snowflake, Starburst, or Databricks —
• Strong experience with a distributed processing engine - Flink strongly preferred; Spark also fine.
• Familiarity with durable execution - Temporal, Restate, or similar - or at minimum a solid mental

🎁 Benefits

• Deeper familiarity with open/REST catalogs (Polaris, Nessie, Unity) beyond basic use.
• Observability stack fluency (Prometheus, Grafana, OpenTelemetry).
• Prior work on agentic or AI-facing API surfaces, or MCP-style interfaces.
• Experience in HIPAA, FedRAMP, or SOC 2 environments.
• dbt, DataHub, or data contract tooling exposure.