Staff Data Platform Engineer

Added
15 days ago
Type
Full time
Salary
Salary not provided

Related skills

docker aws python kafka pyspark
JobCopilot logo
Meet JobCopilot: Your Personal Al Job Hunter
Automatically Apply to Your Dream Jobs While You Sleep
Try it now โ†’

๐Ÿ“‹ Description

  • Lead a team of engineers to deliver data platform initiatives end to end
  • Own data architecture across OLTP, OLAP, and NoSQL stores (Aurora PostgreSQL, Redshift, MongoDB)
  • Design and operate distributed real-time and batch pipelines in Python and PySpark (Kafka, Kinesis
  • Lead entity resolution and MDM architecture for provider data
  • Build and own data products with clear contracts, SLAs, and consumers
  • Be accountable for data reliability, freshness, quality, and cost, with the observability to prove

๐ŸŽฏ Requirements

  • 10+ years building production data systems, including Staff or Tech Lead scope
  • Led a team of engineers to deliver complex data systems
  • Expert Python and production PySpark
  • Deep distributed systems knowledge: consistency, partitioning, idempotency, backpressure, failure
  • Significant entity resolution and MDM experience: matching, deduplication, survivorship, golden
  • Built and owned data products used by other teams

๐ŸŽ Benefits

  • 100% coverage of health, dental, and vision insurance premiums for employees
  • US-based team: unlimited PTO with at least two weeks off each year
  • India: health insurance, statutory leave benefits, additional wellness (menstrual) leave for women
Get alerts for new remote data jobs
A weekly email with new matches. Unsubscribe anytime.
Share job

Meet JobCopilot: Your Personal AI Job Hunter

Automatically Apply to Data Jobs. Just set your preferences and Job Copilot will do the rest โ€” finding, filtering, and applying while you focus on what matters.

Related Data Jobs

See more Data jobs โ†’