Staff Software Engineer - Ingestion Platform

Added
28 minutes ago
Type
Full time
Salary
Upgrade to Premium to se...

Related skills

bigquery java s3 python go

📋 Description

  • Design, write, and deliver reliable software for distributed data movement across streaming and
  • Own the architecture and evolution of the platform’s control plane and data plane, including
  • Expand the platform beyond Kafka-to-BigQuery by helping deliver production-ready paths to S3/GCS
  • Build high-quality connectors and abstractions for systems such as Kafka, BigQuery, S3, GCS
  • Improve the self-service experience for platform users through clear APIs, safe defaults, automated
  • Lead migrations from bespoke and legacy ingestion systems to the Ingestion Platform, partnering

🎯 Requirements

  • 10+ years of hands-on experience building internet-scale distributed systems, data infrastructure
  • BS, MS, PhD in Computer Science, a related field, or equivalent practical experience.
  • Strong software development experience in one or more general-purpose languages such as Go, Python
  • Deep experience designing and operating high-throughput, fault-tolerant data pipelines or platform
  • Experience with data movement patterns and systems such as Kafka, BigQuery, S3, GCS, Apache
  • Experience designing APIs and platform abstractions, including schema evolution, serialization

🎁 Benefits

  • Base salary
  • Equity in the form of restricted stock units
  • Commission (depending on position offered)
  • Medical, dental, and vision insurance
  • 401(k) program with employer match
  • Generous time off for vacation
Share job

Meet JobCopilot: Your Personal AI Job Hunter

Automatically Apply to Data Jobs. Just set your preferences and Job Copilot will do the rest — finding, filtering, and applying while you focus on what matters.

Related Data Jobs

See more Data jobs →