Staff Software Engineer, Lakeflow Pipelines DR

Added
8 days ago
Type
Full time
Salary
Upgrade to Premium to se...

Related skills

java database python distributed systems go

πŸ“‹ Description

  • Design and implement distributed systems that replicate and recover pipelines across regions
  • Work on cross-region replication and recovery for Lakeflow pipelines, streaming tables, and
  • Ensure distributed consistency across pipeline dependencies, table versions, and transaction logs
  • Implement failover and failback workflows with conservative correctness guardrails
  • Develop deep clone, metadata reconciliation, observability, and failure-injection testing
  • Conduct high-fidelity recovery simulations, game-day testing, and formal reasoning about failure

🎯 Requirements

  • 8+ years of experience working on related systems preferred
  • Passion for distributed systems, databases, storage systems, streaming systems, or reliability
  • Strong software engineering skills in Java, Scala, C++, Go, Python, or a similar production language
  • Understanding of consistency, transactions, idempotency, replication, checkpointing, and data
  • Ability to define and work toward a multi-year technical vision with incremental
  • Optional: PhD or advanced research experience in databases, distributed systems, or storage

🎁 Benefits

  • Comprehensive benefits and perks that meet the needs of all employees
  • Annual performance bonus, equity, and the benefits listed above
  • Commitment to fostering a diverse and inclusive culture where everyone can excel
  • Equal employment opportunity standards
Share job

Meet JobCopilot: Your Personal AI Job Hunter

Automatically Apply to Engineering Jobs. Just set your preferences and Job Copilot will do the rest β€” finding, filtering, and applying while you focus on what matters.

Related Engineering Jobs

See more Engineering jobs β†’