Staff Software Engineer, Data Infrastructure

Added
2 hours ago
Type
Full time
Salary
Upgrade to Premium to se...

Related skills

s3 python kubernetes machine learning distributed systems

📋 Description

  • Design, architect, and operate the distributed storage system feeding model training and evaluation.
  • Lead deployment across multiple Kubernetes clusters at petabyte scale, setting standards.
  • Collaborate with researchers and training-infra teams to define data read/write patterns.
  • Optimize networking, I/O, and consistency for moving large datasets across regions.
  • Drive improvements using GPU idle time and time-to-insight as key success metrics.

🎯 Requirements

  • Strong storage fundamentals: replication, consistency, caching, data lifecycle management.
  • Strong coding ability in Python and Go, with mentoring experience.
  • Experience running stateful systems on Kubernetes (PVs, CSI drivers, StatefulSets).
  • Hands-on experience with cloud object storage (e.g., S3) and POSIX filesystems.
  • Bonus: experience with HPC filesystems (Weka, VAST, Lustre) at scale.
  • Familiarity with data-loading and checkpointing patterns in large-scale model training.

🎁 Benefits

  • $500 home office stipend
  • $75 weekly lunch stipend
  • Full health and dental benefits, mental health budget
  • RRSP matching, 401K, pension scheme
  • 100% parental leave top-up for up to 6 months
  • Education stipend, 6 weeks vacation, travel budget
Get alerts for new remote engineering jobs
A weekly email with new matches. Unsubscribe anytime.
Share job

Meet JobCopilot: Your Personal AI Job Hunter

Automatically Apply to Engineering Jobs. Just set your preferences and Job Copilot will do the rest — finding, filtering, and applying while you focus on what matters.

Related Engineering Jobs

See more Engineering jobs →