Engineer, Supercomputing & Distributed Systems

Added
2 hours ago
Type
Full time
Salary
Salary not provided

Related skills

sql python pandas kubernetes pytorch

πŸ“‹ Description

  • Build and operate AI infra for research and inference.
  • Design multi-stage pipelines to turn petabytes of data into datasets.
  • Run models on billions of images.
  • Deploy and combine LLMs to caption multimedia data.
  • Manage distributed training on 1000+ GPU Kubernetes clusters.
  • Solve orchestration and scaling for large-scale GPU jobs.

🎯 Requirements

  • Strong Python, PyArrow, DuckDB, SQL, Pandas, NumPy, PyTorch.
  • Kubernetes and GPU orchestration.
  • Designing large-scale ETL systems.
  • Containerization, OS, file systems, and networking fundamentals.
  • Distributed systems design.
  • Distributed training systems (NCCL, InfiniBand, RDMA) and streaming (Kafka/Pulsar).
Share job

Meet JobCopilot: Your Personal AI Job Hunter

Automatically Apply to Engineering Jobs. Just set your preferences and Job Copilot will do the rest β€” finding, filtering, and applying while you focus on what matters.

Related Engineering Jobs

See more Engineering jobs β†’