Member of Engineering (Scalability)

📋 Description

• Identify, study, and troubleshoot hardware problems during training at scale
• Minimize GPU idle time during faults
• Design tools to accelerate training recovery
• Improve checkpointing performance and reliability
• Write Python (PyTorch), Cython, C/C++, CUDA API code

🎯 Requirements

• Experience with PyTorch and Python
• Linux kernel and Linux API knowledge
• C/C++ and CUDA programming
• Distributed systems and NCCL
• Transformers and LLM fundamentals
• Strong software engineering skills

🎁 Benefits

• Fully remote work and flexible hours
• 37 days vacation and holidays
• Health insurance allowance for you and dependents
• Company-provided equipment
• Well-being, learning and home office allowances
• Frequent team get-togethers
• Diverse and inclusive people-first culture