Member of Engineering (Pre-training / Data Research)

📋 Description

• Follow latest LLM data quality research; know open-source datasets.
• Design pipelines to generate large data with high diversity and efficiency.
• Collaborate with Pretraining, Posttraining, Evals, Product for rapid feedback.
• Run data ablations and experiments to improve dataset quality.

🎯 Requirements

• Strong ML and engineering background
• LLM experience, transformers
• Data ablations and scaling laws
• Mid-training and post-training techniques
• Python programming and prompt engineering
• Experience with GPU clusters and distributed pipelines
• Evals tracking model capabilities
• Data quality obsession; data curation and tokenization

🎁 Benefits

• Fully remote work & flexible hours
• 37 days/year vacation & holidays
• Health insurance allowance for you & dependents
• Company-provided equipment
• Well-being, learning & home office allowances
• Frequent team get togethers
• Diverse & inclusive culture