MTS - Pre-Training Data & Acquisition Engineer

📋 Description

• Identify and integrate valuable data sources across engineering and scientific domains.
• Build distributed crawlers, API integrations, and bulk ingestion systems with effective scheduling
• Develop pipelines for parsing, extraction, normalization, deduplication, quality filtering, and
• Optimize throughput and cost across networking, compute, storage, and databases as acquisition and
• Build monitoring and tooling to track source coverage, ingestion failures, processing throughput
• Work closely with pre-training researchers to translate data requirements into reliable pipelines

🎯 Requirements

• Experience building and operating large-scale distributed systems, web crawlers, or data processing
• Strong programming ability in Python and Rust, Go, C++, or a comparable systems language.
• A practical understanding of web infrastructure, including HTTP, DNS, concurrency, caching, and
• Hands-on experience with databases, object storage, and distributed batch or streaming processing.
• Experience designing fault-tolerant systems that handle partial failures, resume interrupted work
• Ability to profile and debug performance across CPU, memory, disk, and network usage.

🎁 Benefits

• Work with world-class researchers on frontier AI systems for the physical world.
• Build the acquisition and processing systems that supply engineering, scientific, and multimodal
• Competitive compensation and flexible work arrangements.
• High-impact, mission-driven environment.