Senior Data Infrastructure Engineer (Scraping & Scale)

📋 Description

• Design and manage web scraping infrastructure using residential proxy networks, TLS fingerprinting
• Build fault-tolerant, high-throughput scraping pipelines to collect data from Instagram, TikTok
• Develop distributed queues and workflow orchestration systems using technologies such as Temporal
• Architect storage environments for structured and unstructured data using Parquet, Apache Iceberg
• Implement monitoring, automated alerts, and recovery mechanisms to identify platform changes
• Maintain reliable data ingestion at scale while minimizing downtime and supporting daily processing

🎯 Requirements

• At least 4 years of experience in high-volume web scraping, data engineering, or reverse
• Strong experience handling advanced anti-bot systems, including Cloudflare, Akamai, and PerimeterX
• Advanced proficiency in Python or Go.
• Extensive experience with browser automation and scraping frameworks such as Playwright, Puppeteer
• Practical knowledge of distributed systems and task queues, including Temporal, Ray, Kafka, and
• Strong SQL skills and experience with modern analytical data lakes and data warehouses.

🎁 Benefits

• Fully remote work arrangement.
• Full-time employment.
• Salary, healthcare coverage, paid leave, and additional benefits are not specified in the provided