Data Engineer, Ingestion Platform

📋 Description

• Design, optimize, and own pipelines that scrape, process, and ingest transaction and listing data
• Build reusable ingestion infrastructure (auth, retries, session/proxy management, monitoring)
• Implement monitoring and alerting for pipeline latency, uptime, and coverage
• Optimize storage and processing, reduce manual intervention, and ensure cost-effectiveness
• Partner with pricing, ML, product, and analytics teams to deliver standardized data
• Leverage AI for parser fixes, triage loops, LLM extraction, and MCP servers

🎯 Requirements

• 3-4 years in data engineering or adjacent role
• Modern web scraping at scale with Playwright or similar, TLS/request fingerprinting
• Strong Python (3+ years) and solid SQL
• Experience owning pipelines end-to-end
• Orchestration experience with Airflow, Dagster, or similar
• Cloud development (AWS, GCP)

🎁 Benefits

• 85% coverage for medical, dental, and vision
• Generous PTO
• Parental leave at full salary
• $200/month wellness and $100/month home office stipend
• Free DoorDash Pass membership
• Remote-first with WeWork access