Senior Software Engineer (Web Scraping, Data acquisition, Data collection)

📋 Description

• Design and build distributed scraping architectures that can scale across thousands of domains.
• Reverse engineer APIs and mobile apps using tools like Frida, mitmproxy, Charles Proxy, burp and
• Detect anti-bot measures and build crawlers that appear more human-like.
• Lead technical innovation in scraping: identify edge cases, prototype new approaches, share
• Set up anomaly detection and monitoring to detect blockers or failures early

🎯 Requirements

• 5+ years of experience with Python and large-scale scraping projects.
• Deep understanding of anti-bot technologies and how to bypass them, fingerprinting, WAFs
• Experience with Scrapy, Requests, httpx, Selenium, Playwright, or custom headless browser drivers.
• Skilled handling proxies (residential, datacenter, rotating), session management, cookie injection
• Strong debugging skills across browser, HTTP traffic, and device-level interactions.
• Familiarity with Parquet, Avro, or real-time stream processing; knowledge of MongoDB, InfluxDB

🎁 Benefits

• Flexible working environment
• Volunteer time off
• LinkedIn Learning
• Employee-Assistance-Program (EAP)