Senior Software Engineer (Web Scraping, Data acquisition, Data collection)

📋 Description

• Design and build distributed scraping architectures that can scale across thousands of domains
• Reverse engineer APIs and mobile apps using tools like Frida, mitmproxy, Charles Proxy, burp and
• Detect common anti-bot measures (like JavaScript checks or browser behavior detection) to build
• Lead technical innovation in scraping: identify edge cases, prototype new approaches, and share
• Set up anomaly detection and monitoring to detect blockers or failures early

🎯 Requirements

• 5+ years of experience with Python and large-scale scraping projects
• Deep understanding of anti-bot technologies and how to bypass them, fingerprinting, WAFs
• Experience working with Scrapy, Requests, httpx, Selenium, Playwright, or custom headless browser
• Skilled at handling proxies (residential, datacenter, rotating), session management, cookie
• Strong debugging skills across browser, HTTP traffic, and device-level interactions
• You think independently and enjoy solving problems no one has solved before

🎁 Benefits

• Flexible working environment
• Volunteer time off
• LinkedIn Learning
• Employee-Assistance-Program (EAP)