Senior Software Engineer (Web Scraping, Data acquisition, Data collection)

Added
1 hour ago
Type
Full time
Salary
Upgrade to Premium to se...

Related skills

selenium mongodb python playwright influxdb

๐Ÿ“‹ Description

  • Design and build distributed scraping architectures that can scale across thousands of domains.
  • Reverse engineer APIs and mobile apps using tools like Frida, mitmproxy, Charles Proxy, burp and
  • Detect common anti-bot measures (like JavaScript checks or browser behavior detection) to build
  • Lead technical innovation in scraping: identify edge cases, prototype new approaches, and share
  • Set up anomaly detection and monitoring to detect blockers or failures early

๐ŸŽฏ Requirements

  • 5+ years of experience with Python and large-scale scraping projects.
  • Deep understanding of anti-bot technologies and how to bypass them, fingerprinting, WAFs
  • Experience working with Scrapy, Requests, httpx, Selenium, Playwright, or custom headless browser
  • Skilled at handling proxies (residential, datacenter, rotating), session management, cookie
  • Strong debugging skills across browser, HTTP traffic, and device-level interactions.
  • You think independently and enjoy solving problems no one has solved before.

๐ŸŽ Benefits

  • Flexible working environment
  • Volunteer time off
  • LinkedIn Learning
  • Employee-Assistance-Program (EAP)
Share job

Meet JobCopilot: Your Personal AI Job Hunter

Automatically Apply to Engineering Jobs. Just set your preferences and Job Copilot will do the rest โ€” finding, filtering, and applying while you focus on what matters.

Related Engineering Jobs

See more Engineering jobs โ†’