Senior Software Engineer (Web Scraping, Data acquisition, Data collection)

Added
21 hours ago
Type
Full time
Salary
Upgrade to Premium to se...

Related skills

selenium python playwright frida scrapy

๐Ÿ“‹ Description

  • Design and build distributed scraping architectures that scale across thousands of domains.
  • Reverse engineer APIs and mobile apps using Frida, mitmproxy, Charles Proxy, burp and more.
  • Detect anti-bot measures to build crawlers that appear human-like.
  • Lead technical innovation in scraping; prototype new approaches and share knowledge with the team.
  • Set up anomaly detection and monitoring to detect blockers or failures early.

๐ŸŽฏ Requirements

  • 5+ years Python and large-scale scraping experience.
  • Deep understanding of anti-bot technologies and bypass strategies.
  • Experience with Scrapy, Requests, httpx, Selenium, Playwright or similar.
  • Skilled with proxies, session management, cookie injection, TLS tweaking.
  • Strong debugging across browser, HTTP traffic, and device-level interactions.
  • Familiarity with Parquet/Avro or real-time stream processing.

๐ŸŽ Benefits

  • Flexible working environment
  • Volunteer time off
  • LinkedIn Learning
  • Employee-Assistance-Program (EAP)
Share job

Meet JobCopilot: Your Personal AI Job Hunter

Automatically Apply to Engineering Jobs. Just set your preferences and Job Copilot will do the rest โ€” finding, filtering, and applying while you focus on what matters.

Related Engineering Jobs

See more Engineering jobs โ†’