Senior Software Engineer (Web Scraping, Data acquisition, Data collection)

Added
5 minutes ago
Type
Full time
Salary
Upgrade to Premium to se...

Related skills

selenium python kafka playwright celery
JobCopilot logo
Meet JobCopilot: Your Personal Al Job Hunter
Automatically Apply to Your Dream Jobs While You Sleep
Try it now โ†’

๐Ÿ“‹ Description

  • Design scalable distributed scraping architectures across domains.
  • Reverse engineer APIs and mobile apps using Frida, mitmproxy, Charles, Burp.
  • Detect anti-bot measures and adapt crawlers to look human.
  • Lead innovation in scraping, prototype new approaches.
  • Set up anomaly detection to catch blockers and failures.

๐ŸŽฏ Requirements

  • 5+ years Python and large-scale scraping experience.
  • Deep anti-bot, fingerprinting, WAF, JS challenges knowledge.
  • Experience with Scrapy, Requests, httpx, Selenium, Playwright.
  • Proficient with proxies, session management, TLS tweaks.
  • Strong debugging across browser, HTTP, device-level interactions.
  • Knowledge of Parquet/Avro, real-time processing.

๐ŸŽ Benefits

  • Flexible working environment.
  • Tech-focused culture with 60+ scrapers on team.
  • Competitive salary and opportunities to grow fast.
Share job

Meet JobCopilot: Your Personal AI Job Hunter

Automatically Apply to Engineering Jobs. Just set your preferences and Job Copilot will do the rest โ€” finding, filtering, and applying while you focus on what matters.

Related Engineering Jobs

See more Engineering jobs โ†’