Senior Data Engineer - Web Scraping

Added
16 days ago
Location
Type
Full time
Salary
Salary not provided

Related skills

docker selenium aws sql python

📋 Description

  • Design, develop, deploy, and maintain web scrapers to collect datasets.
  • Build data pipelines ingesting scraped data into databases/data warehouses.
  • Develop and manage scheduled workflows with Airflow and other tools.
  • Collaborate with analysts and stakeholders on data needs.
  • Ensure data quality, availability, and integrity with QC checks.
  • Maintain alerting and resolve data incidents for reliable delivery.

🎯 Requirements

  • Bachelor’s or Master’s in CS/Engineering or related field.
  • 4–6 years of data engineering experience.
  • Python and strong SQL/database skills.
  • Advanced Pandas for cleaning and transformation.
  • Web scraping with Selenium, Scrapy, Fiddler, Postman, XPath.
  • Airflow for workflow orchestration and pipelines.

🎁 Benefits

  • Fully remote position from anywhere in Europe.
  • Full-time opportunity in a collaborative engineering environment.
  • Autonomy, ownership, and trust in tackling challenges.
  • Work on advanced web-scraping, data engineering, automation, and products.
  • Exposure to complex datasets supporting analytical decisions.
  • Collaboration with engineers, product, analysts, data scientists.
Share job

Meet JobCopilot: Your Personal AI Job Hunter

Automatically Apply to Data Jobs. Just set your preferences and Job Copilot will do the rest — finding, filtering, and applying while you focus on what matters.

Related Data Jobs

See more Data jobs →