Senior Data Engineer - Web Scraping

Added
15 days ago
Type
Full time
Salary
Salary not provided

Related skills

javascript html selenium sql python

📋 Description

  • Design, develop, deploy, and maintain web scrapers to collect datasets from diverse sources.
  • Use Python and Pandas to clean, explore, transform, and prepare large datasets.
  • Build data pipelines that ingest scraped data into databases and data warehouses.
  • Develop and manage scheduled workflows with Apache Airflow and orchestration tools.
  • Collaborate with analysts and stakeholders to translate data needs into technical solutions.
  • Develop quality-control checks to validate data availability, accuracy, and integrity.

🎯 Requirements

  • Bachelor’s or master’s degree in CS, Engineering, or related field.
  • 4–6 years of professional data engineering experience.
  • Strong Python programming and SQL/database knowledge.
  • Advanced expertise with Pandas for data cleaning and transformation.
  • Web-scraping experience with Selenium, Scrapy, Fiddler, Postman, XPath.
  • Experience with Apache Airflow for workflow orchestration.

🎁 Benefits

  • Fully remote position from anywhere in Netherlands/Europe.
  • Full-time opportunity in a collaborative engineering environment.
  • Significant autonomy and ownership over technical challenges.
  • Work on web-scraping, data engineering, automation, and data-product initiatives.
  • Exposure to complex datasets supporting analytical and investment decisions.
  • Collaboration with engineers, product, analysts, and data scientists.
Share job

Meet JobCopilot: Your Personal AI Job Hunter

Automatically Apply to Engineering Jobs. Just set your preferences and Job Copilot will do the rest — finding, filtering, and applying while you focus on what matters.

Related Engineering Jobs

See more Engineering jobs →