Senior Data Engineer - Web Scraping

📋 Description

• Design, develop, deploy, and maintain web scrapers to collect data from diverse sources.
• Use Python and Pandas to clean, explore, transform, and prepare large datasets.
• Build data pipelines ingesting scraped data into databases and data warehouses.
• Develop and manage workflows with Apache Airflow for reliable data delivery.
• Collaborate with analysts and stakeholders to translate data needs into solutions.
• Develop data quality checks and maintain alerting to ensure reliability.

🎯 Requirements

• Bachelor's or master's in Computer Science, Engineering, or related technical field.
• 4–6 years of professional experience in data engineering or related field.
• Strong Python and SQL/database skills.
• Advanced hands-on expertise with the Python Pandas library.
• Web scraping experience with Selenium, Scrapy.
• Experience with Apache Airflow for workflow orchestration.

🎁 Benefits

• Fully remote position with the flexibility to work from anywhere.
• Full-time opportunity within a collaborative, team-oriented engineering environment.
• Significant autonomy, ownership, and trust in tackling technical challenges.
• Opportunity to work on sophisticated web-scraping and data-product initiatives.