Senior Data Engineer - Web Scraping

📋 Description

• Design, develop, deploy, and maintain web scrapers to collect datasets from diverse sources.
• Use Python and Pandas to clean, explore, transform, and prepare large datasets.
• Build data pipelines to ingest scraped data into databases and data warehouses.
• Develop and manage scheduled workflows with Apache Airflow and other tools.
• Collaborate with analysts and stakeholders to translate data needs into technical solutions.
• Maintain quality checks to ensure data availability, accuracy and integrity.

🎯 Requirements

• Bachelor’s or master’s in CS/Engineering or related field.
• 4–6 years of data engineering experience.
• Strong Python and SQL skills.
• Advanced Pandas for data cleaning and transformation.
• Web scraping experience with Selenium, Scrapy, Fiddler, Postman, XPath.
• Experience with Airflow for pipelines.

🎁 Benefits

• Fully remote position from anywhere.
• Full-time role in a collaborative engineering environment.
• Autonomy, ownership, and opportunity to tackle challenging data problems.
• Work on web-scraping, data engineering, automation, and data-product initiatives.
• Exposure to complex datasets supporting analytical decision-making.