Senior Data Engineer - Web Scraping

📋 Description

• Design, develop, deploy, and maintain web scrapers from diverse sources.
• Use Python and Pandas to clean and transform large datasets.
• Build data pipelines to ingest scraped data into databases/data warehouses.
• Manage scheduled workflows with Airflow and orchestration tools.
• Collaborate with analysts and stakeholders on data requirements.
• Develop quality checks to ensure data accuracy and integrity.

🎯 Requirements

• Bachelor’s or master’s in CS/Engineering or related field.
• 4–6 years in data engineering or related area.
• Strong Python programming and SQL/database knowledge.
• Advanced Pandas for data cleaning and transformation.
• Web scraping experience with Selenium, Scrapy, XPath, etc.
• Airflow experience for data pipelines and orchestration.

🎁 Benefits

• Fully remote position with global collaboration.
• Full-time opportunity in a team-oriented engineering environment.
• Significant autonomy and ownership of projects.
• Work on web-scraping, data engineering, automation, and data products.
• Exposure to complex datasets for analytical decisions.
• Collaboration with engineers, product, analysts, and data scientists.