Senior Data Engineer - Web Scraping

📋 Description

• Design, develop, deploy, and maintain web scrapers from diverse sources.
• Use Python and Pandas to clean, explore, transform, and prepare large datasets.
• Build and maintain data pipelines ingesting scraped data into databases/data warehouses.
• Develop and manage scheduled workflows with Airflow and other tools.
• Collaborate with analysts and stakeholders to translate data needs into solutions.
• Develop quality-control checks for data availability, accuracy, and integrity.

🎯 Requirements

• Bachelor’s or master’s in CS/Engineering or related field.
• 4–6 years of experience in data engineering or related field.
• Strong Python, SQL, and database knowledge.
• Advanced Pandas for data cleaning and transformation.
• Web scraping experience with Selenium, Scrapy, Fiddler, Postman, XPath.
• Experience with Apache Airflow for workflows.

🎁 Benefits

• Fully remote position with global flexibility.
• Full-time opportunity in a collaborative engineering environment.
• Autonomy and ownership of technical challenges.
• Opportunity to work on web-scraping, data engineering, automation projects.
• Exposure to complex datasets supporting analytics/investment decisions.
• Collaboration with engineering, product, analysts, data scientists.