Senior Data Engineer - Web Scraping

📋 Description

• Design, develop, deploy, and maintain web scrapers using a range of scraping techniques and tools
• Use Python and Pandas to clean, explore, transform, manipulate, and prepare large datasets for
• Build and maintain efficient data pipelines that ingest scraped data into databases and data
• Develop and manage scheduled workflows using Apache Airflow and other orchestration tools to ensure
• Collaborate with analysts and cross-functional stakeholders to understand current and anticipated
• Develop quality-control checks to validate data availability, accuracy, consistency, and integrity.

🎯 Requirements

• Bachelor’s or master’s degree in Computer Science, Engineering, or a related technical discipline.
• 4–6 years of professional experience in data engineering or a closely related field.
• Strong programming skills in Python and strong knowledge of SQL and database technologies.
• Advanced hands-on expertise with the Python Pandas library for data cleaning, manipulation
• Strong web-scraping experience with tools and technologies such as Selenium, Scrapy, Fiddler
• Strong experience with Apache Airflow for workflow orchestration and data pipeline management.

🎁 Benefits

• Fully remote position with the flexibility to work from anywhere.
• Full-time opportunity within a collaborative, team-oriented engineering environment.
• Significant autonomy, ownership, and trust in how you approach technical challenges.
• Opportunity to work on sophisticated web-scraping, data engineering, automation, and data-product
• Exposure to complex datasets supporting analytical and investment-related decision-making.
• Collaboration with engineering, product, analysts, data scientists, and other technology