Senior Data Engineer - Web Scraping

📋 Description

• Design, develop, deploy, and maintain web scrapers from diverse sources.
• Use Python and Pandas to clean, explore, transform large datasets.
• Build data pipelines feeding databases and data warehouses.
• Develop scheduled workflows with Apache Airflow for reliable delivery.
• Collaborate with analysts and stakeholders on data needs.
• Implement quality checks for data accuracy and integrity.

🎯 Requirements

• Bachelor’s or master’s in CS/Engineering or related field.
• 4–6 years in data engineering or similar.
• Strong Python, SQL, and database tech skills.
• Advanced Pandas for data cleaning and transformation.
• Web scraping experience with Selenium, Scrapy, Fiddler, Postman, XPath.
• Experience with Airflow for workflows and pipelines.

🎁 Benefits

• Fully remote position, work from anywhere in Australia.
• Full-time opportunity in a collaborative environment.
• Autonomy and ownership of technical challenges.
• Opportunity to work on web-scraping, data engineering, and automation projects.
• Exposure to complex datasets for analytical decisions.
• Collaboration with engineers, product, analysts, and data scientists.