Senior Data Engineer

📋 Description

• Own and evolve data ingestion pipelines, including source ingestion/scraping, data cleaning and
• Design and maintain reliable batch and event-driven data workflows across our data platform
• Diagnose and resolve identity-resolution issues across multiple data sources, including
• Develop and maintain data quality and validation frameworks, including freshness monitoring
• Monitor data at the ingestion boundary and proactively identify issues before they impact
• Partner with engineering teams responsible for the events bridge and downstream identity services

🎯 Requirements

• 5+ years of experience building and operating production-grade data pipelines
• Strong experience working with both batch data processing and event-driven architectures
• Hands-on experience with AWS Glue, Athena, and S3-based data lakes, including
• Strong proficiency in Python and SQL for data transformation, processing, and analysis
• Experience with identity resolution, entity matching, or deduplication, including exact and fuzzy
• Understanding of the challenges and tradeoffs involved in maintaining durable identifiers and