Senior Data Engineer - Data Platform

📋 Description

• Architect and build scalable transformation, warehouse, and data-processing systems capable of
• Design production patterns for LLM-powered extraction, enrichment, entity resolution, and semantic
• Develop evaluation frameworks with labelled datasets, scoring mechanisms, judge calibration
• Establish clear standards for when deterministic rules, SQL, data contracts, and dbt tests should
• Own warehouse architecture and optimization, including dbt transformation layers, Snowflake
• Build reliable orchestration and infrastructure patterns using Airflow and AWS, with appropriate

🎯 Requirements

• 5+ years of experience building and owning production-grade data platforms in business-critical
• Proven experience working with billions of rows and designing systems, pipelines, and quality
• Demonstrated experience deploying LLMs within production data pipelines for extraction, enrichment
• Experience designing evaluation or test harnesses used by other engineers, including scorers
• Strong architectural judgment when deciding between deterministic data-quality approaches and
• Expert-level Python and SQL skills, with strong knowledge of performance optimization, concurrency

🎁 Benefits

• Fully remote position with the flexibility to work from India.
• Opportunity to work on greenfield data and AI infrastructure at significant scale.
• High technical ownership, with the ability to shape architecture, engineering standards, and
• Exposure to frontier challenges involving LLM evaluation, AI-powered data pipelines, entity
• Lean, senior engineering environment with minimal hierarchy and strong individual ownership.
• Fast-paced delivery culture with frequent releases and end-to-end responsibility for the technology