Data Engineer - Data Foundry Engineer

📋 Description

• Design and maintain robust data pipelines from APIs, docs, and sensors
• Integrate and optimize ETL/ELT processes for performance and reliability
• Own the full dataset lifecycle from ingestion to training-ready data
• Define and enforce data quality standards and governance
• Build labeling pipeline infrastructure for ML apps with annotation team
• Participate in architecture, code reviews, and mentorship

🎯 Requirements

• 3+ years in data engineering
• Degree in CS, Data Eng, Computer Engineering, or related field
• Solid understanding of ML training lifecycle and dataset quality
• Familiarity with Medallion Architecture or Data Mesh
• Proficiency in Python for data manipulation, pipelines and automation
• Workflow orchestration with Temporal, Airflow, Prefect, Dagster

🎁 Benefits

• Experience making architectural decisions and contributing to team growth
• Go for high-performance pipeline components
• dbt for transformation layer modeling
• Open table formats: Delta Lake, Iceberg, or Hudi
• Cloud experience, preferably OCI; AWS/GCP/Azure valued
• Rapid prototyping with Streamlit or GenAI