Senior/Lead Data Engineer – AI-Native Aftermarket Platform

📋 Description

• Design and build robust, idempotent data pipelines from scratch.
• Design star and snowflake schemas; write grain-aware SQL.
• Write production-grade Python with type hints and tests.
• Build and test dbt models across staging, intermediate, and mart.
• Author and deploy Databricks Asset Bundles (DAB).
• Implement data quality checks to prevent nulls/duplicates.

🎯 Requirements

• SQL and dimensional modeling with medallion architecture, SCDs, grain management.
• Idempotent pipelines using incremental, checkpoint, replaceWhere.
• Production-grade Python with type hints, pytest, and ruff.
• Diagnose Spark/PySpark jobs via Spark UI.
• Delta Lake features: MERGE, OPTIMIZE, Z-ORDER, time travel.
• dbt models, tests, and exposures.
• Deploy with Databricks Asset Bundles (DAB) and Unity Catalog.
• Pre-write asserts and schema checks; maintain dbt tests.

🎁 Benefits

• 100% Remote Work from anywhere with reliable internet.
• Highly competitive USD pay.
• Paid time off to rest and recharge.
• Work with autonomy to manage your time.
• Work with top American companies on high-impact projects.
• Diverse, global network across 25+ countries.