Senior/Lead Data Engineer – AI-Native Aftermarket Platform | DR

📋 Description

• Design robust, idempotent data pipelines from scratch using a modern data stack.
• Design star and snowflake schemas; write precise, grain-aware SQL to build data marts.
• Write production-grade Python code with type hints and testing.
• Build and test dbt models across staging, intermediate, and mart layers.
• Author and deploy jobs using Databricks Asset Bundles (DAB) per patterns.
• Own data pipelines end-to-end; mentor engineers and drive data strategy.

🎯 Requirements

• SQL and dimensional modeling, medallion architecture, SCDs, grain management.
• Design idempotent pipelines with incremental, checkpoint, and replaceWhere strategies.
• Production-grade Python engineering with type hints, pytest, and ruff.
• Diagnose and resolve Spark/PySpark jobs via Spark UI.
• Deep understanding of Delta Lake (MERGE, OPTIMIZE, Z-ORDER, time travel).
• dbt models, tests, exposures; Databricks Asset Bundles (DAB) with Unity Catalog.

🎁 Benefits

• 100% Remote Work: work from anywhere.
• Competitive USD pay.
• Paid Time Off.
• Autonomy to manage your time and deliver results.
• Work with top American companies.
• Diverse, global team across 25+ countries.