Senior/Lead Data Engineer

📋 Description

• Build and scale robust data pipelines using a modern data stack.
• Design star and snowflake schemas and SQL for data marts.
• Write production-grade Python with type hints and tests.
• Build and test dbt models across staging, intermediate, and mart layers.
• Deploy jobs with Databricks Asset Bundles (DAB) following patterns.
• Own end-to-end data pipelines; mentor mid-level engineers and set standards.

🎯 Requirements

• SQL and dimensional modeling (medallion, SCDs, grain management).
• Idempotent pipelines with incremental, checkpoint, replaceWhere.
• Production-grade Python with type hints, pytest, and ruff.
• Diagnose Spark / PySpark jobs via Spark UI.
• Delta Lake features: MERGE, OPTIMIZE, Z-ORDER, time travel.
• dbt models, tests, and exposures in Unity Catalog.

🎁 Benefits

• 100% Remote Work
• Highly Competitive USD Pay
• Paid Time Off
• Work with Autonomy