Senior Data Engineer - Databricks

📋 Description

• Own production Databricks pipelines for ERP and CRM data.
• Design, develop, and optimize large-scale data pipelines for analytics and AI-driven apps.
• Ensure security, scalability, and reliability of data platforms.
• Provide production support: monitoring, alerting, incident response, and SLA management.
• Migrate legacy ETL/ELT workflows to Databricks architectures with automated deployments.
• Build and maintain Delta Lake architectures with schema design and data quality enforcement.

🎯 Requirements

• 4+ years in data engineering building production-grade pipelines.
• 2+ years with Databricks and Apache Spark in Azure and/or AWS.
• Strong PySpark, SQL, and Python skills delivering scalable solutions under SLA.
• Hands-on Delta Lake experience: ACID, schema evolution, optimization, streaming/incremental
• Databricks workload tuning, compute resource management, performance improvements.
• PostgreSQL expertise: query optimization, schema design, production data integration.

🎁 Benefits

• Comprehensive healthcare coverage for employees and families.
• 401(k) with employer matching.
• Unlimited paid time off.
• Paid parental leave.
• Online legal services, financial planning, and wellness programs.
• Travel and lifestyle discounts, education resources, and referral bonuses.