Senior Databricks Platform Engineer

📋 Description

• Design, configure, administer, and maintain the enterprise Databricks Lakehouse Platform, including
• Develop and optimize data pipelines, ETL/ELT processes, and ingestion frameworks using Apache
• Establish and govern Unity Catalog structures, including catalogs, schemas, tables, roles, groups
• Automate platform provisioning, configuration, testing, and deployments using Terraform, Python
• Monitor platform health and performance through logging, alerting, observability, capacity
• Perform Spark and SQL performance tuning, scalability testing, workload optimization, and

🎯 Requirements

• A Master’s degree in information systems or a related field with 12+ years of general experience
• Strong hands-on experience implementing, executing, and optimizing the Databricks Lakehouse
• Demonstrated expertise in Databricks performance engineering, scalability testing, Spark
• Proficiency in Python, Bash, and SQL for automation, scripting, data engineering, and platform
• Experience with data ingestion, ETL/ELT, lakehouse and warehouse architectures, Apache Spark
• Experience operating Databricks in AWS-based or hybrid cloud environments, with an understanding of

🎁 Benefits

• Salary: between $169,604 and $229,464 annually depending on experience, location, and contract.
• Remote work: fully remote anywhere in the United States.
• Full-time: 40 hours per week, no travel.
• Medical plan options including health savings accounts, and dental & vision coverage.
• 401(k) retirement plan including pre-tax and post-tax contributions and employer match.
• Flexible work arrangements and a variety of paid leave programs.