Databricks Solution Architect

Added
5 days ago
Type
Full time
Salary
Upgrade to Premium to se...

Related skills

terraform sql databricks pyspark delta lake

๐Ÿ“‹ Description

  • Architect and lead enterprise lakehouse on Databricks (Delta Lake, Unity Catalog).
  • Design scalable batch and streaming pipelines with PySpark, Spark SQL, Delta Live Tables.
  • Define platform standards for data modeling, CI/CD, code quality, testing, and observability.
  • Lead governance using Unity Catalog; data lineage, access control, audit, and PII.
  • Optimize Spark workloads for performance and cost: clustering, Photon, tuning.
  • Mentor data engineers; lead architecture reviews and engineering standards.

๐ŸŽฏ Requirements

  • 8+ years data engineering experience, 4+ years building production workloads on Databricks.
  • Deep expertise in Apache Spark (PySpark, Spark SQL); performance tuning, partitioning, Catalyst/Photon.
  • Hands-on with Delta Lake, Unity Catalog, Databricks Workflows, and Delta Live Tables.
  • Production cloud experience on AWS, Azure, or GCP; networking, IAM, storage (S3/ADLS/GCS).
  • Proficiency in Python and SQL; Scala is a plus.
  • Experience designing medallion architectures and dimensional models.

๐Ÿ›ƒ Visa sponsorship

Share job

Meet JobCopilot: Your Personal AI Job Hunter

Automatically Apply to Data Jobs. Just set your preferences and Job Copilot will do the rest โ€” finding, filtering, and applying while you focus on what matters.

Related Data Jobs

See more Data jobs โ†’