Data Engineer

📋 Description

• Design, develop, and maintain Databricks data pipelines and lakehouse capabilities
• Build automated ETL/ELT pipelines ingesting and delivering mission data
• Develop prod-grade data processing with Python, SQL, PySpark, Delta Lake
• Design/maintain data models, schemas, and lakehouse patterns
• Build and operate batch and streaming pipelines for mission needs
• Develop and manage Databricks notebooks, jobs, workflows, and clusters

🎯 Requirements

• 4+ years of relevant data engineering or software engineering experience
• Hands-on experience with Databricks
• Proficiency with Python, SQL, PySpark, Spark, Delta Lake
• Experience building automated ETL/ELT pipelines for large-scale data
• Experience designing/maintaining data models, schemas, and lakehouse architectures
• Experience managing Databricks notebooks, jobs, workflows, compute resources
• Experience implementing data quality, automated testing, monitoring, lineage
• Experience with cloud data services in AWS, Azure, or Google Cloud

NICE TO HAVE

• Databricks certification or platform expertise
• Experience supporting federal enterprise data environments
• CI/CD, infrastructure as code, automated testing, source control
• Unity Catalog for governance and access control
• Streaming pipelines with Spark Streaming, Kafka, or Kinesis
• Orchestration tools such as Airflow, Dagster, Argo

BENEFITS

• Flexible PTO + federal holidays off
• Health, dental and vision insurance plans
• 401k with employer match
• Company-sponsored life insurance and disability
• Professional development (training, certs)
• Paid cloud developer accounts