Senior Data Platform Engineer (Observability)

📋 Description

• Own observability and search for the data platform; improve meta quality and data lineage.
• Implement and operate orchestration and pipeline management with Dagster/Airflow; focus on reliability and scalability.
• Embed data lifecycle management: retention, archival, and deletion controls per regulatory obligations.
• Ensure HIPAA-compliant data ingestion and storage; secure PHI; audit logging; encryption in transit and at rest.
• Drive performance, reliability, and cost optimization across the data platform.
• Mentor junior engineers and align platform with Product Eng, Analytics Delivery, and Security teams.

🎯 Requirements

• 7+ years of experience in platform or data engineering with cloud infra focus.
• Hands-on experience with data catalog/metadata mgmt platforms such as DataHub, Apache Atlas, or similar.
• Strong understanding of data observability, metadata management, data lineage, and governance.
• Experience with cloud-based data warehouses (Snowflake or Databricks) and orchestration tools (Azure Data Factory, Dagster, etc.)
• Proficiency with Python.
• Bachelor's degree in a technology-related field (e.g., Computer Science, MIS, Data Science).

🎁 Benefits

• Comprehensive benefits: medical, dental, vision; HSA, FSA.
• Disability and life insurance.
• 401(k) match; paid time off.
• Wellness stipend and additional voluntary benefits.