Lead Software Engineer

📋 Description

• Design and implement AI-driven data solutions across cloud platforms.
• Prototype and productionize LLM-based systems for dynamic SQL generation.
• Enable document search and semantic retrieval at scale.
• Build vector search capabilities using OpenSearch.
• Develop metadata and data catalog layers for LLM reasoning.
• Build reliable, well-governed data pipelines for AI workloads.

🎯 Requirements

• Expertise in large-scale cloud data platforms (Snowflake, Databricks, BigQuery).
• Hands-on experience building LLM-driven workflows for dynamic SQL or data access.
• Proficiency in Python and/or Java for AI pipeline development.
• Experience with vector search and OpenSearch for semantic retrieval.
• Familiarity with data cataloging or metadata systems such as Atlan or DataHub.
• Strong troubleshooting in production environments and cross-team collaboration.