Senior/Principal Local LLM & Generative AI Platform Engineer

📋 Description

• Own the architecture and technical roadmap for a secure, reliable, and maintainable local LLM
• Partner with engineering, product, support, IT, information security, legal, and domain experts to
• Build a modular inference and model-gateway layer with stable APIs, model routing, streaming
• Evaluate open-weight language, code, embedding, reranking, and, where useful, multimodal models
• Optimize serving across available CPU, GPU, and accelerator resources using techniques such as
• Design and operate RAG and enterprise-search pipelines for approved repositories, wikis, tickets

🎯 Requirements

• BSc or MSc in Computer Science, Computer Engineering, Electrical Engineering, Data Science, or a
• Typically 7+ years of hands-on experience in production software, ML platform, search, data, or
• Strong Python engineering skills and experience designing maintainable APIs, services, libraries
• Strong understanding of transformer-based language models and production inference, including
• Demonstrated experience building production RAG or enterprise-search systems using embeddings
• Experience defining task-specific LLM evaluations using representative datasets, strong baselines