Senior Software Engineer, AI Gateway

📋 Description

• Design and own core components of our AI Gateway, ensuring 99.99% uptime and low-latency
• Lead the implementation of features like prompt engineering, caching, and observability for AI
• Influence the technical roadmap and architecture, proactively identifying and mitigating technical
• Architect robust solutions for integrating with various Large Language Models (LLMs) and AI
• Mentor junior engineers, fostering a culture of technical excellence, high-ownership, and rapid
• Drive the full development lifecycle, from ideation and design to deployment and operation within a

🎯 Requirements

• Extensive experience in backend development, preferably with Golang and/or Python.
• Deep understanding of distributed systems, microservices architecture, and API design principles.
• Proven experience designing and operating services in a cloud-native environment (Kubernetes
• Familiarity with API gateways, service mesh, or related infrastructure technologies.
• Strong computer science fundamentals (data structures, algorithms, concurrency).
• Experience with AI/ML infrastructure, LLMs, or frameworks like LangChain or LlamaIndex (bonus).

🎁 Benefits

• Offers Equity
• Offers Bonus