GenAI Platform Engineer – LLM Gateway

Added
31 minutes ago
Type
Full time
Salary
Salary not provided

Related skills

python rest apis fastapi genai llm

📋 Description

  • Design, develop, and operate enterprise LLM Gateway features, primarily using Python, enabling
  • Build and maintain multi-provider model integrations, intelligent routing, failover mechanisms, API
  • Develop platform features for usage metering, budget management, cost transparency, and chargeback
  • Integrate agentic AI capabilities into the platform while ensuring appropriate security and
  • Develop and maintain Model Context Protocol (MCP) servers, cross-provider tool calling, and
  • Maintain and enhance the platform's open-source foundations by assessing upstream releases

🎯 Requirements

  • Bachelor's or Master's degree in Computer Science, Computer Applications, Engineering, or a related
  • At least 9 years of professional software engineering experience, including a minimum of 3 years
  • Strong proficiency in Python backend development, including asynchronous programming, FastAPI or
  • Hands-on experience integrating LLM provider APIs, such as OpenAI, Azure OpenAI, and AWS Bedrock.
  • Experience implementing tool calling, function calling, and integrations across multiple LLM
  • Proven experience deploying and operating services on AWS using containerization technologies and

🎁 Benefits

  • Full-time employment opportunity.
  • Fully remote working arrangement from India.
  • Opportunity to work on enterprise-scale generative AI infrastructure and LLM platform engineering.
  • Exposure to leading AI technologies and multiple LLM providers, including OpenAI, Azure OpenAI, and
  • Hands-on experience with modern agentic AI frameworks, MCP integrations, and multi-agent
  • Opportunity to contribute to open-source projects and influence the evolution of enterprise AI
Get alerts for new remote engineering jobs
A weekly email with new matches. Unsubscribe anytime.
Share job

Meet JobCopilot: Your Personal AI Job Hunter

Automatically Apply to Engineering Jobs. Just set your preferences and Job Copilot will do the rest — finding, filtering, and applying while you focus on what matters.

Related Engineering Jobs

See more Engineering jobs →