Senior Backend AI Engineer

📋 Description

• Refactor, maintain, and scale the core backend and AI framework layers of the platform, eliminating
• Implement and monitor production LLM observability, focusing on token cost optimization, retrieval
• Build and manage automated prompt versioning systems, A/B testing pipelines, and LLM evaluation
• Build out next-generation copilot services and agentic workflows that autonomously produce
• Deliver reliable Python backend services, integrations, and APIs that interact directly with vector
• Drive features from concept to production, working directly within client cloud environments while

🎯 Requirements

• 5+ years of overall software development experience with a heavy focus on backend systems.
• 3+ years of production-level engineering experience with Python.
• 2+ years of hands-on experience building, deploying, and maintaining Retrieval-Augmented Generation
• 1+ years of hands-on experience integrating and utilizing LLM observability and tracing tools
• 1+ years of experience establishing prompt versioning, A/B testing, and evaluation frameworks for
• 1+ years of experience implementing data drift and model drift monitoring for production AI

🎁 Benefits

• 100% remote work.
• Long-term engagement with high impact and autonomy.
• Strategic and high-visibility role within a modern engineering culture.
• Opportunity to influence technical and business strategy.
• Collaborative international team with strong technical leadership.
• Clear growth path and leadership opportunities within Coderio.