AI Platform and Harness Engineer

📋 Description

• Design, build, and maintain enterprise AI platform capabilities for LLMs, AI agents, RAG.
• Develop reusable AI harnesses to automate testing, prompt evaluation, model benchmarking.
• Build AI evaluation frameworks for accuracy, retrieval quality, latency, and cost.
• Implement observability and monitoring for AI apps: telemetry, tracing, logging, dashboards.
• Build and maintain LLMOps pipelines: deployment, versioning, evaluation, experimentation.
• Design automated workflows for prompt testing, retrieval evaluation, and validation.

🎯 Requirements

• Bachelor's degree in Computer Science, Software Engineering, AI, Data Science, or related.
• 5+ years in software/platform/backend/DevOps/cloud/infra engineering.
• 2+ years building or supporting Generative AI, LLMs, or ML apps.
• Strong programming experience in Python.
• Experience developing APIs, backend services, and distributed systems.
• Experience with cloud platforms AWS, Azure, or Google Cloud Platform.
• Experience deploying apps using Docker and Kubernetes.
• Experience with Git, CI/CD, IaC, and infrastructure automation.

🎁 Benefits

• The Opportunity to support high-visibility federal missions
• A culture that values innovation, growth, and collaboration
• Access to cutting-edge tools and technologies
• Comprehensive benefits for you and your family
• A career path that rewards ambition and performance