Software Engineer - AI Performance

📋 Description

• Participate in a structured training track to develop expertise in AI benchmarking, profiling, and
• Build and scale benchmarking infrastructure for evaluating AI systems in enterprise settings.
• Design agent evaluation pipelines that measure reasoning, accuracy, alignment, and user outcomes.
• Participate in a structured AI benchmarking training track, gaining expertise in profiling
• Collaborate with AI and Infra teams to instrument model-serving systems (vLLM, Triton, Ray, or
• Develop data and telemetry pipelines that capture model performance, latency, and quality.

🎯 Requirements

• 3–10+ years of experience as a Software Engineer in backend, systems, or infrastructure roles.
• Strong foundation in Python or similar backend languages — Go, Java, C#, or Node.js.
• Hands-on experience in building APIs and cloud-native architectures (AWS, GCP, or Azure; Kubernetes
• Understanding of metrics, profiling, or observability tools (Grafana, Prometheus, ELK, or similar).
• Curiosity and commitment to learn AI benchmarking, LLM evaluation, and performance frameworks.
• Strong analytical and product intuition — you care about what the benchmark represents, not just