Software Engineer 3

📋 Description

• Contribute high-quality, well-tested code to the modernization and framework team and its
• Collaborate effectively with Product Management, other engineers, and designers to build and
• Participate actively in code reviews to enforce best practices and patterns
• Help troubleshoot and resolve complex technical issues in our distributed systems
• Give and solicit feedback on technical design documents and pull requests
• Perform tasks related to process such as CI/CD, quality, testing, etc.

🎯 Requirements

• 4+ years of commercial software development experience with at least one JVM language such as Java
• Proven experience evaluating Large Language Models (OpenAI, Anthropic, open-weights, etc.)
• Familiarity with evaluation frameworks (DeepEval, Ragas, Promptfoo) and LLM-as-a-judge concepts
• Experience integrating LLMs into the developer workflow to automate unit test generation and
• Experience curating 'golden datasets,' adversarial test sets, and establishing scoring rubrics to
• Experience building developer tools, infrastructure, or complex testing frameworks