Staff AI Engineer, Agentic AI Harness & Quality

📋 Description

• Apply software engineering and compound AI system engineering to create lasting value for all our
• Drive quality in agent behavior, both in terms of increasing success rate at achieving goals set by
• Take on exciting and difficult challenges in AI harness engineering, such as agent cognitive
• Read, discuss, and build on the latest AI research and open-source repositories and models
• Research and develop innovative, scalable and dynamic solutions to hard problems
• Use your knowledge of machine learning fundamentals and LLMs to make improvements to the agentic

🎯 Requirements

• Drive to ship product improvements with production-quality, fully unit-tested code and
• Solid grasp of LLM and agent evaluation fundamentals, especially for agent action trajectories
• Attention to detail and high standard of data quality for eval datasets
• Thoughtfulness about API contracts and implications of exposing a platform feature to a given type
• Readiness to hit the ground running in a Mac development environment, programming in Python and/or
• Familiarity with industry standard agent architectures and large language models