Software Engineer, AI Systems

📋 Description

• Build and operate production LLM pipelines coordinating model calls, tool calls, graph queries
• Extend agent orchestration systems that move incidents from evidence collection through analysis
• Design grounding and retrieval strategies using graph traversal, vector search, and hybrid
• Develop evaluation datasets, scoring systems, regression suites, model comparisons, LLM-as-judge
• Implement production AI operations capabilities including tracing, tool-call auditing, cost and
• Identify and address hallucinations, agent loops, silent model drift, regressions, and other

🎯 Requirements

• Professional AI/ML engineering experience with a demonstrated track record of shipping production
• Hands-on experience building and debugging multi-step, tool-calling agent workflows using
• Strong understanding of LLM evaluation, including representative datasets, regression testing
• Experience designing retrieval and context-assembly systems, with the ability to make informed
• Demonstrated ownership of production systems through deployment, monitoring, troubleshooting, and
• Strong judgment when working across multiple model providers and evaluating tradeoffs involving

🎁 Benefits

• High-impact opportunity to solve complex AI reasoning problems in a safety-critical enterprise
• Evaluation-first engineering culture focused on making AI quality measurable, observable, and
• Direct exposure to customer needs and feedback from safety teams across energy, utilities
• High level of technical ownership within a small, early-stage team.
• Close collaboration with technical leadership, product, and knowledge engineering teams.
• Opportunity to make consequential architectural and product decisions and see implementations reach