Staff Software Engineer, Applied AI

Added
16 days ago
Type
Full time
Salary
Upgrade to Premium to se...

Related skills

aws postgresql python fastapi llm

πŸ“‹ Description

  • Build the agent harness for planning, tool use, memory, context compaction, interruption and
  • Integrate OpenAI and Anthropic model APIs. Select models using measured quality, latency and cost
  • Evaluate existing harnesses and build only the missing pieces. Keep the harness connected to AWS
  • Keep authorization and sensitive writes behind application policy checks. Require evidence of the
  • Build evaluation datasets and replay tests for valid findings, access decisions, app setup and AI
  • Measure false positives, missed risks, unsafe actions, completion rate and cost. Turn production

🎯 Requirements

  • Strong Python engineering skills and experience shipping an LLM application that uses tools.
  • Hands-on experience building agent workflows or evaluation systems for tool-using LLM applications.
  • Experience integrating model APIs, structured outputs and asynchronous services. Experience with
  • Depth in agent execution or evaluation systems, with working code and failure analysis you can
  • Ability to distinguish a plausible model response from a supported finding or verified action.

🎁 Benefits

  • Equity (where applicable)
  • Bonus
  • Health, dental and vision insurance
  • 401(k)
  • Flexible spending account
  • Paid leave (including PTO and parental leave)
Get alerts for new remote engineering jobs
A weekly email with new matches. Unsubscribe anytime.
Share job

Meet JobCopilot: Your Personal AI Job Hunter

Automatically Apply to Engineering Jobs. Just set your preferences and Job Copilot will do the rest β€” finding, filtering, and applying while you focus on what matters.

Related Engineering Jobs

See more Engineering jobs β†’