AI Prompt Engineer

📋 Description

• Design and implement sophisticated LLM prompts aligned to internal scoring rubrics and
• Conduct prompt testing and evaluation using labeled datasets to ensure performance accuracy.
• Collaborate with engineering to improve tooling and infrastructure for managing LLM scoring
• Maintain a centralized prompt library to ensure reuse and standardization across use cases.
• Document prompt strategies, testing approaches, and outcomes for internal learning.
• Identify and resolve inefficiencies in the prompt development and deployment process.

🎯 Requirements

• Strong understanding of LLMs, NLP systems, and prompt engineering concepts.
• Ability to structure and document complex logic in a scalable and repeatable manner.
• Demonstrated ability to collaborate effectively with both technical and non-technical teams.
• Analytical mindset with an interest in experimentation, iteration, and data-driven decision-making.
• Experience in structured data labeling or QA workflows (preferred).
• Familiarity with tools like LangChain, OpenAI/GPT APIs, or vector databases (preferred).

🎁 Benefits

• Free health insurance options
• Comprehensive benefits - medical, vision, dental, life, and disability insurance
• HSA and FSA plans
• 401(K)
• Unlimited vacation time
• Generous paid holidays, sick leave, and parental leave