Added
16 days ago
Type
Full time
Salary
Salary not provided

Related skills

sql python prompt engineering rag conversational ai

๐Ÿ“‹ Description

  • Analyze AI conversations, interaction data, and user feedback to identify opportunities to improve
  • Design, implement, test, and optimize prompt engineering strategies and conversational behaviors.
  • Optimize RAG pipelines, retrieval mechanisms, vector-based search, and overall retrieval quality.
  • Evaluate different LLMs and recommend the most effective models for specific product use cases.
  • Define, track, and continuously improve AI quality metrics such as accuracy, relevance, latency
  • Design and execute structured experiments to assess AI improvements and determine their impact.

๐ŸŽฏ Requirements

  • 5+ years of professional experience in AI, machine learning, NLP, or a related technical field.
  • Strong practical understanding of LLMs, generative AI, and conversational AI systems.
  • Hands-on experience with prompt engineering, prompt evaluation, and LLM optimization.
  • Proven experience evaluating conversational AI using both qualitative and quantitative
  • Strong Python and SQL skills, with the ability to analyze data and build practical evaluation or
  • Experience with AI evaluation frameworks, benchmarking, and systematic model or system assessment.

๐ŸŽ Benefits

  • Competitive salary with individual performance-based bonuses paid quarterly.
  • 28 days of paid annual leave.
  • Remote-first working environment with flexibility across your local time zone.
  • Core working hours from 10:00 AM to 3:00 PM local time, with flexibility outside those hours.
  • Referral bonuses and additional flash bonus opportunities.
  • High-quality, top-of-the-line work equipment.
Share job

Meet JobCopilot: Your Personal AI Job Hunter

Automatically Apply to Engineering Jobs. Just set your preferences and Job Copilot will do the rest โ€” finding, filtering, and applying while you focus on what matters.

Related Engineering Jobs

See more Engineering jobs โ†’