Added
16 days ago
Type
Full time
Salary
Salary not provided

Related skills

nlp sql python rag evaluation

πŸ“‹ Description

  • Analyze AI conversations, interaction data, and user feedback to identify opportunities to improve
  • Design, implement, test, and optimize prompt engineering strategies and conversational behaviors.
  • Optimize RAG pipelines, retrieval mechanisms, vector-based search, and retrieval quality.
  • Evaluate different LLMs and recommend effective models for product use cases; explore
  • Define, track, and improve AI quality metrics (accuracy, relevance, latency, user satisfaction).
  • Design and execute experiments to assess AI improvements and impact.

🎯 Requirements

  • 5+ years in AI, ML, NLP, or related field.
  • Strong understanding of LLMs, generative AI, conversational AI.
  • Hands-on prompt engineering, evaluation, and LLM optimization.
  • Experience evaluating conversational AI with qualitative and quantitative methods.
  • Strong Python and SQL skills; ability to build evaluation/experimentation workflows.
  • Experience with AI evaluation frameworks, benchmarking, and model/system assessment.

🎁 Benefits

  • Competitive salary with performance-based bonuses paid quarterly.
  • 28 days of paid annual leave.
  • Remote-first environment with flexible local time zone.
  • Core hours 10:00–15:00 local time, flexible outside those hours.
  • Referral bonuses and additional flash bonus opportunities.
  • High-quality work equipment.
Share job

Meet JobCopilot: Your Personal AI Job Hunter

Automatically Apply to Engineering Jobs. Just set your preferences and Job Copilot will do the rest β€” finding, filtering, and applying while you focus on what matters.

Related Engineering Jobs

See more Engineering jobs β†’