Added
16 days ago
Type
Full time
Salary
Salary not provided

Related skills

sql python rag llm embeddings

๐Ÿ“‹ Description

  • Analyze AI conversations, interaction data, and user feedback to identify opportunities to improve
  • Design, implement, test, and optimize prompt engineering strategies and conversational behaviors.
  • Optimize RAG pipelines, retrieval mechanisms, vector-based search, and retrieval quality.
  • Evaluate different LLMs and recommend the most effective models for product use cases.
  • Define, track, and improve AI quality metrics such as accuracy, relevance, latency, and user
  • Collaborate with AI Engineers to validate and deploy improvements into production.

๐ŸŽฏ Requirements

  • 5+ years of professional experience in AI, machine learning, NLP, or related field.
  • Strong practical understanding of LLMs, generative AI, and conversational AI systems.
  • Hands-on experience with prompt engineering, evaluation, and LLM optimization.
  • Proven experience evaluating conversational AI using qualitative and quantitative methods.
  • Strong Python and SQL skills.
  • Experience with AI evaluation frameworks, benchmarking, and systematic assessment.

๐ŸŽ Benefits

  • Competitive salary with quarterly performance-based bonuses.
  • 28 days of paid annual leave.
  • Remote-first environment with flexibility across your local time zone.
  • Core working hours from 10:00 AM to 3:00 PM local time.
  • Referral bonuses and additional flash bonus opportunities.
  • High-quality, top-of-the-line work equipment.
Share job

Meet JobCopilot: Your Personal AI Job Hunter

Automatically Apply to Engineering Jobs. Just set your preferences and Job Copilot will do the rest โ€” finding, filtering, and applying while you focus on what matters.

Related Engineering Jobs

See more Engineering jobs โ†’