Safeguards Enforcement Analyst, User Well-being

📋 Description

• Design and deploy mental health guardrails, iterating detection systems and review queues
• Evaluate interventions, monitor performance, and refine thresholds for detection models
• Collaborate with Product, Legal, and external partners on referral pathways
• Translate clinical guidance and data analyses into actionable changes in detection and response
• Review flagged content to drive enforcement and policy improvements
• Stay updated on AI policy and research related to mental health and wellbeing

🎯 Requirements

• Experience in trust & safety, policy, content moderation, or related field with mental health
• Experience designing experiments or evaluation studies to measure intervention efficacy
• Ability to translate policy definitions into measurable rubrics/guidelines
• Experience coordinating content review operations and QA/workflow management
• Proficiency in SQL and/or data analysis tools to measure impact and surface gaps
• Experience with generative AI products and writing prompts for content review/evaluation

🎁 Benefits

• Annual salary: 245,000 – 285,000 USD
• Bonuses and equity as applicable