AI Security Researcher/Research Engineer

📋 Description

• Design and execute adversarial evaluations to uncover failure modes in LLM-powered web agents and
• Analyze model behavior (including internal thoughts) to understand and forecast security risks in
• Develop and prototype security-focused training and fine-tuning techniques
• Augment web agents with security principles including information flow control, privilege control
• Partner with engineers and (privacy, ML, and Cryptographic) researchers to translate findings into
• Help define a forward-looking security strategy and policy for building and responsibly releasing

🎯 Requirements

• Demonstrated experience working on Secure AI (prompt injection attacks and security guardrails)
• Strong publication record in AI security, ML security, or closely related areas
• A track record of shipping products and features inside a fast-moving environment
• Strong coding skills in Python and familiarity with ML frameworks like PyTorch or JAX
• Experience training, fine-tuning, and evaluating large language models
• Deep familiarity with large language models and web agents, how they work, and how they are trained

🎁 Benefits

• Ability to work at an exciting and well-funded international startup headquartered in San Francisco
• Cutting-edge technology, allowing you to work with state-of-the-art tools and software solutions
• Competitive compensation and plenty of room for personal growth
• Great international exposure and team atmosphere