Expert Talent Pool, Safety Testing Associate
Apply by 17 Jan 2027
About the job
About the RoleJoin an expert network supporting AI model evaluation projects as a safety tester. You will identify and document ways AI systems can fail, helping improve model safety across projects matched to your background.
What You'll Do
- Write prompts and multi-turn conversations that test whether models follow safety guidelines.
- Try known and novel jailbreak techniques, and record which approaches succeed or fail.
- Use hidden instructions in documents and tool outputs to test for prompt injection vulnerabilities.
- Evaluate whether models using tools such as code, browsers, or email can be manipulated into harmful actions.
- Compare responses across demographic groups, names, and languages to identify potential bias.
- Review model responses against written safety policies and flag violations.
- Label content as safe or unsafe according to project guidelines.
What We're Looking For
- 0 to 5 years of professional experience; prior AI data work is not required.
- Experience in security testing, CTFs, trust and safety, content moderation, policy analysis, fairness or bias research, adversarial machine learning, quality assurance, or a relevant cyber, bio, or chemical domain.
- Experience testing software, systems, or models by trying to break them and documenting steps and results.
- Experience applying written policies or guidelines to judge or label content or behavior.
- Familiarity with language model jailbreaks, prompt injection, or red teaming is useful.
- Familiarity with Burp Suite, Garak, PyRIT, similar tools, or the OWASP LLM Top 10 is useful.
- Strong written English, careful documentation habits, and the ability to work with sensitive content under structured guidelines.
Compensation & Benefits
Compensation is $30 to $60 per hour, depending on project, field, and experience. Payment is based on hours worked.
Location
Fully remote.
Originally posted on Himalayas
Skills
Similar jobs
Manager EDI
Hi, weâre Gravie. Our mission is to create health benefits that actually benefit small and midsize businesses and their employees. Our innovative b…
About the Role Join a curated expert pool supporting AI safety testing projects. You will lead evaluations across security, fairness, and specialized…
Safety Testing Associate
About the Role Join an expert network supporting AI model evaluation projects as a safety tester. You will identify and document ways AI systems can…
About the Role Join an expert pool supporting AI safety testing projects. You will lead evaluations across security, fairness, and domain-specific sa…
Feltsense AI Engineer
About the company We raised $5.1M to build agents that operate as fully autonomous founders. Our backers include Matt Schlicht (founder of Moltbook),…
Solutions Engineer
Consequential Work. Dedicated People. About Onebrief Onebrief builds collaboration and AI-powered workflow software for military planning and operati…