Skip to content
RemoteJobsOne logo

Domain Contributor - Evaluation Specialist – Remote (Worldwide)

RemoteJobsOne · Remote · Posted 1d ago
This job was posted on Himalayas, an open job board. Join eGig free and you get the link to apply on Himalayas. Every job you apply to is then kept in My applications, with the pay shown up front.
Salary$30 – $60 / hr
Experience2 – 5 years
Job typeContract
Work modeRemote
Openings1

Apply by 19 Jan 2027

About the job

IMPORTANT: after you apply, please check your email. We sendyou a link to complete your application — it is not considered until that laststep is done. If you do not see it, check your spam folder.
This is a fully remote position, open to candidates based in 55 countries, including Pakistan, United States, United Kingdom, Canada, Germany, India, France, Netherlands.
Pay: $30–$60/hr
Role Title: Domain Contributor - Evaluation Specialist
Role Type: Contractor (~15 hrs/week)
Location: Remote
We are engaging Domain Contributor - Evaluation Specialists to support an internal project evaluating and improving advanced AI models. In this role, you'll apply your expertise to help train next-generation AI systems. Your work will shape how models learn, reason, and perform through high-quality, real-world input. Flexible, pay-per-task work across history, law, finance, journalism, and tech, for experts with prior AI training experience.
Scope of Work

- Design nuanced, domain-specific tasks that probe AI model limits and surface reasoning flaws.

- Author questions and scenarios demanding deep subject knowledge, beyond general understanding.

- Assess AI-generated outputs, validating accuracy against authoritative, primary sources in your area of expertise.

- Document clear rationales for model shortcomings, specifying missed reasoning, source errors, or nuances.

- Apply detailed task guidelines and evaluation rubrics consistently to each submission.

- Submit completed deliverables independently on a rolling basis, meeting project requirements for written and verbal clarity.

Preferred Qualifications

- Proven hands-on experience with AI model training, annotation, RLHF, or evaluation.

- Deep expertise in a core domain: history, archival or library science, law (paralegal, legal academic, compliance), finance (equity research, PE/VC, forensic accounting), journalism, or technology/industry history.

- Advanced research skills with a track record of verifying complex claims against authoritative sources.

- Exceptional written and verbal communication skills to articulate findings and feedback.

- Demonstrated ability to precisely follow detailed instructions and evaluation frameworks.

- Background in adversarial or “stomp the model” task design is advantageous.

- Graduate-level research, experience at a Fortune 100 company, or professional fluency in a non-English language a plus.

Compensation Structure
Compensation is output-based; experts are paid per task that meets the project specifications. The time required to complete work may vary depending on the expert’s experience and workflow. Minimum submission requirements apply. Experts must submit a minimum of tasks per week.
Start Timeline & Availability
We typically fill roles within 48 hours and are looking for experts ready to jump in right away. If selected, we expect you to start your first tasks within 24–48 hours of completing onboarding.
How to apply
Apply here with your profile. We will then email you a link to complete yourapplication on the hiring platform — your application is only considered oncethat final step is done.
Originally posted on Himalayas

Skills

eGig for remote workers: jobs, pay and answers in one place
Get new remote Domain Contributor - Evaluation jobs by emailFree, once a day, salary on every job. Stop anytime.

Similar jobs

HILLSIDE ASSETS LIMITED logo

Market Specialist

HILLSIDE ASSETS LIMITED
2–5 yrs $40k – $50k / yr Remote

HILLSIDE ASSETS LIMITED is an international company focused on digital assets, financial markets, market research, and data-driven trading solutions.…

Full-timeRemote via Himalayas
New · 1d ago View job
Vertex Inc. logo

GTM Program Manager

Vertex Inc.
5+ yrs ₹11.6 – 15.2 L / yr Remote

Job Description: Essential Job Functions and Responsibilities - Turn GTM priorities into defined plays with goals, owners, timelines and success meas…

Full-timeRemote via Himalayas
New · 1d ago View job
2–5 yrs $20 – $44 / hr Remote

IMPORTANT: after you apply, please check your email. We sendyou a link to complete your application — it is not considered until that laststep is don…

ContractRemote via Himalayas
New · 1d ago View job
1

IT Manager

1mind
7+ yrs $140k – $170k / yr Remote

Job Title: IT Manager Location:This is a fully remote opportunity and can be worked from any location in the United States. About Us 1mind is buildin…

Full-timeRemote via Remote OK
New · 1d ago View job
Domain Contributor - Evaluation Specialist – Remote (Worldwide)$30 – $60 / hr
Sign up to apply