AI Evaluation Specialist – Remote (Contract)

About the role

We are looking for a detail‑oriented AI Evaluation Specialist to join our remote team on a contract basis. In this role you will critically assess AI‑generated content, ensuring it meets high standards of quality, clarity, and usability.

Key responsibilities

• Review AI‑generated outputs across various content types and visual experiences.
• Identify inconsistencies, weaknesses, and opportunities for improvement.
• Apply structured evaluation guidelines and provide nuanced feedback to guide model enhancements.
• Collaborate with cross‑functional teams to define quality standards, scoring criteria, and review processes.
• Maintain high accuracy and consistency in evaluations to deliver reliable, actionable results.
• Contribute to the continuous improvement of evaluation workflows and best practices.

Required profile

• Native‑level English proficiency (C1/C2).
• Exceptional reading comprehension and acute attention to detail.
• Strong observational skills with excellent editorial judgment.
• Ability to think critically and deliver consistent, high‑quality evaluations in ambiguous scenarios.
• Excellent written and verbal communication skills.

Required skills