AI Data Quality Specialist - AI Trainer

Headquarters: California

URL: https://imerit.ai/

About the opportunity

We’re seeking detail-oriented professionals to review AI-generated content and annotated data for accuracy, clarity, and consistency. This role is well suited to candidates with backgrounds in editing, teaching, instructional design, quality assurance, research, or AI data annotation.

You will apply detailed written guidelines, identify subtle errors, and explain your decisions clearly. Assignments may include written content, image comparisons, and other evaluation tasks that require sustained focus and independent judgment.

What you will do

• Review AI-generated responses and annotated data against project guidelines and scoring rubrics.

• Identify errors, inconsistencies, unsupported statements, and cases that require further review.

• Write clear, specific feedback explaining what is incorrect and how it should be improved.

• Compare images or video frames to identify subtle visual differences, where required.

• Maintain consistent judgments across lengthy tasks and multiple documents.

• Incorporate feedback and participate in calibration exercises to align with project standards.

• Flag unclear guidelines and recommend improvements to rubrics, SOPs, or review instructions.

• Manage assignments independently and meet agreed quality and delivery expectations.