Domain Contributor - Evaluation Specialist

Role Title: Domain Contributor - Evaluation Specialist

Role Type: Contractor (~15 hrs/week)

Location: Remote

micro1 is engaging Domain Contributor - Evaluation Specialists to support an internal project evaluating and improving advanced AI models. In this role, you'll apply your expertise to help train next-generation AI systems. Your work will shape how models learn, reason, and perform through high-quality, real-world input. Flexible, pay-per-task work across history, law, finance, journalism, and tech, for experts with prior AI training experience.

Scope of Work

• Design nuanced, domain-specific tasks that probe AI model limits and surface reasoning flaws.

• Author questions and scenarios demanding deep subject knowledge, beyond general understanding.

• Assess AI-generated outputs, validating accuracy against authoritative, primary sources in your area of expertise.

• Document clear rationales for model shortcomings, specifying missed reasoning, source errors, or nuances.

• Apply detailed task guidelines and evaluation rubrics consistently to each submission.

• Submit completed deliverables independently on a rolling basis, meeting project requirements for written and verbal clarity.

Preferred Qualifications

• Proven hands-on experience with AI model training, annotation, RLHF, or evaluation.

• Deep expertise in a core domain: history, archival or library science, law (paralegal, legal academic, compliance), finance (equity research, PE/VC, forensic accounting), journalism, or technology/industry history.

• Advanced research skills with a track record of verifying complex claims against authoritative sources.