AI Product Evaluator
Role details
Skills the posting asks for
- AI Models
- AI Agents
- Following Instructions
- Attention to Detail
micro1 is engaging expert AI Product Evaluators to contribute directly to a customer's high-impact AI project. In this role, you'll apply your expertise to help train next-generation AI systems. Your work will shape how models learn, reason, and perform through high-quality, real-world input. This operationally intensive engagement involves handling AI model and agent evaluations, often within strict timeframes and usage limit resets. The project benefits greatly from contributions of multiple specialists, each bringing a meticulous approach to instruction-following and quality assurance.
Scope of Work
- Evaluate AI models and agents according to detailed, pre-defined scenarios and guidelines.
- Execute a series of operational tasks designed to test model accuracy, reasoning, and responsiveness.
- Document findings, observations, and any anomalies in structured written reports.
- Reset usage limits and repeat evaluations as required by project protocols.
- Record findings and submit evaluation datasets on AI training platforms in line with project standards and milestones.
- Maintain a high standard of attention to detail and rigor across all evaluation tasks.
Preferred Qualifications
- Experience with AI products, AI models, or AI agent evaluation and testing.
- Demonstrated ability to follow complex instructions with precision and consistency.
- Exceptional attention to detail and operational thoroughness.
- Someone who already uses AI in daily life.
- Comfort working with repetitive or high-volume operational tasks within strict timeframes.
- Prior participation in digital product, software QA, or AI research projects is a plus.
- Detail-oriented, great at following instructions and documenting each step.
From the micro1 posting.
Applying on micro1
What happens after you click
- The link opens this role on micro1. Sign up and apply from there.
- An AI interview, 20 to 40 minutes.
- If micro1 hires you, they match you to a project.
- Remote, open to United Kingdom and Japan. The posting also names countries this site does not cover.
If you're hired and complete 10 hours, micro1 pays this site a referral fee. Your pay is unaffected.
Red Pen Jobs is independent. We are not affiliated with, endorsed by, or acting for micro1 in any way, and we do not recruit on its behalf.
More about micro1: how it pays, what it does not say, and its referral terms.
Already have a micro1 account?
Tell us, and we'll keep micro1 roles out of your lists so the platforms you haven't tried come first.
Noted. micro1 roles stay out of your lists on this device.
New roles for generalists every Monday
What the email looks like
Cardiac Imaging Specialist
$80–285 an hour · micro1
Physician AI Trainer – Hospital Medicine
$80–125 an hour · micro1
AI Trainer (Earth & Environmental Sciences)
$60–120 an hour · micro1
More roles for generalists
Pays $14–36 an hour, close to the $40 median top rate of the 65 other open hourly generalists roles listed here. 100 openings, among the largest in this profession here. Posted 3 weeks ago.
We read this listing on micro1 on 16 Oct 2026 and checked it again on 10 Nov 2026. We clean its formatting for readability and safety. View on micro1
Filed under Generalists Compare pay rates across professions