AI training jobs for generalists

Evaluate AI-generated interpretations of cardiovascular imaging findings and review clinical scenarios involving echocardiography, cardiac MRI, and cardiac CT.

Listen to short field recordings and annotate instruments, tempo, key, and timestamps of audible background events.

Create challenging computational mathematics and statistics tasks for AI models and evaluate model-generated proofs, calculations, code, and optimizations.

Create computational physical-science tasks that challenge advanced AI models and evaluate model-generated calculations, code, simulations, and models.

Create realistic computational earth-science tasks that challenge advanced AI models and evaluate model-generated code, geospatial analyses, simulations, and forecasts.

Create computational life-science tasks that challenge advanced AI models and evaluate model-generated code, analyses, models, and experiments.

Create realistic computational engineering tasks that challenge advanced AI models and evaluate model-generated code, calculations, simulations, and designs.

Create realistic software engineering tasks that challenge advanced AI models and evaluate model-generated code for correctness, robustness, and completeness.

Create realistic machine learning engineering tasks that challenge advanced AI models and evaluate model-generated code, experiments, and analyses.

Test AI agents using privacy-focused scenarios and review responses for inappropriate disclosures of personal or sensitive information.

Execute real-world digital workflows with AI tools and document task execution through screenshots, observations, and structured feedback.

Annotate and categorize image data per project guidelines and review annotations for consistency and quality, correcting discrepancies.

Review and refine machine-generated bounding boxes on drone and maritime sensor imagery and annotate objects missed by AI models.

Compare original images with AI-generated counterparts and document visual discrepancies and common AI artifacts in written descriptions.

Compare original photographs with AI-generated images and document visual flaws in lighting, composition, and texture.

Compare artwork with AI-generated images and describe artifacts like warped anatomy, broken textures, and inconsistent shadows.

Review and annotate video content using detailed guidelines, applying consistent tags, labels, or classifications to video segments.

Listen to short field recordings and annotate instruments, tempo, key, and background sound events using a structured web platform.

Review machine-generated bounding boxes on drone and maritime imagery, correct wrong labels, and label objects the model missed.

Transform engineering drawings and bills of materials into dependency-correct assembly procedures for technical manuals.

Compare real photographs with AI-generated images and write specific feedback explaining visual differences and inconsistencies.

Document user journeys on food delivery platforms and evaluate the relevance of search results and app recommendations.

Run real-life scenarios with AI agents, approve key steps, screen record attempts, and score each run.

Create, evaluate, and refine AI-generated HR documents, spreadsheets, and slide decks, such as job descriptions and offer letters.

Design domain-specific tasks that probe AI model limits and assess AI-generated outputs against authoritative primary sources.

Review AI-generated prompts and responses, evaluating relevance, accuracy, helpfulness, and personalization, and provide clear ratings and feedback.

Evaluate and refine AI-generated technical design documents and data pipeline and ETL documentation.

Create original, high-difficulty question-and-answer pairs that assess AI model capabilities, with answers documented using primary sources.

Create, evaluate, and refine AI-generated documents and spreadsheets for HR workflows like job descriptions and offer letters.

Evaluate AI models and agents using pre-defined scenarios and guidelines, and document findings in structured written reports.

Review inpatient medical records and clinical notes to check claims are supported and identify missing, incorrect or inconsistent information.

Read short questions and answers about government services and describe where they were confusing or easy to follow.

Read Spanish and English sample answers and judge whether the wording sounds natural, clear, and easy to follow.

Read sample questions and AI-generated answers about government services and give feedback on clarity and helpfulness.

Review and annotate short video and audio clips, and assess the accuracy of AI-generated descriptions of multimedia content.

Give an AI assistant instructions for teaching-related digital tasks, then review its work for accuracy, tone, grammar, and instruction following.

Complete everyday email and scheduling tasks with an AI assistant, then verify its work and grade responses using guidelines.

Evaluate AI chat and search tools, applying grading guidelines to rank and annotate model responses.

Review and annotate short video and audio clips using project guidelines, and assess the accuracy of AI-generated descriptions.

Write teaching problems with reference answers and grade model-written explanations and lesson material for AI evaluation.

Write realistic consumer questions with reference answers and grade model recommendations as current, practical, and safe.

Write prompts and reference answers for everyday questions and grade model output on general reasoning correctness.

Review short video and audio clips and evaluate the accuracy of AI-generated descriptions against provided guidelines.

Create high-quality research questions, answers, and evaluation materials to train advanced language models.

Install applications on an Ubuntu/Linux computer and follow detailed written guidelines to complete structured tasks.

Design multi-turn prompts from personal experience and rank model responses side-by-side, writing rationales on personalization quality.

Evaluate Gemini personalization by designing multi-turn prompts and ranking model responses side-by-side for grounding, integration, and helpfulness.

Evaluate Gemini personalization by designing multi-turn prompts and ranking model responses side-by-side for grounding, integration, and helpfulness.

Design multi-turn prompts from personal experience and rank model responses side-by-side, writing rationales on personalization quality.

Design multi-turn prompts from personal experience and evaluate Gemini's personalized responses for grounding, integration, and helpfulness.

Design multi-turn prompts from personal experience and evaluate Gemini's personalized responses for grounding, integration, and helpfulness.

Design multi-turn prompts from personal experience and evaluate Gemini's personalized responses for grounding, integration, and helpfulness.

Design multi-turn prompts using personal experiences and rank model responses side-by-side, writing clear rationales for comparisons.

Design multi-turn prompts using personal experiences and rank model responses side-by-side, writing clear rationales for comparisons.

Design multi-turn prompts using personal experiences and rank model responses side-by-side, writing clear rationales for comparisons.

Design multi-turn prompts using personal experiences and rank model responses side-by-side, writing clear rationales for comparisons.

Design multi-turn prompts using personal experiences and rank model responses side-by-side, writing clear rationales for comparisons.

Design multi-turn prompts using personal experiences and rank model responses side-by-side, writing clear rationales for comparisons.