AI training work open in the United States

Review and annotate AI-generated transcripts of outpatient hematology/oncology clinic conversations for accuracy, clinical completeness, and clarity.

Create realistic Adobe XD tasks, document them in SuperAnnotate, and record yourself executing each task.

Create realistic SketchUp tasks, document them in SuperAnnotate, and record yourself executing each task on your computer.

Create realistic CATIA modeling tasks, document them in SuperAnnotate, and record yourself completing them on your computer.

Create realistic Creo tasks, document them in SuperAnnotate, and record yourself completing them on your computer.

Develop professional 3D modeling tasks, document them in SuperAnnotate, and record yourself executing each task on your computer.

Develop MicroStation CAD tasks, document them in SuperAnnotate, and record yourself executing each task on your computer.

Create realistic CAD and engineering tasks, document them in SuperAnnotate, and record yourself executing the workflow on your computer.

Create realistic computer-based design tasks, document them in SuperAnnotate, and record yourself executing the workflow.

Design embedded systems and kernel engineering tasks, write solutions, and develop rubrics assessing correctness, safety and performance.

Write realistic clinical cases with guideline-based reference answers and develop rubrics assessing clinical accuracy and safety.

Design model training and data pipeline tasks with runnable reference solutions and develop rubrics for reproducibility.

Design adversarial red teaming scenarios that probe AI systems for security vulnerabilities, and develop rubrics assessing response safety.

Write, check and repair formal proofs in Lean, Coq or Isabelle, and translate informal mathematics into formal statements.

Build and review financial models and valuations, and develop rubrics assessing numerical accuracy and methodology.

Build realistic infrastructure tasks like Kubernetes manifests and Terraform modules, and develop rubrics assessing infrastructure design and reliability.

Write, review and debug realistic multi-file coding tasks with unit tests, and develop rubrics assessing code correctness.

Create CAD modeling tasks and reference models, and develop rubrics assessing geometric accuracy and manufacturability.

Design realistic professional workflows with reference outputs and develop rubrics to assess accuracy, structure and business judgment.

Review scenarios involving personal and sensitive information to identify privacy risks, inappropriate disclosures, and data-handling issues.

Write realistic customer conversations about orders, returns, and refunds, and develop rubrics assessing policy compliance and resolution quality.

Test AI agents using privacy-focused scenarios and review responses for inappropriate disclosures of personal or sensitive information.

Compare AI-generated videos, select the higher-quality one, and document written reasoning on composition, editing, pacing, motion graphics, and storytelling.

Execute real-world digital workflows with AI tools and document task execution through screenshots, observations, and structured feedback.

Review personal financial planning scenarios and evaluate investment strategies and retirement plans tailored to individual client needs.

Review and refine machine-generated bounding boxes on drone and maritime sensor imagery and annotate objects missed by AI models.

Compare submitted original images with AI-generated counterparts to identify discrepancies, visual artifacts, and imperfections in image quality.

Evaluate your artwork side by side against AI-generated counterparts and document differences in anatomy, color, lighting, perspective, and texture.

Develop federal HR scenarios in Employee & Labor Relations and craft reference answers based on federal HR policy.

Develop realistic federal management, program, and policy scenarios and create reference answers for AI training.

Develop realistic federal contracting scenarios and create detailed reference answers demonstrating sound contracting decisions.

Create federal audit scenarios and reference responses, and give detailed feedback on content developed by other experts.

Summarize public comments on proposed federal regulations and draft agency response text to substantive public comments.

Compare original images with AI-generated counterparts and document visual discrepancies and common AI artifacts in written descriptions.

Review medical charts and validate diagnosis and procedure coding against clinical documentation, flagging documentation gaps.

Annotate and review medical records, assigning ICD-10-CM, ICD-10-PCS, CPT, and HCPCS codes based on documentation.

Author realistic medical coding scenarios and write detailed answer keys and rationales explaining code selection, sequencing, modifiers, and POA indicators.

Listen to English audio clips, evaluate nativeness and fluency, and document pronunciation and intonation assessments.

Evaluate AI-written code, tests and grading rubrics against a repository's architecture and conventions, giving written technical feedback.

Write realistic chemical engineering tasks from your own work and judge frontier AI model responses against professional standards.

Turn robotics problems from your own work into realistic tasks and judge frontier AI model responses.

Write realistic tasks from your own work and judge frontier AI model responses against professional standards.

Write research questions on US company filings with sourced answers, then test them against AI models.

Compare artwork with AI-generated images and describe artifacts like warped anatomy, broken textures, and inconsistent shadows.

Review model-generated patent work product, assess its quality, and annotate legal, technical, factual, claim-construction and citation errors inline.

Evaluate AI-generated content about intelligence agencies and assess its accuracy, realism, and practical relevance, recommending improvements.

Review mathematical tasks and model outputs for proof gaps, and write problem statements and reference solutions.

Review life sciences reasoning tasks and model outputs, and write problem specifications and reference solutions.

Assess chemistry tasks and model outputs for errors, and write precise problem statements and rigorous reference solutions.

Review physics tasks and model outputs for flawed derivations, and write problem statements and reference solutions defining correct answers.

Review clinical documentation for accuracy and coding integrity, and validate alignment between documentation and assigned codes.

Build realistic cardiology cases, give them to frontier AI models, and write grading rubrics for them.

Write realistic design briefs, run them through frontier AI design tools, and critique the output against professional standards in writing.

Build realistic gynecology and obstetrics cases and write grading rubrics to judge frontier AI model answers.

Build realistic dermatology cases and write grading rubrics to judge frontier AI model answers.

Review machine-generated bounding boxes on drone and maritime imagery, correct wrong labels, and label objects the model missed.

Read de-identified mammography, ultrasound and breast MRI studies, record reference findings, and review AI-generated reads for errors.

Read de-identified orthodontic imaging, record the reference finding, and review AI-generated reads for inaccurate, unsupported, or unsafe results.

Write prompts, input artifacts, and golden responses for DoD staff writing tasks, and create grading guidelines to score AI-generated outputs.

Create and refine federal reporting artifacts such as WARs and SITREPs, and evaluate sample submissions using detailed grading guidelines.

Create realistic military status reports and summaries from prompts and artifacts, and develop golden responses for AI model training.

Compare real photographs with AI-generated images and write specific feedback explaining visual differences and inconsistencies.

Review inpatient medical records to ensure accurate ICD-10-CM and ICD-10-PCS coding and validate MS-DRG assignment.

Annotate and review inpatient clinical documentation and evaluate AI-generated outputs for clinical accuracy, safety, and appropriateness.

Review AI-generated responses to medication-related clinical questions for accuracy and safety, and correct inaccurate or incomplete answers.

Answer medication-related clinical questions and review AI-generated responses for clinical accuracy, safety, clarity, and completeness.

Document user journeys on food delivery platforms and evaluate the relevance of search results and app recommendations.

Work through realistic revenue operations scenarios and resolve conflicts between operational policies, explaining the reasoning behind each choice.

Work through realistic operations scenarios and explain the reasoning behind CRM configuration decisions, workflow design, and integration tradeoffs.

Run real-life scenarios with AI agents, approve key steps, screen record attempts, and score each run.

Conduct or assess structured elicitation interview sessions and score them according to a detailed rubric.

Compare pairs of responses to litigation tasks, decide which is stronger, and write justifications grounded in source documents and law.

Compare pairs of AI responses to in-house legal tasks, decide which is stronger, and write justifications.

Compare pairs of responses to transactional tasks, decide which is stronger, and write concise justifications.

Upload your brokerage trade history, describe your trading style, and explain your biggest trades with the reasoning behind each decision.

Review immigration law documents and draft legal memos and briefs to support AI model improvement.

Review and annotate healthcare regulation documents, analyzing policies such as HIPAA, Stark Law, and the Anti-Kickback Statute.

Review, analyze, and provide feedback on litigation and transactional documents, including contracts related to M&A, private equity, and capital markets.

Review and analyze corporate documents, contracts, and deal structures, and provide legal scenario assessments that inform AI model training.

Analyze US macroeconomic indicators and Treasury yield curves, and interpret Federal Reserve communications such as FOMC statements.

Evaluate AI model outputs on biology tasks and design benchmarks and training data for biology problems.

Evaluate AI model outputs on drug discovery tasks and design benchmarks and training data for drug discovery problems.

Evaluate AI model outputs on chemistry tasks and design benchmarks and training data for chemistry problems.

Review legal documents, case law, and statutes, and create sample legal arguments, memoranda, and pleadings.

Review and annotate complex legal documents and perform cite-checking and Bluebook formatting for legal materials.

Review AI-generated and human-edited video for editing quality, pacing, and continuity, and provide precise written feedback on editing errors.

Review inpatient medical records to ensure accurate ICD-10-CM and ICD-10-PCS coding and evaluate AI-generated clinical notes.

Review inpatient medical records to ensure accurate ICD-10-CM and ICD-10-PCS coding and evaluate AI-generated clinical notes against documentation.

Review inpatient medical records for accurate ICD-10 and CPT coding and evaluate AI-generated clinical notes against coding standards.

Record first-person video of household chores with a smartphone and capture synchronized footage during specified physical tasks.

Read provided English text aloud following detailed guidelines and submit clean audio files.

Review AI-generated legal analyses, arguments, and contracts for accuracy and sound reasoning, and provide structured feedback and corrections.

Review AI-generated legal analyses and documents for accuracy and completeness, then provide structured feedback and corrections on tax law scenarios.

Review AI-generated legal analyses and documents for accuracy, identify legal errors, and provide structured feedback to improve outputs.

Review AI-generated legal analyses and documents, identify legal errors and missing information, and provide structured feedback to improve outputs.

Review business data sets for accuracy and verify PII is properly redacted or anonymized in transformed data.

Review inpatient medical records and clinical notes to check claims are supported and identify missing, incorrect or inconsistent information.

Review inpatient medical records and identify missing, incorrect, or inconsistent clinical information to support AI model training and data quality.

Write rubrics defining correct answers for complex passport cases and evaluate AI-generated answers against them, flagging errors and omissions.

Write rubrics for veterans benefits answers and evaluate AI-generated answers against them, flagging errors, omissions, and outdated guidance.

Write rubrics defining correct Medicare enrollment answers and evaluate AI-generated answers against them, flagging errors, omissions, and misconceptions.

Write rubrics for Medicare enrollment scenarios and evaluate AI-generated answers for errors, omissions, and outdated guidance.

Write rubrics and evaluate AI-generated Spanish answers on government services topics, flagging errors, omissions, and mistranslations.

Write rubrics defining correct federal student loan repayment answers and evaluate AI-generated answers for errors, omissions, and outdated guidance.

Write rubrics defining correct postal answers and evaluate AI-generated answers against them, flagging errors and outdated guidance.

Write rubrics defining correct answers on park passes, fees, permits, and reservations, then evaluate AI-generated answers against them for errors.

Write rubrics defining correct answers and evaluate AI-generated answers on government services questions, flagging errors, omissions, and outdated guidance.

Write rubrics defining correct passport answers and evaluate AI-generated answers against them, flagging errors, omissions, and outdated guidance.

Read short questions and answers about government services and describe where they were confusing or easy to follow.

Read Spanish and English sample answers and judge whether the wording sounds natural, clear, and easy to follow.

Read sample questions and AI-generated answers about government services and give feedback on clarity and helpfulness.

Build realistic electrical engineering tasks, give them to frontier AI models, and write grading rubrics for them.

Evaluate AI model outputs for clinical accuracy and safety, and score diagnoses and care recommendations.

Annotate clinical content and medical records, and evaluate AI-generated outputs for clinical accuracy and safety.

Annotate and review inpatient clinical documentation and evaluate AI-generated outputs for clinical accuracy, safety, and appropriateness.

Review data sets for PII and assess AI responses to data and business analysis scenarios, providing expert feedback.

Annotate and review outpatient medical records, assigning ICD-10-CM and CPT/HCPCS codes based on documentation and applying E&M leveling to visits.

Perform simulated contract negotiations and redlining exercises, and review AI responses to contract scenarios with expert feedback.

Give an AI assistant instructions for teaching-related digital tasks, then review its work for accuracy, tone, grammar, and instruction following.

Participate in realistic customer service scenarios by enacting natural conversations used to train speech-to-speech AI agents.

Draft sample bankruptcy motions and pleadings, and assess model-generated legal answers for accuracy and clarity.

Evaluate and critique AI-generated legal outputs for accuracy and logic, and draft detailed explanations responding to complex compliance scenarios.

Evaluate AI-generated legal content such as briefs, arguments, and memos, and provide written feedback identifying errors and logical inconsistencies.

Create challenging professional questions, evaluate AI-generated legal content, and design rubrics defining what a complete response should contain.

Design detailed rubrics and evaluate AI-generated financial work for accuracy, methodology, assumptions, and calculations.

Create expert healthcare questions, design detailed scoring rubrics, and evaluate AI-generated clinical content for accuracy, completeness, and reasoning.

Create expert-level technical questions and design rubrics to evaluate AI-generated solutions for correctness and reasoning quality.

Review PCB CAM and Gerber files for manufacturability and quality, and inspect PCB assembly builds visually.

Build physics tasks, give them to frontier AI models, and write grading rubrics for the results.

Build clinical tasks, give them to frontier AI models, and write grading rubrics for the results.

Build mathematical tasks, give them to frontier AI models, and write grading rubrics for the results.

Build mechanical engineering tasks, give them to AI models, and write grading rubrics for the results.

Build software engineering tasks, give them to AI models, and write grading rubrics for the results.

Build realistic biology tasks, give them to frontier AI models, and judge the results.

Build realistic tasks from your chemistry work, run them through frontier AI models, and judge the results against professional standards.

Complete everyday email and scheduling tasks with an AI assistant, then verify its work and grade responses using guidelines.

Review and enhance book manuscripts for clarity and narrative structure, providing detailed editorial feedback.

Evaluate AI-generated trade recommendations and investment proposals, and compare AI responses head-to-head on financial soundness, regulatory compliance, and analytical rigor.

Review and annotate financial reports and statements for accuracy and completeness, and assess audit procedures against established accounting standards.

Evaluate AI chat and search tools, applying grading guidelines to rank and annotate model responses.

Perform simulated contract negotiations and redlining exercises, and review AI responses to contract scenarios with expert feedback.

Perform simulated contract negotiations and redlining exercises, and review AI responses to contract scenarios with expert feedback.

Classify user requests as benign, dual-use or adversarial, judge three model answers safe or unsafe, and rank them.

Assess AI answers on chemical, biological, radiological and nuclear hazard topics for technical accuracy and safe framing.

Evaluate AI answers to chemical engineering scenarios, checking material and energy balances and assumptions.

Review sample contracts to flag risky clauses and draft brief memos summarizing findings, key risk areas, and suggested improvements.

Review and redline commercial agreements such as MSAs, NDAs, and DPAs according to established playbooks and policies.

Review and redline commercial agreements such as MSAs, NDAs, and DPAs per playbooks, and draft written explanations for redlines.

Classify chemical requests, mark model answers safe or unsafe, and write the answer the model should have given.

Listen to AI-narrated audiobooks and log errors like mispronounced words and unnatural intonation in synthesized speech.

Listen to AI-narrated US Spanish audiobooks, log synthesized speech errors, and categorize each issue.

Design realistic finance Excel tasks with well-structured solutions, and evaluate Excel tasks and solutions with clear written feedback.

Design realistic Excel tasks, write accurate solutions, and evaluate Excel tasks and solutions with written feedback.

Review AI-generated chemical, biological, radiological, and nuclear content for accuracy and safety, flagging unsafe or operationally enabling material.

Review AI-generated materials science content for scientific accuracy, and write gold-standard answers while ranking multiple AI responses by correctness.

Classify requests as benign, dual-use or adversarial and mark model answers as safe or unsafe.

Review AI-generated biochemistry content for scientific accuracy and write high-quality rewrites and model answers.

Review outpatient clinical notes and evaluate AI-generated notes and summaries for accuracy, completeness, and clinical soundness.

Review inpatient documentation and evaluate AI-generated notes, flagging omissions, hallucinations, and clinical inaccuracies with structured written feedback.

Review AI-generated clinical outputs based on nursing flowsheet documentation and validate accuracy and completeness against documentation standards.

Build realistic healthcare operations tasks, give them to frontier AI models, and judge the results.

Build realistic data science tasks, give them to frontier AI models, and judge the results.

Build realistic accounting tasks, give them to frontier AI models, and judge the results.

Build realistic tasks from your finance work, run them through frontier AI models, and judge the results against professional standards.

Build realistic life sciences tasks from your own work and judge frontier AI model answers.

Build realistic legal tasks, give them to frontier AI models, and judge the results.

Evaluate AI-generated clinical assessments and treatment plans for quality and accuracy, and compare AI responses based on clinical reasoning.

Evaluate AI-generated financial plans, budgets, and forecasts for quality and accuracy, and compare AI responses head-to-head.

Evaluate AI-generated sales conversations, product recommendations, and quotes for quality and accuracy, comparing responses head-to-head.

Evaluate AI-generated project plans, status reports, and stakeholder communications for quality and accuracy, comparing responses head-to-head.

Review AI-generated responses, fact-check information, and rate and compare multiple responses for correctness and reasoning quality.

Review deployed network logs, configs, and telemetry, then label and classify network anomalies and incident patterns.

Research online sources, verify information, and review AI-generated responses to identify or correct errors.

Create realistic AutoCAD tasks, document them in SuperAnnotate, and record yourself executing them on your computer.

Design realistic Blender tasks, record yourself completing them, and write verification criteria defining what a correct result must satisfy.

Review AI-generated scientific reasoning and rate and rank model outputs against scientific criteria in ALD.

Review AI-generated physics content and trainer work against project guidelines, and provide written feedback on scientific accuracy.

Review AI-generated SQL queries and database explanations, and provide precise written feedback against project guidelines.

Review AI-generated Python code and trainer work, then provide precise written feedback against project guidelines.

Review AI-generated astronomy and astrophysics content against project rubrics and give written feedback to trainers and QAs on quality issues.

Review AI red-teaming safety evaluations and adversarial prompts against project guidelines, and give trainers precise written feedback.

Review AI-generated economics content and trainer work against project guidelines and provide precise written feedback.

Review AI-generated neuroscience/cognitive science content against project guidelines and provide written feedback to trainers.

Review AI-generated psychology content and trainer work against project guidelines, and give written feedback on accuracy and safety.

Review AI-generated architecture and design content and trainer work, giving precise written feedback against project guidelines and rubrics.

Review AI-generated political science content for accuracy and balance, and give written feedback to trainers and QAs on quality issues.

Review AI-generated geology content and trainer work against project guidelines, providing written feedback on scientific accuracy and geologic reasoning.

Review AI-generated art history content and trainer work against project guidelines, providing precise written feedback to contributors.

Review AI-generated anthropology content and trainer work against project guidelines, giving precise written feedback to keep quality consistent across contributors.

Review AI-generated sociology content and trainer work against project guidelines, providing written feedback to maintain quality standards.

Review AI-generated philosophy content and trainer work against project guidelines, and provide precise written feedback to contributors.

Review AI-generated history content and trainer work against project guidelines, providing written feedback on historical accuracy, chronology, and context.

Install applications on an Ubuntu/Linux computer and follow detailed written guidelines to complete structured tasks.

Review AI-generated Python code and machine learning workflows against project guidelines, and provide written feedback to trainers on quality issues.

Review AI-generated data science content and trainer work against project guidelines, and provide precise written feedback on quality issues.

Review AI-generated HTML/CSS code and trainer work, evaluating quality against project guidelines and giving precise written feedback to contributors.

Review AI-generated C code and trainer/QA work, evaluating quality against project guidelines and providing precise written feedback.

Review AI-generated C# code and trainer work against project guidelines, providing precise written feedback on quality issues.

Review AI-generated C++ code and trainer work against project guidelines, providing precise written feedback.

Review AI-generated Java code and trainer/QA work against project guidelines, providing precise written feedback.

Review AI-generated Go code for correctness and concurrency safety, and give written feedback to trainers following project guidelines.

Review AI-generated PHP code and trainer work against project guidelines, and give precise written feedback on correctness, security, and quality.

Review AI-generated TypeScript code and trainer work against project guidelines, providing precise written feedback.

Review AI-generated JavaScript code against project guidelines and give written feedback to trainers and QAs on correctness and quality.

Review AI-generated Kotlin code and trainer/QA work, providing precise written feedback against project guidelines.

Review AI-generated Dart code and trainer work, evaluating quality against project guidelines with precise written feedback.

Review AI-generated R code and trainer work, evaluating statistical validity and reproducibility against project guidelines and giving precise written feedback.

Review AI-generated Bash code and trainer work against project guidelines, providing written feedback on correctness and safety.

Review AI-generated Excel formulas and spreadsheet workflows against project guidelines, and give trainers precise written feedback on quality issues.

Review AI-generated Persian content and trainer work against project guidelines, and provide precise written feedback to maintain consistent quality standards.

Spot-check Turkish items, give ongoing feedback to trainers and QAs, and maintain Turkish style guides and onboarding documentation.

Review AI-generated legal content and trainer work against project guidelines and provide precise written feedback on quality.

Review AI-generated biomedical engineering content and trainer/QA work against project guidelines, giving precise written feedback.

Review AI-generated civil engineering content and trainer/QA work against project guidelines, providing precise written feedback.

Review AI-generated chemical engineering content and trainer/QA work against project guidelines, and provide precise written feedback.

Review AI-generated electrical engineering content and trainer work, giving written feedback on technical accuracy against project guidelines.

Review AI-generated medical content and trainer work against project guidelines and provide precise written feedback on quality.

Review AI-generated finance content and trainer/QA work, then provide precise written feedback against project guidelines.

Review AI-generated math content and trainer/QA work, then provide precise written feedback against project guidelines.

Review AI-generated chemistry content and trainer work against project guidelines, giving precise written feedback on scientific accuracy.

Review AI-generated mechanical engineering content and trainer/QA work for technical accuracy, and give written feedback against project guidelines.

Review AI-generated biology content and trainer/QA work against project guidelines, providing precise written feedback.

Review AI-generated Spanish content and trainer work against project guidelines, providing precise written feedback to keep quality consistent across contributors.

Review AI-generated Ukrainian content and trainer work, evaluating quality against project guidelines and providing precise written feedback to contributors.

Review AI-generated Filipino/Tagalog content and trainer work, evaluating quality against project guidelines and providing precise written feedback to contributors.

Review AI-generated Vietnamese content and trainer work, evaluating quality against project guidelines and providing precise written feedback to contributors.

Spot-check submitted AI training items, give written feedback to trainers and QAs, and maintain project style guides and onboarding documentation.

Review AI-generated Gujarati content and trainer work against project guidelines, and provide precise written feedback to trainers and QAs.

Review AI-generated Finnish content and compare responses for accuracy, fluency, grammar, tone, and cultural appropriateness.

Review AI-generated Gujarati content for accuracy and fluency, and write Gujarati model answers and rewrites.

Review AI-generated iOS code and technical explanations, and rate and compare multiple AI responses on correctness and reasoning quality.

Review AI-generated Android code and technical explanations, and write reference implementations with step-by-step reasoning.

Review AI-generated React Native code and mobile app architectures, and write reference implementations with step-by-step reasoning.

Review AI-generated full-stack code and system designs, and produce reference implementations with step-by-step reasoning.

Review AI-generated Angular code and rate and compare multiple AI responses based on correctness and reasoning quality.

Review AI-generated React/Next.js code and technical explanations for correctness, and write reference implementations demonstrating best practices with step-by-step reasoning.

Review AI-generated clinical responses and fact-check medical information, providing precise written feedback on reasoning quality and accuracy.

Review AI-generated legal research outputs, write model research memos, and rate and compare responses on correctness and reasoning quality.

Review AI-generated clinical responses, evaluating reasoning quality and giving written feedback on accuracy, safety, and clarity.

Review AI-generated nursing and clinical-care responses, evaluating reasoning quality and providing precise written feedback.

Review AI-generated SQL queries and database designs, and write reference solutions with step-by-step explanations for complex data problems.

Review AI-generated legal responses and write precise feedback on reasoning quality, accuracy, and step-by-step issue analysis.

Review AI-generated fintech, payments, and crypto responses, evaluating reasoning quality and providing precise written feedback.

Review AI-generated contract analyses and drafting outputs, identifying errors in clause interpretation and risk allocation.

Review AI-generated compliance and regulatory outputs, evaluating reasoning quality and providing written feedback on accuracy and clarity.

Review AI-generated legal support responses for accuracy and errors, then evaluate and rank them to improve correctness and clarity.

Review AI-generated risk management responses and write precise feedback on reasoning quality and accuracy.

Review AI-generated tax and audit responses for accuracy and reasoning quality, and write expert explanations and model solutions.

Review AI-generated insurance responses and write expert content, identifying errors in coverage analysis, claims handling logic, and underwriting reasoning.

Review AI-generated financial analysis responses and identify errors in modeling logic, assumptions, and valuation reasoning with written feedback.

Review AI-generated advertising outputs and write expert ad copy, rating and comparing multiple responses for effectiveness, correctness, and reasoning quality.

Review AI-generated accounting responses for errors in journal entries and reconciliations, and write model solutions demonstrating correct methods.

Review AI-generated market research outputs and evaluate research design, sampling logic, and survey construction, providing precise written feedback.

Review AI-generated brand strategy and positioning outputs and provide precise written feedback on reasoning quality.

Review AI-generated PR communications outputs and write model deliverables such as press releases, statements, and FAQs.

Review AI-generated SEO and marketing outputs and rate and compare multiple AI responses for effectiveness and reasoning quality.

Review AI-generated social content and strategy outputs, and write precise written feedback on clarity, brand voice, and platform fit.

Review AI-generated marketing copy for accuracy, tone and clarity, and rank multiple responses while writing expert rewrites with feedback.

Review AI-generated radiology responses and evaluate imaging reasoning, writing precise written feedback on accuracy and safety.

Review AI-generated dental and oral-health responses and write expert model solutions demonstrating correct clinical reasoning.

Review AI-generated public health responses for errors in epidemiologic reasoning, and write gold-standard prompts and answers on public health topics.

Review AI-generated clinical research content and identify errors in study design, statistics, and evidence interpretation.

Review AI-generated medication responses and evaluate pharmacotherapy reasoning, identifying errors in dosing, contraindications, and interactions.

Review AI-generated Scala code and technical explanations, and write reference implementations with step-by-step reasoning for complex engineering problems.

Review AI-generated C++ code and technical explanations for errors in logic, memory handling, and concurrency, and write reference model solutions.

Review AI-generated C code for errors in logic, memory handling, and concurrency, and write reference implementations.

Review AI-generated PHP code and backend designs, then rate and compare AI responses for correctness.

Evaluate AI-generated responses for technical accuracy and challenge language models with realistic chemical engineering scenarios and calculations.

Evaluate AI-generated responses for technical accuracy and challenge language models with realistic biomedical engineering scenarios.

Evaluate AI-generated responses for technical accuracy and challenge language models with realistic electrical engineering scenarios and calculations.

Evaluate AI-generated responses for scientific accuracy and logical soundness across astronomy and space science topics, providing structured feedback on errors.

Review AI-generated legal analyses and fact-check citations and stated rules, providing precise written feedback.

Evaluate AI-generated responses for technical accuracy and challenge language models with realistic civil engineering scenarios.

Review AI-generated analytical reasoning, code, and model outputs for errors, and write step-by-step reference solutions for complex data problems.

Review AI-generated physics responses, evaluate step-by-step reasoning, and identify errors in calculations, methodology, or conceptual understanding.

Review AI-generated engineering solutions, evaluating reasoning quality, and rate and compare multiple responses with written feedback on correctness.

Review AI-generated chemistry responses, identify calculation or methodology errors, and rate multiple responses by chemical correctness.

Review AI-generated math responses, evaluate step-by-step reasoning, and identify errors in calculations and methodology.

Review AI-generated responses, evaluate reasoning quality and step-by-step problem-solving, and provide expert feedback on biological accuracy.

Review AI-generated medical responses, fact-check clinical information, and rate and compare multiple responses based on correctness and reasoning quality.

Review AI-generated Swift and iOS responses, evaluating their reasoning quality, and write expert-level explanations and model solutions.

Review AI-generated Ruby and Rails code, evaluate reasoning quality, and rate and compare multiple AI responses for correctness.

Review AI-generated responses and write R data-analysis solutions, evaluating the reasoning quality behind each solution.

Review AI-generated Kotlin responses and rate and compare multiple AI responses for correctness and reasoning quality.

Review AI-generated C#/.NET responses, fact-check technical claims, and rate and compare responses for correctness and reasoning quality.

Review AI-generated Rust code and explanations, evaluate reasoning quality, and rate and compare multiple AI responses for correctness.

Review AI-generated JavaScript code and explanations, and rate and compare multiple AI responses on correctness and reasoning quality.

Review AI-generated Go code and compare multiple AI responses for correctness and reasoning quality.

Review AI-generated TypeScript code snippets and explanations for correctness, and write reference solutions while rating and comparing multiple AI responses.

Review AI-generated Java code and technical explanations, then rate and compare multiple AI responses for correctness.

Review AI-generated Python solutions for correctness and code quality, and write clear step-by-step explanations and exemplary solutions.

Review AI-generated responses and rate and compare multiple AI responses based on correctness and reasoning quality.

Review AI-generated English responses, evaluate reasoning quality, and rate and compare multiple responses for correctness.

Evaluate AI-generated clinical content on heart failure diagnosis and management, and provide evidence-based feedback to improve AI medical recommendations.

Evaluate AI-generated interpretations of cardiovascular imaging findings and review clinical scenarios involving echocardiography, cardiac MRI, and cardiac CT.

Evaluate AI-generated interventional cardiology information and review scenarios involving coronary angiography, angioplasty, and stent placement.

Evaluate AI-generated interpretations of cardiovascular imaging findings and review clinical scenarios involving echocardiography, cardiac MRI, and cardiac CT.

Translate engineering requirements into SysML v2 textual models and create evaluation rubrics for assessing AI-generated SysML v2 models.

Solve and validate advanced mathematical problems by translating requirements into executable Python and command-line workflows.