AI Content Reviewer (Remote)

About the role

We are looking for a meticulous AI Content Reviewer to evaluate and improve AI‑generated outputs across text, image descriptions, and code. The role is fully remote, allowing you to work from anywhere while ensuring content meets accuracy, brand, and safety standards.

Key responsibilities

• Review AI‑generated text, image captions, and code for relevance, factual integrity, toxicity, and bias.
• Create high‑quality training datasets by labeling data according to strict guidelines.
• Audit junior reviewers or automated systems to maintain consistency with project rubrics.
• Collaborate with operations teams to refine style guides and annotation instructions.
• Identify recurring model errors and provide detailed feedback to data scientists and engineers.
• Track basic metrics such as Inter‑Agreement Rates and F1 scores to gauge impact on model performance.

Required profile

• Minimum 2 years of experience in content review, moderation, fact‑checking, or quality assurance within tech or digital media.
• Strong analytical ability to make reasoned judgments under ambiguous guidelines.
• Comfort handling potentially sensitive or disturbing content with professionalism.
• Experience testing or providing feedback on generative AI models (e.g., ChatGPT, Bard, Midjourney).
• Background in linguistics, data annotation, or computational linguistics is a plus.

Required skills

• Familiarity with generative AI models such as ChatGPT, Bard, Midjourney.
• Data annotation and labeling using internal annotation tools.
• Understanding of evaluation metrics like F1 score and Inter‑Agreement Rate.
• Proficiency with spreadsheets and multiple software platforms.