AI Content Reviewer

Responsibilities:

• Review AI-generated text, image descriptions, or code for accuracy, relevance, toxicity, and bias.
• Create high-quality training datasets by labeling data according to strict guidelines.
• Audit the work of junior reviewers or automated systems to ensure consistency and adherence to project rubrics.
• Collaborate with the operations teams to refine style guides and annotation instructions based on emerging trends and edge cases.
• Identify patterns in model errors and provide detailed feedback to data scientists and engineers for model improvement.

Requirements:

• Minimum of 4 years of professional experience in Content Review, Moderation, Fact-Checking, or Quality Assurance within the tech or digital media space.
• Proven ability to analyze complex information quickly, make reasoned judgments, and justify decisions based on ambiguous guidelines.
• Familiarity with basic metrics like Inter-Agreement Rates of F1 scores. Understanding how your reviews impact model performance statistics is key.
• Comfortable working with multiple software platforms, spreadsheets, and internal annotation tools simultaneously.
• Ability to handle exposure to potentially sensitive or disturbing content with professionalism and emotional intelligence.
• Experience working with Generative AI models (ChatGPT, Bard, Midjourney, etc.) from a testing or feedback perspective.
• Background in Linguistics, data annotation, or computational Linguistics.
• Ability to work in a fast-paced, ambiguous environment where guidelines and product features evolve frequently.
• The ability to review AI-generated content for factual accuracy and regulatory compliance within a high-stakes domain is highly desirable.

Remuneration: NGN 500,000 monthly