Technical QA Reviewer
Easy apply
New
Job summary
We are seeking an experienced Technical QA Reviewer to oversee annotation quality standards, ensure decision consistency, and maintain evaluation integrity across AI data operations. This role serves as the final quality control layer before datasets and model evaluations are approved for production use.
Min Qualification:
Degree
Experience Level:
Mid level
Experience Length:
4 years
Job descriptions & requirements
Responsibilities:
- Review annotator and QA decisions for accuracy, consistency, and policy adherence
- Conduct meta-QA reviews to evaluate the quality of prior annotations
- Handle dispute resolution cases and ambiguous edge scenarios
- Set and enforce quality thresholds and performance benchmarks
- Perform structured quality audits through sampling and trend analysis
- Identify systemic annotation errors and recommend process improvements
- Train and mentor junior QA reviewers to ensure judgment consistency
- Contribute to annotation guideline refinement and process design
Requirements:
- Bachelor’s degree in Computer Science, Information Technology, or equivalent professional experience.
- 4+ years of deep experience in annotation workflows and QA review processes
- Strong consistency in judgment and decision-making
- Solid understanding of quality control frameworks and sampling methodologies
- Experience in dispute resolution and edge-case evaluation
- Process design and optimization knowledge
- Excellent documentation and communication skills
Important safety tips
- Do not make any payment without confirming with the Jobberman Customer Support Team.
- If you think this advert is not genuine, please report it via the Report Job link below.
