Gramian Consulting Group Logo

Gramian Consulting Group

AI Annotation Quality Reviewer

Posted 2 Days Ago
Remote
Hiring Remotely in India
Mid level
Remote
Hiring Remotely in India
Mid level
Leads quality assurance for AI training data by managing review queues, auditing annotations, monitoring quality trends, coaching reviewers, clarifying guidelines, training new team members, identifying recurring errors, and escalating complex issues. The role also supports corrective actions and continuous improvement while ensuring accurate, consistent, and timely project delivery.
The summary above was generated by AI

About Gramian

Gramian Consultancy is a boutique consultancy specializing in IT professional services and engineering talent solutions. With a strong background in software engineering and leadership, we help companies build high-performing teams by matching them with professionals who truly fit their needs.

About the Role

We are seeking a detail-oriented QA Review Team Lead to oversee quality assurance activities for AI training data and ensure annotated outputs are accurate, consistent, and delivered on time. In this role, you will lead QA reviewers, manage audit and review queues, assess annotation quality, identify recurring errors, and provide clear, actionable feedback to improve team performance. You will also train new reviewers, clarify guidelines for annotators, and escalate complex or recurring issues to the Senior QA Lead. The ideal candidate combines strong quality assurance skills with experience mentoring team members and applying detailed guidelines in a fast-paced environment.

CONTRACT: Contractor assignment, 16 weeks

COMMITMENT: Hourly, up to 40h/week

LOCATIONS: Remote - Brazil, Colombia, India

Key Responsibilities

  • Lead QA reviewers and manage audit and review queues to ensure timely and accurate completion of assigned work.
  • Spot-check annotated data and reviewer decisions to verify compliance with project guidelines and quality standards.
  • Provide clear, actionable, and consistent feedback to reviewers and annotators.
  • Conduct office hours and clarify annotation guidelines, review criteria, and quality expectations.
  • Monitor quality scores, error trends, audit results, and reviewer performance.
  • Train and onboard new reviewers on project guidelines, tools, and review procedures.
  • Identify recurring errors, inconsistencies, and process gaps, and recommend corrective actions.
  • Escalate persistent quality issues, unclear guidelines, and complex cases to the Senior QA Lead.
  • Support continuous improvement of review processes and maintain consistent quality across the team.

Requirements
  • 3–5 years of overall professional experience, including at least 1 year of experience leading, mentoring, or supervising reviewers or team members.

  • Strong attention to detail and the ability to apply complex guidelines consistently.

  • Excellent written and verbal communication skills.

  • Ability to provide constructive, actionable feedback and explain quality expectations clearly.

  • Strong organizational skills and the ability to manage multiple review queues and competing deadlines.

  • Ability to identify patterns in errors and support corrective actions.

  • Availability to work the specified schedule for the full 16-week project.

Similar Jobs

Yesterday
Remote or Hybrid
Expert/Leader
Expert/Leader
Blockchain • Fintech • Payments • Consulting • Cryptocurrency • Cybersecurity • Quantum Computing
Provides executive technology leadership for Mastercard’s Pune platform organization, connecting offshore execution with UK strategy and accountability. The role drives portfolio prioritization, governance, capacity planning, operational resilience, efficiency, automation, and cross-functional dependency resolution through matrix influence rather than direct authority. It also develops leaders, strengthens technical capability, aligns infrastructure and platform stakeholders, and scales the Pune technology hub while improving delivery effectiveness, productivity, and organizational maturity.
Top Skills: AutomationEnterprise ArchitectureInformation SecurityInfrastructureOperational ResiliencePlatform Engineering
Yesterday
Remote
India
Entry level
Entry level
Artificial Intelligence • Consumer Web • Digital Media • Information Technology • Social Impact • Software
Translate English software UI text and online marketing content into natural European Spanish. Maintain meaning, tone, variables, formatting, glossaries, and style guidelines using key-based localization tools. Review and resolve linguistic QA issues, communicate availability and delivery risks asynchronously, and coordinate with Circle and another translator to maintain coverage. Work independently as a remote contractor while collaborating primarily through Slack.
Top Skills: Slack
Yesterday
Remote
India
Entry level
Entry level
Artificial Intelligence • Consumer Web • Digital Media • Information Technology • Social Impact • Software
Translate software UI text and online marketing content from English into natural European Portuguese. Preserve meaning, tone, formatting, variables, and cultural conventions while following Circle’s glossary and style guide. Use key-based localization tools, resolve linguistic QA issues, communicate availability and risks asynchronously in Slack, and coordinate coverage with another translator. The role requires professional localization experience, native-level European Portuguese, strong English communication, independent judgment, and familiarity with SaaS or digital products as a bonus.
Top Skills: Ai ToolsKey-Based Translation ToolsSlack

What you need to know about the Delhi Tech Scene

Delhi, India's capital city, is a place where tradition and progress co-exist. While Old Delhi is known for its rich history and bustling markets, New Delhi is defined by its modern architecture. It's clear the region places a strong emphasis on preserving its cultural heritage while embracing technological advancements, particularly in artificial intelligence, which plays a central role in shaping the city's tech landscape, fueled by investments in research and development.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account