AI Jobs in India — Remote AI Data Annotation Specialist

Remote Full-time
• *About The Role**

Rex.zone is hiring remote, full-time AI Data Annotation Specialists to support LLM training pipelines through high-quality data labeling, RLHF evaluation, prompt evaluation, and QA evaluation. You will work on multimodal datasets (text and image) and deliver rubric-aligned judgments that improve training data quality and model performance.
• *What You Will Do
• Execute data labeling and data annotation for NLP and computer vision datasets
• Perform RLHF-style preference comparisons and graded reward-model judgments
• Run prompt evaluation and response grading using detailed rubrics
• Complete QA evaluation audits, guideline compliance checks, and rework cycles
• Apply named entity recognition (NER), taxonomy tagging, and text classification
• Conduct content safety labeling (policy, harm, hate, self-harm, sexual content) with escalation workflows
• Document edge cases and contribute to annotation guidelines updates
• Report throughput, agreement rates, and error categories to improve production quality
• *What We Are Looking For
• Mid-Senior experience delivering high-precision labeling/evaluation work
• Strong written English and ability to follow complex rubrics
• Familiarity with LLM evaluation, RLHF concepts, and prompt evaluation methods
• Strong QA mindset: sampling, audits, disagreement analysis, and root-cause analysis
• Comfort working remotely with asynchronous communication and versioned guidelines
• Compensation
• $30–$50 per hour

(base salary, hourly). Final compensation depends on scope and evaluation complexity.
• *How To Apply**

Apply via Rex.zone and share relevant labeling, evaluation, and QA experience.
Apply Now →

Similar Jobs

Experienced Registered Behavior Technician for In-Home ABA Therapy - Atlanta, GA

Remote

Immediate Hiring: Experienced Registered Behavioral Technician (RBT) for Clinic-Based ABA Therapy Services

Remote

Experienced Registered Behavioral Technician (RBT) - ABA Therapy for Children with Autism Spectrum Disorder

Remote

Experienced Registered Nurse - Telehealth: Providing Remote Care Coordination and Patient Support

Remote

Experienced Substitute Teacher for Riverside County Schools - Join Scoot Education's Innovative Team

Remote

Experienced Substitute Teacher for San Bernardino County - Flexible Schedules & Competitive Pay

Remote

Experienced School Year Instructional Coach for High-Dosage Tutoring Programs in Edgewater Park, NJ

Remote

Experienced School Year Tutor for K-8 Students in Math and Literacy - Mickleton, NJ

Remote

Experienced Secondary Social Studies Teacher for Kansas - Flexible Hybrid Remote Arrangement

Remote

USPS Office Helper

Remote

Experienced Data Processing and Customer Service Professional for Order Administration and Fulfillment Management

Remote

**Experienced Customer Service Representative – Remote Work Opportunity with arenaflex**

Remote

N2 Publishing is hiring: Advertising Manager in Wilmington

Remote

**Experienced Bilingual Customer Service Representative – Remote Opportunity with blithequark**

Remote

Web Developer - Webflow

Remote

Behavior Technician Position - Make a Difference in Autism Care

Remote

K-5 ELA Curriculum Writer

Remote

Part-time Gig Driver

Remote

**Experienced Full Stack Data Scientist – Clinical Research and Evidence Generation**

Remote

Immediate Hiring: Creative Content Creator for Grocery Shopping UGC Reel in Walmart - Remote

Remote
← Back