AI Jobs in India — Remote AI Data Annotation Specialist

Remote Full-time
About The Role
Rex.zone is hiring remote, full-time AI Data Annotation Specialists to support LLM training pipelines through high-quality data labeling, RLHF evaluation, prompt evaluation, and QA evaluation. You will work on multimodal datasets (text and image) and deliver rubric-aligned judgments that improve training data quality and model performance.

What You Will Do
• Execute data labeling and data annotation for NLP and computer vision datasets
• Perform RLHF-style preference comparisons and graded reward-model judgments
• Run prompt evaluation and response grading using detailed rubrics
• Complete QA evaluation audits, guideline compliance checks, and rework cycles
• Apply named entity recognition (NER), taxonomy tagging, and text classification
• Conduct content safety labeling (policy, harm, hate, self-harm, sexual content) with escalation workflows
• Document edge cases and contribute to annotation guidelines updates
• Report throughput, agreement rates, and error categories to improve production quality

What We Are Looking For
• Mid-Senior experience delivering high-precision labeling/evaluation work
• Strong written English and ability to follow complex rubrics
• Familiarity with LLM evaluation, RLHF concepts, and prompt evaluation methods
• Strong QA mindset: sampling, audits, disagreement analysis, and root-cause analysis
• Comfort working remotely with asynchronous communication and versioned guidelines

Compensation
$30–$50 per hour
(base salary, hourly). Final compensation depends on scope and evaluation complexity.
How To Apply
Apply via Rex.zone and share relevant labeling, evaluation, and QA experience.

Apply tot his job

Apply To this Job
Apply Now →

Similar Jobs

Experienced Registered Behavior Technician for In-Home ABA Therapy - Atlanta, GA

Remote

Immediate Hiring: Experienced Registered Behavioral Technician (RBT) for Clinic-Based ABA Therapy Services

Remote

Experienced Registered Behavioral Technician (RBT) - ABA Therapy for Children with Autism Spectrum Disorder

Remote

Experienced Registered Nurse - Telehealth: Providing Remote Care Coordination and Patient Support

Remote

Experienced Substitute Teacher for Riverside County Schools - Join Scoot Education's Innovative Team

Remote

Experienced Substitute Teacher for San Bernardino County - Flexible Schedules & Competitive Pay

Remote

Experienced School Year Instructional Coach for High-Dosage Tutoring Programs in Edgewater Park, NJ

Remote

Experienced School Year Tutor for K-8 Students in Math and Literacy - Mickleton, NJ

Remote

Experienced Secondary Social Studies Teacher for Kansas - Flexible Hybrid Remote Arrangement

Remote

USPS Office Helper

Remote

**Experienced Remote Data Entry Clerk – Flexible Work Arrangements and Opportunities for Growth at arenaflex**

Remote

Financial Services Professional

Remote

Product Group HW Governance Business Systems Analyst

Remote

Full Time Registered Behavior Technician

Remote

Looking for Online English Tutor ? Flexible Hours in Rio Rancho, NM

Remote

Senior Network Engineer

Remote

Commercial Service Plumber

Remote

**Experienced Full Stack Customer Service Representative – Chat Support for blithequark's E-commerce Success**

Remote

[Remote] Principal AI Systems Engineer

Remote

Product Manager - Product Led Growth Services

Remote
← Back