English (U.S. Native) AI Trainer & Evaluator (Remote, Hourly Contractor)

Remote Full-time
Position Summary
• This is a fully remote, hourly contractor role supporting AI data and language projects on a project-based, flexible hour basis. Project scopes vary and may include:
• Content generation: writing high-quality prompts and model responses, or recording high-quality voice samples, to guide AI learning across diverse topics.
• Data annotation: labeling, classifying, and structuring documents, tables, and other content to support AI training datasets.
• LLM evaluation: reviewing AI-generated responses for accuracy, reasoning quality, coherence, and cultural/linguistic appropriateness.
• Localization QA: ensuring terminology, tone, cultural nuance, and locale-specific details (units, references, names, dates) are consistently accurate across outputs.

This position exclusively seeks native speakers of American English born and raised in the United States.
• Profile Requirements
• Native speakers of American English born and raised in the United States.
• Excellent editorial judgment in register, tone, punctuation, inclusivity, and cultural nuance, with extreme attention to detail.
• Ability to identify meaning drift, ambiguity, locale inconsistencies, and subtle errors, and to explain corrections clearly in writing.
• Ability to rigorously fact-check localized content (units, references, names, dates) using reliable sources and consistent reasoning.
• Ability to identify reasoning gaps, methodological errors, and unclear explanations even when language is fluent.
• Reliable, self-directed, and able to deliver consistent quality with clear communication and responsiveness across time zones.
• Preferred Experience
• Familiarity with MQM/LQA concepts (severity, category, and root-cause thinking) for consistent quality decisions.
• Familiarity with QA workflows.
• Previous experience with AI data training, annotation, or evaluation.
About CNTXT AI

CNTXT AI builds artificial intelligence products and data solutions with a focus on making AI accurate, safe, and globally relevant for impact. Our work spans data services, custom AI solutions, and proprietary AI products, with deep expertise in Arabic-native and secure, sovereign solutions.
Apply Now →

Similar Jobs

Experienced Registered Behavior Technician for In-Home ABA Therapy - Atlanta, GA

Remote

Immediate Hiring: Experienced Registered Behavioral Technician (RBT) for Clinic-Based ABA Therapy Services

Remote

Experienced Registered Behavioral Technician (RBT) - ABA Therapy for Children with Autism Spectrum Disorder

Remote

Experienced Registered Nurse - Telehealth: Providing Remote Care Coordination and Patient Support

Remote

Experienced Substitute Teacher for Riverside County Schools - Join Scoot Education's Innovative Team

Remote

Experienced Substitute Teacher for San Bernardino County - Flexible Schedules & Competitive Pay

Remote

Experienced School Year Instructional Coach for High-Dosage Tutoring Programs in Edgewater Park, NJ

Remote

Experienced School Year Tutor for K-8 Students in Math and Literacy - Mickleton, NJ

Remote

Experienced Secondary Social Studies Teacher for Kansas - Flexible Hybrid Remote Arrangement

Remote

USPS Office Helper

Remote

Experienced Customer Service Associate - Temporary in Plattsburgh, NY at careerzynith

Remote

Hiring Now: Work At Home Data Entry Remote Position

Remote

Experienced Customer Service Representative – Remote Work Opportunity at careerzynith

Remote

Experienced Data Entry Specialist – Live Chat and Remote Work Opportunity with blithequark in Cambodia, Offering $40/Hour in 2024

Remote

Pharmacy Summer Internship Lakeland Hospital

Remote

Business Development Associate

Remote

Apply Now: Part-time AI Writing Evaluator (Tier 2)

Remote

American Express Remote Jobs (Virtual Assistant ) $70000/Yearly

Remote

Financial Crimes Compliance Model Analyst - Remote

Remote

Flutter Developer Needed – Simple Offline App (4 Buttons) – Urgent

Remote
← Back