Software Developer AI Trainer, $100-$130/hour

Remote Full-time
Project Overview:

Join a growing community of professionals advancing the next wave of AI. As an AI Trainer, you'll play a hands-on role by analyzing and providing feedback on data to improve LLM performance, helping ensure that the next generation of AI technology is accurate and trustworthy.

We are seeking a skilled Senior Software Engineer to work as a project consultant in our AI Labor Marketplace. This is not a full-time employment position - you will be engaged as an expert project consultant on a contract basis.

Location: U.S.-based experts only

Engagement: Part-time, project-based expert evaluation work

Work Type: Remote

Project Summary:

Consultants will design realistic, senior-level software engineering tasks, evaluate GPT-5.2 model reasoning using structured rubrics, and produce gold-standard responses that reflect real-world engineering best practices.

Consultant Engagement Terms:

This is a project-based consultant role. Consultants will be paid on a per-project basis; hourly rates are estimates based on anticipated completion time. Consultants control their own schedule, provide their own tools, and may simultaneously provide services to other vendors/employers (subject to those vendors' allowances).

Responsibilities:

Contributors will:
• Create realistic, complex software engineering prompts based on professional experience
• Design clear, criteria-based evaluation rubrics
• Evaluate GPT-5.2 model outputs against defined success criteria
• Author high-quality gold responses demonstrating senior-level reasoning
• Ensure all work is synthetic, non-proprietary, and objectively evaluable

Expected Outcomes:
• High-quality prompts that reflect real engineering challenges
• Clear, defensible evaluation rubrics
• Consistent, well-reasoned model evaluations
• Gold-standard responses suitable for model training and benchmarking

Qualifications:
• 10+ years of professional software engineering experience
• Senior, Staff, Principal, Tech Lead, or Architect-level background
• Strong CS fundamentals and production system experience
• Experience at top SaaS companies or scaled startups preferred
• Prior data annotation or model evaluation experience is a strong plus

Apply Now

Apply Now
Apply Now →

Similar Jobs

Experienced Registered Behavior Technician for In-Home ABA Therapy - Atlanta, GA

Remote

Immediate Hiring: Experienced Registered Behavioral Technician (RBT) for Clinic-Based ABA Therapy Services

Remote

Experienced Registered Behavioral Technician (RBT) - ABA Therapy for Children with Autism Spectrum Disorder

Remote

Experienced Registered Nurse - Telehealth: Providing Remote Care Coordination and Patient Support

Remote

Experienced Substitute Teacher for Riverside County Schools - Join Scoot Education's Innovative Team

Remote

Experienced Substitute Teacher for San Bernardino County - Flexible Schedules & Competitive Pay

Remote

Experienced School Year Instructional Coach for High-Dosage Tutoring Programs in Edgewater Park, NJ

Remote

Experienced School Year Tutor for K-8 Students in Math and Literacy - Mickleton, NJ

Remote

Experienced Secondary Social Studies Teacher for Kansas - Flexible Hybrid Remote Arrangement

Remote

USPS Office Helper

Remote

Principal Legal Counsel – Global Trade Legal & Compliance

Remote

Data Entry Specialist Job

Remote

Experienced Customer Support Representative for Healthcare Industry – FULLY REMOTE Opportunity with arenaflex

Remote

Data Entry Jobs/ Work at Home Jobs - VacancyGlobal

Remote

Business Development Representative (Canada)

Remote

Experienced Global Head of Customer Success – Strategic Leadership for Customer-Centric SaaS Environment

Remote

Amazon Customer Service - Work From Home - Part Time

Remote

Remote Outbound Call Center Agent

Remote

BDR Manager (Americas)

Remote

Hospital at Home - Virtual Care Physician - Charlotte, NC

Remote
← Back