Remote Prompt Engineer for AI Evaluation & Coding

Remote Full-time
Craft realistic, chat-style developer prompts covering code review, debugging, error diagnosis, configuration, and related scenarios.
Source and adapt real pull requests and engineering discussions to create authentic evaluation tasks.
Write clear, technically accurate model responses that demonstrate strong reasoning and explanation quality.
Evaluate AI outputs based on logic, clarity, and technical judgment rather than executable correctness.
Apply software engineering expertise to ensure prompts and responses reflect real-world developer workflows.
Contribute to structured evaluation datasets used to assess AI reasoning and communication quality.
Collaborate asynchronously with research teams to refine task quality and consistency.
Requirements
Strong experience in software engineering, technical research, or educational content development.
Bachelor’s degree in Software Engineering, Computer Science, or a related field.
Hands-on experience with debugging, testing, and validating code.
Strong technical writing skills with high attention to detail.
Ability to work independently in a fully remote, project-based environment.

#J-18808-Ljbffr Crossing Hurdles
Apply Now →

Similar Jobs

Experienced Registered Behavior Technician for In-Home ABA Therapy - Atlanta, GA

Remote

Immediate Hiring: Experienced Registered Behavioral Technician (RBT) for Clinic-Based ABA Therapy Services

Remote

Experienced Registered Behavioral Technician (RBT) - ABA Therapy for Children with Autism Spectrum Disorder

Remote

Experienced Registered Nurse - Telehealth: Providing Remote Care Coordination and Patient Support

Remote

Experienced Substitute Teacher for Riverside County Schools - Join Scoot Education's Innovative Team

Remote

Experienced Substitute Teacher for San Bernardino County - Flexible Schedules & Competitive Pay

Remote

Experienced School Year Instructional Coach for High-Dosage Tutoring Programs in Edgewater Park, NJ

Remote

Experienced School Year Tutor for K-8 Students in Math and Literacy - Mickleton, NJ

Remote

Experienced Secondary Social Studies Teacher for Kansas - Flexible Hybrid Remote Arrangement

Remote

USPS Office Helper

Remote

**Experienced Remote Data Entry Clerk – Flexible Part-Time Opportunity with Competitive Hourly Rate**

Remote

Manager - Data Engineering And Analytics

Remote

Behavioral Health Clinician/Therapist - Center for Traumatic Stress in Children & Adolescents

Remote

Distribution Partner Account Manager- EMEA Southern Region

Remote

Cashier/Front End Services

Remote

Experienced E-commerce Live Chat Support Specialist – Remote Customer Service Representative for Dynamic Online Shopping Experience

Remote

Support Specialist- Remote (Bi-lingual/Spanish)

Remote

Senior Software Engineer Python Django PostgreSQL and Vue.js

Remote

Immediate Hiring: Looking for MLS Lab/Teaching assistants in

Remote

Behavioral Health Educator, Research (Multiple Positions)

Remote
← Back