AI Trainer Jobs in Brazil
About The Role
As an AI Trainer, you will improve large language models by producing high-quality training signals through data labeling, RLHF preference rankings, and rubric-based evaluations. You will support end-to-end LLM training pipelines with consistent, well-documented decisions that improve instruction following, reasoning quality, and content safety outcomes.
What You Will Do
ā¢ Perform data labeling for NLP tasks (intent classification, summarization checks, factuality review, named entity recognition)
ā¢ Execute RLHF work: pairwise ranking, rubric-based scoring, and short rationales
ā¢ Conduct prompt evaluation and response quality scoring using detailed rubrics
ā¢ Run QA evaluation, track error categories, and contribute to guideline updates
ā¢ Support content safety labeling for policy-sensitive topics
ā¢ Collaborate with engineering partners on edge cases, sampling strategies, and quality thresholds
Core Workstreams
ā¢ LLM evaluation (instruction following, reasoning quality, refusal behavior)
ā¢ Training data quality audits (spot checks, adjudication, gold set creation)
ā¢ Annotation operations (calibration sessions, reviewer alignment)
ā¢ Occasional multimodal evaluation or computer vision annotation when required
Qualifications
ā¢ Mid-senior experience in data operations, evaluation, QA, or applied AI workflows
ā¢ Strong written communication and ability to produce consistent decision rationales
ā¢ Attention to detail with rubric-based scoring and annotation guidelines compliance
ā¢ Familiarity with NLP concepts, LLM behavior, and training data quality practices
Employment Details
Remote, full-time role with Rex.zone.
Compensation:
$30ā$50 per hour (USD), depending on scope and assignment.
How To Apply
Apply on Rex.zone via the AI Trainer jobs in Brazil page.
As an AI Trainer, you will improve large language models by producing high-quality training signals through data labeling, RLHF preference rankings, and rubric-based evaluations. You will support end-to-end LLM training pipelines with consistent, well-documented decisions that improve instruction following, reasoning quality, and content safety outcomes.
What You Will Do
ā¢ Perform data labeling for NLP tasks (intent classification, summarization checks, factuality review, named entity recognition)
ā¢ Execute RLHF work: pairwise ranking, rubric-based scoring, and short rationales
ā¢ Conduct prompt evaluation and response quality scoring using detailed rubrics
ā¢ Run QA evaluation, track error categories, and contribute to guideline updates
ā¢ Support content safety labeling for policy-sensitive topics
ā¢ Collaborate with engineering partners on edge cases, sampling strategies, and quality thresholds
Core Workstreams
ā¢ LLM evaluation (instruction following, reasoning quality, refusal behavior)
ā¢ Training data quality audits (spot checks, adjudication, gold set creation)
ā¢ Annotation operations (calibration sessions, reviewer alignment)
ā¢ Occasional multimodal evaluation or computer vision annotation when required
Qualifications
ā¢ Mid-senior experience in data operations, evaluation, QA, or applied AI workflows
ā¢ Strong written communication and ability to produce consistent decision rationales
ā¢ Attention to detail with rubric-based scoring and annotation guidelines compliance
ā¢ Familiarity with NLP concepts, LLM behavior, and training data quality practices
Employment Details
Remote, full-time role with Rex.zone.
Compensation:
$30ā$50 per hour (USD), depending on scope and assignment.
How To Apply
Apply on Rex.zone via the AI Trainer jobs in Brazil page.