MBB Consultant - AI Consulting Simulation and Evaluation

Remote Full-time
Toloka AI supports frontier model post-training by building domain‑specific reinforcement learning environments, tasks, and evaluation frameworks designed by real practitioners.

Mindrift, powered by Toloka — a leading enterprise AI and machine learning data partner since 2014 — connects top domain experts with cutting‑edge AI initiatives. Backed by Toloka’s deep expertise in scalable data generation, crowd technology, and applied ML systems, Mindrift enables experts to shape how next‑generation generative models learn, reason, and perform.

We are now launching a Management Consulting domain focused on translating real‑world consulting engagements into structured learning environments for advanced AI systems. To do this credibly, we are building a team of former McKinsey, BCG, and Bain consultants who can convert authentic project experience into end‑to‑end examples — from problem structuring and work planning to analysis, synthesis, and client‑ready recommendations.

You will join a team of ex‑McKinsey and Bain consultants shaping how AI learns high‑level business reasoning.

Important: This role is exclusively for consultants with MBB experience (McKinsey, BCG, or Bain). If you do not have direct experience at one of these firms, please do not apply. This requirement is non‑negotiable and helps us ensure the domain is built by practitioners with firsthand MBB training and standards.

Who We're Looking For

Consultants with 3+ years of experience at McKinsey & Company, Boston Consulting Group, or Bain & Company.

You should have hands‑on project experience:
• Structuring ambiguous client problems
• Building models and synthesized findings
• Producing client‑ready deliverables
• Forming recommendations under uncertainty

No deep technical background required, we’ll onboard you on the lightweight tools involved.

What You’ll Do
• Build realistic consulting project environments: create detailed project scenarios (industry context, financials, constraints, incomplete information)
• Design structured consulting tasks for AI Agents: break projects into tasks that mirror real consulting work such as market sizing, due diligence, cost reduction, growth strategy, or operational diagnosis
• Define evaluation criteria and quality standards: develop a grading approach, evaluation criteria and golden solutions for each task that will be used to train and calibrate an LLM‑based grading system that evaluates AI outputs at scale

This is a remote individual‑contributor project‑based role focused on analytical design and evaluation.

Skills & Requirements
• 3+ years at McKinsey, BCG, or Bain
• Strong structured problem‑solving skills
• Ability to translate vague problems into clear analytical steps
• High attention to logical consistency
• Independent working style
• Clear written English (B2+)

Apply Now

Apply Now
Apply Now →

Similar Jobs

Experienced Registered Behavior Technician for In-Home ABA Therapy - Atlanta, GA

Remote

Immediate Hiring: Experienced Registered Behavioral Technician (RBT) for Clinic-Based ABA Therapy Services

Remote

Experienced Registered Behavioral Technician (RBT) - ABA Therapy for Children with Autism Spectrum Disorder

Remote

Experienced Registered Nurse - Telehealth: Providing Remote Care Coordination and Patient Support

Remote

Experienced Substitute Teacher for Riverside County Schools - Join Scoot Education's Innovative Team

Remote

Experienced Substitute Teacher for San Bernardino County - Flexible Schedules & Competitive Pay

Remote

Experienced School Year Instructional Coach for High-Dosage Tutoring Programs in Edgewater Park, NJ

Remote

Experienced School Year Tutor for K-8 Students in Math and Literacy - Mickleton, NJ

Remote

Experienced Secondary Social Studies Teacher for Kansas - Flexible Hybrid Remote Arrangement

Remote

USPS Office Helper

Remote

**Experienced Remote Data Entry Clerk – Entry-Level Opportunity at blithequark**

Remote

Experienced CDP Product Leader – Real-Time Customer Data Platform Technical Expert (Adobe Experience Platform) – Remote Work From Home Opportunity

Remote

Inpatient Coder - Account Resolution

Remote

Strategic Account Executive

Remote

Join Today: Senior Safety Professional- Project Hire

Remote

Experienced Remote Customer Support Chat Agent – Delivering Exceptional Client Experiences through Proactive Issue Resolution and Personalized Product Expertise

Remote

Payroll Manager (Remote Opportunity)

Remote

American Airlines Remote Customer Service Careers $25/Hour

Remote

Travel Nurse RN - Urgent Care - $2,616 per week

Remote

Senior Pre-Sales Specialist (US, West Coast)

Remote
← Back