[Remote] Domain Advisor Consultant (Subject Matter Expert)

Note: The job is a remote job and is open to candidates in USA. Meridial Marketplace, by Invisible, is seeking elite Subject Matter Experts (SMEs) to engage in high-impact AI evaluation and training projects. The role involves defining quality criteria for AI outputs, curating benchmark examples for model training, and providing expert analysis on model failures. This is a consulting opportunity for independent professionals with deep domain knowledge who want to shape the standards for AI in their fields.ResponsibilitiesReview and advise on the quality criteria used to evaluate AI outputsCreate, edit, or certify "Golden Tasks"—benchmark examples of perfect prompts and responses that serve as the ground truth for model trainingAnalyze model failures (hallucinations, logical fallacies) and provide technical breakdowns of why the model failed and how a human expert would have approached the problemConsult on the difficulty and nuance of specific prompts to ensure the AI is being tested against sufficiently rigorous scenariosSkillsElite Domain Mastery: Advanced degrees (PhD, MD, JD) or equivalent industry-recognized status (e.g., Senior Principal Engineer, Published Author, Award-Winning Creative)Professional Autonomy: You currently operate as an independent consultant or freelancer and have your own workflows, equipment, and professional methodologyInterest in Shaping Technology: While prior experience in AI evaluation is a bonus, it is absolutely not required. We want industry veterans who are eager to set the 'gold standard' for how AI should operate within their specific professionArticulate Reasoning: The ability to not just know the right answer, but to articulate the reasoning process clearly in writingGlobal Compliance: Candidates must be properly registered to operate as independent contractors in their country of residenceCompany OverviewWe are the AI training and scaling partner for the leading foundation model providers, enterprises, and governments, bridging the gap between AI potential and production. It was founded in 2015, and is headquartered in , with a workforce of 201-500 employees. Its website is https://www.meridial.ai/.