[Remote] Customer Support Specialist (Russian) | $11/hr Remote

Note: The job is a remote job and is open to candidates in USA. Crossing Hurdles is seeking a LLM AI Quality Analyst (Personalization) who is proficient in Russian. The role involves evaluating AI model responses for quality and effectiveness, designing prompts to test AI capabilities, and collaborating with teams to enhance model performance.ResponsibilitiesEvaluate AI model responses for personalization quality, including grounding, integration, and helpfulnessDesign and execute multi-turn prompts based on personal context to test AI capabilitiesAnalyze responses for hallucinations, incorrect personalization, and poor inferencesPerform side-by-side comparison of model outputs to determine quality and effectivenessWrite clear and structured rationales for response evaluations and rankingsExtract and verify debug information to ensure proper use of data sourcesMaintain strict data hygiene and ensure accurate documentation of evaluationsCollaborate with cross-functional teams to improve AI model performanceSkillsStrong proficiency in Russian with excellent reading and writing skillsExperience in data annotation, AI evaluation, content moderation, or a related roleStrong analytical thinking and ability to assess nuanced AI responsesAbility to design creative, multi-turn prompts based on personal contextUnderstanding of personalization concepts, including identifying incorrect or forced personalizationHigh attention to detail in evaluating subtle differences in model outputsExcellent written communication and structured reasoning skillsAbility to work independently in a remote environmentWillingness to use a personal Google account for evaluation purposesFull-time availability with at least 4 hours overlap with PSTBachelor's degree or equivalent experience in a relevant analytical fieldCompany OverviewCrossing Hurdles connects skilled professionals with opportunities across AI training platforms and high-growth companies. It was founded in 2019, and is headquartered in Gurgaon, Haryana, IND, with a workforce of 51-200 employees. Its website is https://www.crossinghurdles.com.