[Remote] Machine Learning Engineer, Chakra

Note: The job is a remote job and is open to candidates in USA. HackerRank helps companies like NVIDIA, Amazon, and Microsoft hire and upskill developers based on skills. The Machine Learning Engineer will architect and develop an AI interviewer, ensuring consistency and quality in candidate evaluations.ResponsibilitiesArchitect and develop Chakra end to end: the agent design, conversation management, real-time response evaluation, scoring methodology, and report generationBuild the systems that ensure interview consistency at scale. Not just model capability, but the infrastructure that makes the 200,000th interview as coherent as the firstDesign evaluation and benchmarking pipelines that measure interview quality, candidate experience consistency, and report defensibilityBuild fine-tuning and RLHF workflows to push model judgment past what off-the-shelf models deliver for this specific taskOwn the quality bar. Define what a good interview looks like, instrument how well the system meets that bar, and close the gap systematicallyWork across the full stack: data pipelines, model serving, latency constraints, and the product experience the candidate actually encountersSkillsYou have built and shipped agentic or conversational AI systems in production, not just prototypesYou have a strong intuition for where LLM behavior breaks down under real-world conditions and how to address it systematicallyYou think in systems. The conversation architecture, the evaluation model, the serving infrastructure, and the candidate experience are one problem to youYou care about the quality bar at the level of a user who depends on the output, not just a researcher measuring aggregate metricsExperience building multi-turn conversational agents or interview-style AI systemsWorked with RLHF, Constitutional AI, or preference-based fine-tuning methodsBackground in dialogue systems, conversational evaluation, or rubric-based scoringPublications or contributions in agentic AI, LLM reliability, or evaluation of generative systemsBenefitsTarget 10% annual bonus tied to individual and company performanceEquity (stock options)Comprehensive package of cash and non-cash benefitsCompany OverviewHackerRank provides a platform that helps companies to evaluate technical skills and create opportunities. It was founded in 2009, and is headquartered in Mountain View, California, USA, with a workforce of 201-500 employees. Its website is http://hackerrank.com.Company H1B SponsorshipHackerRank has a track record of offering H1B sponsorships, with 1 in 2020. Please note that this does not guarantee sponsorship for this specific role.