[Remote] Data Engineer | Remote
Note: The job is a remote job and is open to candidates in USA. CodeGeniusRecruit is a company looking for a Data Engineer to work remotely on a contract basis. The role involves authoring complex benchmark tasks, designing evaluations for language models, and contributing to benchmark datasets for professional document understanding.ResponsibilitiesAuthor complex, multi-step benchmark tasks grounded in real-world workspace files including technical specs, architecture docs, API references, and codebasesDesign tasks that evaluate the ability of language models and systems to reason over technical documentation and follow precise instructionsPair each task with a clearly defined ground truth output and an objective evaluation rubricIncorporate web search and code execution into task design to reflect professional, real-world workflowsContribute to the development of benchmark datasets used to assess LLMs on professional document understanding and instruction following within the Technology domainSkillsStrong experience in software engineering, data science, or analytics in a hands-on professional capacityStrong experience in authoring or evaluating technical documentation, including architecture docs, API references, or codebasesStrong experience in designing structured, multi-step tasks with measurable outputs and evaluation criteriaStrong experience working independently in a remote, self-directed contract environmentCompany OverviewCodeGeniusRecruit connects developers with high-quality remote opportunities across AI, machine learning, and software engineering. It was founded in undefined, and is headquartered in , with a workforce of 2-10 employees. Its website is https://www.codegeniusrecruit.com.