Applied AI Research Scientist, LLM
Job Description: • Design graduate- and research-level evaluation questions grounded in hardware and computer engineering domains • Create tasks that require precise, step-by-step technical reasoning with verifiable ground-truth answers • Develop multimodal prompts when appropriate • Evaluate AI models on hardware- and systems-heavy reasoning tasks • Identify and document model failure modes • Provide authoritative solutions for each evaluation task • Maintain detailed records of prompts, expected answers, and outcomes Requirements: • MS or Ph.D. in Computer Engineering, Electrical Engineering, Computer Science, or a closely related field • Strong expertise in at least two hardware- and systems-focused domains: Computer architecture, Hardware systems and performance analysis, VLSI design, digital logic, Embedded systems, Operating systems, Compilers or systems programming • Proven experience in technical research, evaluation, or rigorous problem formulation in academic, lab, or production environments • Strong programming skills (especially Python, C or C++) • Excellent written communication skills and strong attention to technical detail Benefits: • Contractor assignment (no medical/paid leave) • Flexible work arrangements Apply tot his job