[Remote] Director of Product Management, AI Evals

Note: The job is a remote job and is open to candidates in USA. Harness is the AI Software Delivery Platform company, led by technologist and entrepreneur Jyoti Bansal. They are seeking a Director of Product Management to lead the AI Evaluation module, focusing on how engineering teams measure, validate, and improve AI applications in production.ResponsibilitiesDesign AI-assisted experiences for eval authoring, failure analysis, and remediation recommendationsOwn the vision, strategy, roadmap, and P&L for Harness's AI Evals modulePartner with engineering to deliver scalable, differentiated solutions that developers loveWork closely with GTM teams (sales, marketing, customer success) on positioning, adoption, and revenue growthEngage directly with customers to shape the roadmap, improve adoption, and ensure measurable business impactDrive competitive positioning and track product metricsSkills8+ years of product management experience, including AI/ML technologies, developer tooling, or platform productsExperience owning business outcomes including strategy, positioning, and revenue impactStrong communication and stakeholder management skills across product, engineering, and GTM teamsObsessed with customer success and outcome-drivenStrong understanding of: LLM evaluation methodologies, CI/CD pipelines and developer workflows, AI observability, monitoring, and quality assurance, Agentic AI systems and the unique evaluation challenges they presentExperience building AI/ML evaluation or observability platforms at scaleExperience in building products from the ground upFamiliarity with prompt engineering, fine-tuning pipelines, and dataset versioningExposure to AI governance, responsible AI frameworks, or automated remediationCloud-native and enterprise SaaS experienceBenefitsCompetitive salaryComprehensive healthcare benefitsFlexible Spending Account (FSA)Flexible work scheduleEmployee Assistance Program (EAP)Flexible Time Off and Parental LeaveMonthly, quarterly, and annual social and team building eventsMonthly internet reimbursementCompany OverviewHarness provides a software delivery platform that helps engineering teams build, deploy, and operate applications through a set of tools. It was founded in 2017, and is headquartered in San Francisco, California, USA, with a workforce of 501-1000 employees. Its website is http://harness.io.Company H1B SponsorshipHarness has a track record of offering H1B sponsorships, with 8 in 2026, 31 in 2025, 22 in 2024, 10 in 2023, 36 in 2022, 6 in 2021, 21 in 2020. Please note that this does not guarantee sponsorship for this specific role.