[Remote] Senior AI Product Engineer, Backend

Note: The job is a remote job and is open to candidates in USA. Arize AI is the leading AI & Agent Engineering observability and evaluation platform, empowering AI engineers to ship high-performing, reliable agents and applications. The Senior AI Product Engineer, Backend will be responsible for building scalable distributed services for Arize's ML observability platform, primarily using Go, Java, and Python, while collaborating with cross-functional teams to enhance product offerings.ResponsibilitiesWrite maintainable, scalable, and performant backend code primarily in Go, Java, and Python, with opportunities to work in TypeScriptBuild high-volume and highly available analytics systemsDesign and build APIs specific to our customers’ Machine Learning and LLM workflowsPrototype, optimize, and maintain scalable backend services that power the Arize core platformExtend, and contribute back to, open source OLAP databases and distributed message queue frameworksDevelop and integrate collection tools for robust monitoring of ML and LLM pipelinesResearch and implement cutting-edge visualization & dimensionality reduction algorithms in a distributed environmentCollaborate with our product, design, and directly with customer engineering teams to enhance and expand our product offeringsContribute to the build our own in-house AI AgentsSkills5+ years of experience working with high-performance backend systemsStrong experience writing Go, Python, TypeScript/Node, Java, or similar server programming languagesEnthusiasm and interest in the AI and LLM ecosystem, with a desire to learn and stay updated on emerging technologiesPrevious work building and operating highly complex SaaS platforms/systemsKnowledge of working with public clouds & container orchestration - AWS, GCP, Azure, Kubernetes, etcExperience with distributed stream processing - Kafka, Gazette, or similarExperience with OLAP systemsFamiliarity with system observability tooling like PrometheusWorking knowledge of Machine Learning and/or Data ScienceFirst-hand experience working with large language models (LLMs) or developing AI productsBenefitsA competitive equity packageA comprehensive benefits package, including medical, dental, visionA 401(k) planUnlimited paid time offA generous parental leave planAdditional support for mental health and wellnessWFH monthly stipend to pay for co-working spacesCompany OverviewArize is an AI engineering platform focused on evaluation and observability. It helps engineers develop, evaluate, and observe AI agents. It was founded in 2020, and is headquartered in Berkeley, California, USA, with a workforce of 51-200 employees. Its website is https://arize.com.Company H1B SponsorshipArize AI has a track record of offering H1B sponsorships, with 1 in 2025, 1 in 2024. Please note that this does not guarantee sponsorship for this specific role.