[Remote] Senior AI Product Engineer, Backend

Note: The job is a remote job and is open to candidates in USA. Arize AI is the leading AI & Agent Engineering observability and evaluation platform, empowering AI engineers to ship high-performing, reliable agents and applications. The Senior AI Product Engineer will be part of the Backend Engineering team, responsible for building scalable distributed services and designing APIs for Machine Learning workflows.ResponsibilitiesWrite maintainable, scalable, and performant backend code primarily in Go, Java, and Python, with opportunities to work in TypeScriptBuild high-volume and highly available analytics systemsDesign and build APIs specific to our customers' Machine Learning and LLM workflowsPrototype, optimize, and maintain scalable backend services that power the Arize core platformExtend, and contribute back to, open source OLAP databases and distributed message queue frameworksDevelop and integrate collection tools for robust monitoring of ML and LLM pipelinesResearch and implement cutting-edge visualization & dimensionality reduction algorithms in a distributed environmentCollaborate with our product, design, and directly with customer engineering teams to enhance and expand our product offeringsContribute to the build our own in-house AI AgentsSkills5+ years of experience working with high-performance backend systemsStrong experience writing Go, Python, TypeScript/Node, Java, or similar server programming languagesEnthusiasm and interest in the AI and LLM ecosystem, with a desire to learn and stay updated on emerging technologiesPrevious work building and operating highly complex SaaS platforms/systemsKnowledge of working with public clouds & container orchestration - AWS, Google Cloud Platform, Azure, Kubernetes, etcExperience with distributed stream processing - Kafka, Gazette, or similarExperience with OLAP systemsFamiliarity with system observability tooling like PrometheusWorking knowledge of Machine Learning and/or Data ScienceFirst-hand experience working with large language models (LLMs) or developing AI productsBenefitsA competitive equity packageA comprehensive benefits package, including medical, dental, vision, a 401(k) plan, unlimited paid time off, a generous parental leave plan, and additional support for mental health and wellnessWFH monthly stipend to pay for co-working spacesRegularly have chats with industry experts, researchers, and ethicists across the ecosystem to advance the use of responsible AICulturally conscious events such as LGBTQ trivia during pride monthWe have an active Lady Arizers subgroupCompany OverviewDice is a job-searching platform for technology professionals. It is a sub-organization of DHI Group. It was founded in 1990, and is headquartered in Santa Clara, California, USA, with a workforce of 201-500 employees. Its website is http://www.dice.com.Company H1B SponsorshipDice has a track record of offering H1B sponsorships, with 2 in 2022, 4 in 2021, 5 in 2020. Please note that this does not guarantee sponsorship for this specific role.