[Remote] Sr. Software Engineer II - AI

Note: The job is a remote job and is open to candidates in USA. iHerb is on a mission to make health and wellness accessible to all, and they are seeking a Senior Software Engineer II - AI to lead the development of GenAI-powered product experiences and the AI platform infrastructure. The role involves designing and operating production AI features, building shared AI platform layers, and ensuring quality and performance of AI systems.ResponsibilitiesDesign, build, and operate production AI features: RAG pipelines, LLM-driven recommendations, conversational agents, or agentic workflow automationBuild the shared AI platform layer: retrieval infrastructure, eval frameworks, model monitoring, guardrails, and observabilityWrite LLM applications and integrations with marketing platforms, BI tools, or customer-facing product surfacesEvaluate model and feature quality using structured eval frameworks; iterate on prompts, retrieval strategies, and model selection using dataUse AI-driven SDLC tooling such as Claude Code as a daily practice for both AI and non-AI codeCoordinate with the Personalization team to align GenAI product features with existing ML personalization signalsDocument AI system design decisions, evaluation results, and operational lessons in the shared knowledge baseOwn the observability of AI systems you build: latency, cost, quality drift, and error rates; participate in on-call rotation and respond to production incidentsSkillsAI-driven SDLC: hands-on experience shipping production code with AI-assisted development tools such as Claude Code, GitHub Copilot, or Cursor. The bar is not awareness; it is daily use in delivering real softwareFull-stack awareness: comfortable contributing across layers of the stack when needed; purely single-layer specialists are not the target profileProduction ownership: experience owning features end-to-end from spec through deployment, observability, and on-call. Engineers here own what they ship; there is no separate ops handoffCode quality fundamentals: strong grasp of software design principles, automated testing, code review, and CI/CDFully autonomous; drives technical decisions within the team; mentors junior engineersPython proficiency; comfortable building and operating production LLM applicationsHands-on experience with at least one specialization: RAG and retrieval systems, LLM evaluation, agentic frameworks (LangChain, LlamaIndex, or similar), or LLM-based workflow automationUnderstanding of prompt engineering, context window management, and LLM output quality tradeoffsFamiliarity with vector databases, embedding models, or semantic searchHigh degree of accuracy and attention to detailExcellent organization skills and ability to multi-taskExposure to MLOps tooling or model deployment pipelinesContributions to internal developer tooling, golden path standards, or SDLC process improvementsExperience with e-commerce platforms, product catalogs, or high-traffic consumer applicationsExposure to MLOps tooling or model deployment pipelinesExperience working in globally distributed teamsTrack record of documenting architectural decisions, writing RFCs, or contributing to engineering wikisExperience with Microsoft Office Suite (Word, Excel, PowerPoint)Experience with Google Business Suite (Gmail, Drive, Docs, Sheets, Forms) preferredBenefitsEmployees (and their families) that meet eligibility criteria as outlined in applicable plan documents are eligible to participate in our medical, dental, vision, and basic life insurance programs and may enroll in our company’s 401(k) plan.Employees will also be eligible for Time Off and Paid Sick Leave pursuant to the company’s policies.Employees will enjoy paid holidays throughout the calendar year.Hired applicant may be awarded Restrict Stock Units and receive annual bonuses pursuant to eligibility and performance criteria defined in the respective plan documents and policies.Company OverviewiHerb is on a mission to make health and wellness accessible to all. It was founded in 1996, and is headquartered in Irvine, California, USA, with a workforce of 1001-5000 employees. Its website is http://www.iherb.com.Company H1B SponsorshipiHerb has a track record of offering H1B sponsorships, with 1 in 2026, 4 in 2025, 2 in 2024, 2 in 2023, 6 in 2022, 2 in 2021, 1 in 2020. Please note that this does not guarantee sponsorship for this specific role.