[Remote] Staff AI Engineer

Note: The job is a remote job and is open to candidates in USA. Machinify is a leading healthcare intelligence company specializing in AI-powered solutions for health plans. They are seeking a Staff AI Engineer to design and build LLM applications while integrating foundation models and ensuring production-grade infrastructure.ResponsibilitiesDesign and build LLM applications: RAG pipelines, agents, tool-use systems, structured generation, multi-step workflowsOwn prompt engineering and evaluation — write evals before you write prompts, and treat both as codeIntegrate foundation models (Claude, GPT, Gemini, open-weight Llama/Qwen/Mistral) and know when to reach for whichBuild the unglamorous infrastructure that makes LLMs production-grade: caching, streaming, retries, fallbacks, cost controls, observability, guardrailsFine-tune or distill models when prompting hits a wall (LoRA/QLoRA, SFT, DPO)Partner with product and design on UX patterns specific to AI (latency masking, streaming UIs, confidence display, human-in-the-loop)Skills3+ years of software engineering, with at least 1 year shipping LLM-based features in productionStrong Python and TypeScript; comfortable in a real codebase, not just notebooksDeep practical knowledge of the LLM stack: prompting techniques, function calling, structured outputs, context management, embedding models, vector searchHave built and maintained an eval suite — and have opinions on why most public benchmarks are misleadingComfortable with at least one orchestration approach (custom, LangGraph, Inngest, Temporal) and one vector store (pgvector, Pinecone, Turbopuffer, Weaviate)Cost- and latency-aware: can read a token bill and a trace and know where to cutClear communicator who can push back when 'just add AI' isn't the right answerExperience with agent frameworks and MCP (Model Context Protocol)Fine-tuning experience on open-weight models, or work with inference servers like vLLM/TGI/SGLangBackground in security, evals, or red-teaming for LLM systemsContributions to open-source AI toolingBenefitsWork from anywhere in the US! Machinify is digital-first.Top Medical/Dental/Vision offeringsFSA/HSATuition reimbursementCompetitive salary, 401(k) with company matchUnlimited PTOAdditional health and wellness benefits and perksFlexible and trusting environment where you’ll feel empowered to do your best workMeaningful equityHealthcareCompany OverviewMachinify is a SaaS platform that enables non-technical enterprises to build AI-powered products and processes. It was founded in 2016, and is headquartered in Palo Alto, California, USA, with a workforce of 1001-5000 employees. Its website is http://www.machinify.com.