[Remote] Lead Software Engineer – AI/RAG Platform

Note: The job is a remote job and is open to candidates in USA. Floor & Decor is a leading retailer in the home improvement sector, and they are seeking a Lead Software Engineer for their AI/RAG Platform. The role involves providing technical leadership for developing and maintaining solutions on the ServiceNow platform, focusing on AI applications and integrations with retail systems.ResponsibilitiesArchitect, develop, and continuously improve a production RAG agent built on Azure OpenAI — including chunking strategies, vector indexing, retrieval ranking, and prompt engineeringLead full-stack development across an Angular front end and a Python-based service and LLMOps layerDesign and maintain MCP (Model Context Protocol) integrations with inventory and merchandising systems to ground AI responses in live operational dataOwn the model evaluation pipeline using Ragas to track faithfulness, answer relevance, and context precision metrics across releasesMake architectural decisions for reliability, scalability, and observability of all AI services deployed in AzureLead, mentor, and conduct code reviews for a team of software engineers, fostering a culture of quality and continuous learningWork closely with product managers and business stakeholders to understand associate pain points, translate them into technical requirements, and prioritize the backlogChampion agile practices — participate in sprint planning, retrospectives, and daily stand-ups as a senior voice on the teamCommunicate technical trade-offs and architectural decisions clearly to both technical and non-technical audiencesEvaluate emerging LLM capabilities, tooling, and Azure OpenAI updates; recommend and prototype improvements to keep the platform currentEstablish and maintain engineering best practices including CI/CD pipelines, code quality standards, and security practices for AI workloadsTroubleshoot and resolve complex issues in retrieval quality, LLM hallucination, latency, and integration reliabilitySkills7–10 years of professional software engineering experience, with increasing scope and ownershipHands-on experience designing and deploying 2–5 production RAG agents or AI-powered applicationsProficiency in Python for backend services and LLM orchestration (LangChain, Semantic Kernel, or similar frameworks)Working knowledge of Angular or comparable modern front-end frameworksDemonstrated experience with Azure OpenAI services — including LLM APIs, Azure AI Search (vector/index), and associated Azure infrastructureExperience with service-based and microservice architectures, RESTful API design, and async service communicationFamiliarity with MCP or other tool-calling/function-calling patterns for LLM-to-system integrationsExperience with cloud environments (Azure preferred) including compute, storage, networking, and IAM fundamentalsPractical knowledge of agile/scrum methodologies — sprint ceremonies, story estimation, backlog groomingExperience with Ragas or other LLM evaluation frameworks (RAGAS, ROUGE, G-Eval, etc.)Familiarity with retail systems — POS, OMS, inventory/merchandising platformsExposure to LLMOps tooling such as MLflow, Weights & Biases, or Azure MLPrior experience in a Center of Excellence or innovation-focused team within a larger enterpriseBenefitsBonus opportunities & career advancement opportunities at every levelPrograms that help you reach your financial goals: 401k with company match, Employee Stock Purchase Plan, and Referral Bonus ProgramMedical, Dental, Vision, Life, and other Insurance Plans (subject to eligibility criteria)Paid vacation and sick time for eligible associatesPaid holidays plus a personal holidayPaid Volunteer Time Off that starts on Day 1Company OverviewFloor & Decor is a high-growth, differentiated, multi-channel specialty retailer of hard surface flooring and related accessories. It was founded in 2000, and is headquartered in Smyrna, Georgia, USA, with a workforce of 10001+ employees. Its website is https://www.flooranddecor.com/.