[Remote] Software Engineer, AI

Note: The job is a remote job and is open to candidates in USA. Lattice is a people success platform focused on enhancing employee development and engagement. They are seeking a Software Engineer specializing in AI to contribute to AI evaluation pipelines and improve the quality of AI systems, ensuring high-quality user experiences.ResponsibilitiesContribute to AI evaluation pipelines, including offline evals, production tracing, and feedback systemsImplement and maintain performance metrics (e.g., response quality, task success, reliability) using established frameworksHelp create and maintain evaluation datasets and test cases to identify regressionsAnalyze results and propose incremental improvements to model and agent qualityContribute to AI system components such as RAG pipelines, retrieval systems, and multi-step workflows within existing architecturesWrite clean, maintainable Python code that integrates with LLM providers and internal servicesSupport improvements to system reliability, observability, and performance in productionDeliver well-scoped projects with guidance from more senior engineersBreak down tasks, make steady progress, and be proactive in unblocking yourself by asking for help when neededContribute to team excellence through code reviews, documentation, and knowledge sharingCollaborate with cross-functional partners to ship user-facing featuresSkills2–5 years of professional software engineering experienceExperience contributing to production systems as part of a teamExposure to AI/ML systems with a strong interest in LLM-powered productsExperience debugging systems, working with data, and iterating on performanceProficiency in Python or a similar languageStrong understanding of LLM concepts (prompting, RAG, evaluation)Familiarity with backend systems, APIs, and cloud environments (e.g., AWS, GCP)Exposure to logging, monitoring, or debugging toolsInterest in learning tools like LangGraph, vector databases, and evaluation platformsStrong ownership: you reliably deliver high-quality work on well defined tasks, on time and communicate progress clearlyLearning mindset: you actively seek feedback and improve quicklyPragmatic and product-minded: you focus on solving problems effectively and not perfectlyCollaborative: you contribute to team discussions and uphold engineering best practicesGrowth-oriented: you actively seek feedback and expand your skills in AI engineeringHands-on experience with LLMs, prompt iteration, or MLOpsFamiliarity with vector databases or retrieval systemsExposure to experimentation, metrics, or basic statistical analysisFamiliarity with TypeScriptBenefitsMedical insuranceDental insuranceLife, AD&D, and Disability InsuranceNatural Disaster Support ProgramWellness AppsPaid Parental LeavePaid Time off inclusive of holidays and sick timeWorking Remotely StipendOne time WFH Office Set-Up StipendRetirement PlanFinancial PlanningLearning & Development BudgetCompany OverviewLattice is a people success platform that help business leaders develop engaged, high-performing employees, and winning cultures. It was founded in 2015, and is headquartered in San Francisco, California, USA, with a workforce of 501-1000 employees. Its website is http://www.lattice.com.