[Remote] Lead AI Platform Engineer

Note: The job is a remote job and is open to candidates in USA. EPAM Systems is seeking a Lead AI Platform Engineer to lead the design and evolution of a next-generation AI Gateway platform. This role involves owning the architecture for secure, scalable access to Large Language Models and agentic workflows, ensuring integration and governance across the enterprise.ResponsibilitiesDevelop the AI Gateway platform, including MCP, agents, LLM routing, governance and observabilityTranslate business and product requirements into clear problem statements, architectural designs and scalable technical solutionsDesign extensible frameworks for MCP server capabilities and integrations as well as agent orchestration and reusable agent skillsArchitect gateway capabilities such as semantic caching for LLM responses, rate limiting, quotas and traffic governance and guardrails and validation layers for safe LLM/MCP usageDesign and review authentication and authorization models, including multiple OIDC-based flows, identity propagation and token-based access control for MCP and LLM trafficBuild prototypes and reference implementations to validate architectural decisions and guide engineering teamsPartner with multiple product teams integrating with the AI Gateway, providing architecture guidance, best practices and integration patternsReview designs and code, providing actionable feedback to ensure quality, performance, scalability and securityDefine and review CI/CD best practices using modern GitHub-based pipelinesArchitect and review Kubernetes-based deployment models, ensuring scalability, resiliency and production readinessSkills5+ years of software engineering experienceProven experience designing and delivering large-scale distributed systems or platform productsProficiency in Golang and PythonFamiliarity with AI-centric development with a strong emphasis on quality gates and architecture patterns to enforce agentic behavior in producing quality codeDeep understanding of AI gateways, AI/LLM platforms or middleware systems, including routing, governance and scalabilityExperience with microservices and service-oriented architectures for multi-tenant SAAS environments, PostgreSQL for transactional data and Redis for caching and distributed coordinationStrong background in authentication and authorization systems, particularly OAuth-based approachesDemonstrated ability to independently drive problem definition, architecture, prototype and execution guidanceExperience designing platforms and frameworks used by multiple product teamsEnglish proficiency at B2 level or higherExperience with MCP (Model Context Protocol), agentic platforms or AI orchestration frameworksKnowledge or know-how in working with EDA softwarePrior work on LLM gateways, API gateways or AI middleware platformsExperience building generic developer frameworks or SDKs adopted across teamsFamiliarity with guardrails, semantic caching, prompt/response optimization and LLM cost control techniquesBenefitsDelivering innovative solutions to industry leaders, making a global impactEnjoyable working environment, whether it is the vibrant office or the comfort of your homeOpportunity to work abroad for up to two months per yearRelocation opportunities within our offices in 55+ countriesCorporate and social eventsLeadership development, career advising, soft skills and well-being programsCertifications, including GCP, Azure and AWSUnlimited access to LinkedIn Learning and UdemyFree English classes with certified teachersParticipation in the Employee Stock Purchase PlanMonetary bonuses for engaging in the referral programComprehensive medical & family care packageFour trust days per year for personal needsDiscounts for fitness clubsBenefits package (hotels, restaurants, stores and services)Company OverviewEPAM leverages its core engineering expertise as a leading global product development and digital platform engineering services company. It was founded in 1993, and is headquartered in Newtown, Pennsylvania, USA, with a workforce of 10001+ employees. Its website is https://www.epam.com.Company H1B SponsorshipEPAM Systems has a track record of offering H1B sponsorships, with 11 in 2026, 120 in 2025, 172 in 2024, 232 in 2023, 373 in 2022, 359 in 2021, 502 in 2020. Please note that this does not guarantee sponsorship for this specific role.